Astraios: Parameter-Efficient Instruction Tuning Code Large Language
Models

Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models

1 January 2024

Nitchakarn Suppattarachai

Leandro von Werra

Niklas Muennighoff

ArXiv (abs)PDF HTML HuggingFace (24 upvotes)

Papers citing "Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models"

14 / 14 papers shown

Title
OMPILOT: Harnessing Transformer Models for Auto Parallelization to Shared Memory Computing Paradigms Arijit Bhattacharjee Ali TehraniJamsaz Le Chen N. Hasabnis Mihai Capota Nesreen K. Ahmed Ali Jannesari 108 0 0 05 Nov 2025
Breaking Memorization Barriers in LLM Code Fine-Tuning via Information Bottleneck for Improved Generalization Changsheng Wang Xin Chen Sijia Liu Ke Ding CLL 140 0 0 15 Oct 2025
Training Language Model Agents to Find Vulnerabilities with CTF-Dojo Terry Yue Zhuo Dingmin Wang Hantian Ding Varun Kumar Zijian Wang ELM 151 1 0 25 Aug 2025
Vision-G1: Towards General Vision Language Reasoning with Multi-Domain Data Curation Yuheng Zha Kun Zhou Yujia Wu Yushu Wang Jie Feng Zhi Xu Shibo Hao Zhengzhong Liu Eric P. Xing Zhiting Hu LRM VLM 100 3 0 18 Aug 2025
The Impact of Fine-tuning Large Language Models on Automated Program Repair Roman Macháček Anastasiia Grishina Max Hort Leon Moonen 116 1 0 26 Jul 2025
Turbulence: Systematically and Automatically Testing Instruction-Tuned Large Language Models for CodeInternational Conference on Information Control Systems & Technologies (ICICST), 2023 Shahin Honarvar Mark van der Wilk Alastair Donaldson 423 12 0 28 Jan 2025
LoRA vs Full Fine-tuning: An Illusion of Equivalence Reece Shuttleworth Jacob Andreas Antonio Torralba Pratyusha Sharma 404 51 0 28 Oct 2024
MergeRepair: An Exploratory Study on Merging Task-Specific Adapters in Code LLMs for Automated Program Repair Meghdad Dehghan Jie JW Wu Fatemeh H. Fard Ali Ouni MoMe 348 3 0 18 Aug 2024
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions Terry Yue Zhuo Minh Chien Vu Jenny Chim Han Hu Wenhao Yu ... David Lo Daniel Fried Xiaoning Du H. D. Vries Leandro von Werra 563 353 0 22 Jun 2024
A Survey on Large Language Models for Code Generation Juyong Jiang Fan Wang Jiasi Shen Sungju Kim Sunghun Kim 486 456 0 01 Jun 2024
Large Language Models Meet NLP: A Survey Libo Qin Qiguang Chen Xiachong Feng Yang Wu Yongheng Zhang Hai-Tao Zheng Min Li Wanxiang Che Philip S. Yu LRM ALM LM&MA ELM 415 113 0 21 May 2024
LoRA Learns Less and Forgets Less D. Biderman Jose Javier Gonzalez Ortiz Jacob P. Portes Mansheej Paul Philip Greengard ... Sam Havens Vitaliy Chiley Jonathan Frankle Cody Blakeney John P. Cunningham CLL 309 224 0 15 May 2024
Language models scale reliably with over-training and on downstream tasksInternational Conference on Learning Representations (ICLR), 2024 S. Gadre Georgios Smyrnis Vaishaal Shankar Suchin Gururangan Mitchell Wortsman ... Y. Carmon Achal Dave Reinhard Heckel Niklas Muennighoff Ludwig Schmidt ALM ELM LRM 273 74 0 13 Mar 2024
WizardCoder: Empowering Code Large Language Models with Evol-InstructInternational Conference on Learning Representations (ICLR), 2023 Ziyang Luo Can Xu Lu Wang Qingfeng Sun Xiubo Geng Wenxiang Hu Chongyang Tao Jing Ma Qingwei Lin Daxin Jiang ELM SyDa ALM 678 836 0 14 Jun 2023