v1v2v3v4 (latest)

Parameter-Efficient Fine-Tuning via Circular Convolution

27 July 2024

Papers citing "Parameter-Efficient Fine-Tuning via Circular Convolution"

50 / 64 papers shown

Title
Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding HelpsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Jiashun Cheng Chenyi Zi Polydoros Giannouris Ziqi Gao Yuhan Li Jia Li Fugee Tsung 184 0 0 20 Jun 2025
RaSA: Rank-Sharing Low-Rank AdaptationInternational Conference on Learning Representations (ICLR), 2025 Zhiwei He Zhaopeng Tu Xing Wang Xingyu Chen Zhaoxiang Wang Jiahao Xu Tian Liang Wenxiang Jiao Zizhuo Zhang Rui Wang ALM 297 4 0 16 Mar 2025
G-Refer: Graph Retrieval-Augmented Large Language Model for Explainable RecommendationThe Web Conference (WWW), 2025 Yuhan Li Xinni Zhang Linhao Luo Heng Chang Yuxiang Ren Irwin King Jiajian Li 226 25 0 18 Feb 2025
PETapter: Leveraging PET-style classification heads for modular few-shot parameter-efficient fine-tuning Jonas Rieger Mattes Ruckdeschel Gregor Wiedemann VLM 170 1 0 06 Dec 2024
Adam-mini: Use Fewer Learning Rates To Gain More Yushun Zhang Congliang Chen Ziniu Li Tian Ding Chenwei Wu Yinyu Ye Zhi-Quan Luo Tian Ding 378 83 0 24 Jun 2024
The Impact of Initialization on LoRA Finetuning Dynamics Soufiane Hayou Nikhil Ghosh Bin Yu AI4CE 207 41 0 12 Jun 2024
Bridging The Gap between Low-rank and Orthogonal Adaptation via Householder Reflection Adaptation Shen Yuan Haotian Liu Hongteng Xu 242 9 0 24 May 2024
Parameter-Efficient Fine-Tuning with Discrete Fourier TransformInternational Conference on Machine Learning (ICML), 2024 Ziqi Gao Qichao Wang Chenyi Zi Zijing Liu Bingzhe Wu Liang Chen Jia Li 269 54 0 05 May 2024
LoRA+: Efficient Low Rank Adaptation of Large Models Soufiane Hayou Nikhil Ghosh Bin Yu AI4CE 398 307 0 19 Feb 2024
ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphs Yuhan Li Peisong Wang Zhixun Li Jeffrey Xu Yu Jia Li 251 75 0 17 Feb 2024
DoRA: Weight-Decomposed Low-Rank Adaptation Shih-yang Liu Chien-Yi Wang Hongxu Yin Pavlo Molchanov Yu-Chiang Frank Wang Kwang-Ting Cheng Min-Hung Chen 702 658 0 14 Feb 2024
RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust AdaptationInternational Conference on Machine Learning (ICML), 2024 Mahdi Nikdan Soroush Tabesh Elvir Crnčević Dan Alistarh 389 45 0 09 Jan 2024
Magicoder: Empowering Code Generation with OSS-InstructInternational Conference on Machine Learning (ICML), 2023 Yuxiang Wei Zhe Wang Jiawei Liu Yifeng Ding Lingming Zhang SyDa 243 187 0 04 Dec 2023
Parameter-Efficient Orthogonal Finetuning via Butterfly FactorizationInternational Conference on Learning Representations (ICLR), 2023 Weiyang Liu Zeju Qiu Yao Feng Yuliang Xiu Yuxuan Xue ... Songyou Peng Yandong Wen Michael J. Black Adrian Weller Bernhard Schölkopf 388 95 0 10 Nov 2023
The Expressive Power of Low-Rank AdaptationInternational Conference on Learning Representations (ICLR), 2023 Yuchen Zeng Kangwook Lee 429 93 0 26 Oct 2023
VeRA: Vector-based Random Matrix AdaptationInternational Conference on Learning Representations (ICLR), 2023 D. J. Kopiczko Tijmen Blankevoort Yuki Markus Asano VLM 315 248 0 17 Oct 2023
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsInternational Conference on Learning Representations (ICLR), 2023 L. Yu Weisen Jiang Han Shi Jincheng Yu Zhengying Liu Yu Zhang James T. Kwok Zheng Li Adrian Weller Weiyang Liu OSLM LRM 521 543 0 21 Sep 2023
WizardCoder: Empowering Code Large Language Models with Evol-InstructInternational Conference on Learning Representations (ICLR), 2023 Ziyang Luo Can Xu Lu Wang Qingfeng Sun Xiubo Geng Wenxiang Hu Chongyang Tao Jing Ma Qingwei Lin Daxin Jiang ELM SyDa ALM 682 838 0 14 Jun 2023
Controlling Text-to-Image Diffusion by Orthogonal FinetuningNeural Information Processing Systems (NeurIPS), 2023 Zeju Qiu Wei-yu Liu Haiwen Feng Yuxuan Xue Yao Feng Zhen Liu Dan Zhang Adrian Weller Bernhard Schölkopf DiffM 323 211 0 12 Jun 2023
Fine-Tuning Language Models with Just Forward PassesNeural Information Processing Systems (NeurIPS), 2023 Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 463 295 0 27 May 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code GenerationNeural Information Processing Systems (NeurIPS), 2023 Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 1.1K 1,358 0 02 May 2023
Segment AnythingIEEE International Conference on Computer Vision (ICCV), 2023 A. Kirillov Eric Mintun Nikhila Ravi Hanzi Mao Chloe Rolland ... Spencer Whitehead Alexander C. Berg Wan-Yen Lo Piotr Dollár Ross B. Girshick MLLM VLM 858 10,796 0 05 Apr 2023
Strong Baselines for Parameter Efficient Few-Shot Fine-tuningAAAI Conference on Artificial Intelligence (AAAI), 2023 S. Basu Daniela Massiceti S. Hu Soheil Feizi VLM 156 45 0 04 Apr 2023
Practical Solutions in Fully Homomorphic Encryption -- A Survey Analyzing Existing Acceleration Methods Yanwei Gong Xiaolin Chang J. Misic Vojislav B. Mišić Jianhua Wang Haoran Zhu 194 22 0 20 Mar 2023
LLaMA: Open and Efficient Foundation Language Models Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux ... Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave Guillaume Lample ALM PILM 2.9K 17,417 0 27 Feb 2023
On the Effectiveness of Parameter-Efficient Fine-TuningAAAI Conference on Artificial Intelligence (AAAI), 2022 Z. Fu Haoran Yang Anthony Man-Cho So Wai Lam Lidong Bing Nigel Collier 164 201 0 28 Nov 2022
Understanding and Improving Visual Prompting: A Label-Mapping PerspectiveComputer Vision and Pattern Recognition (CVPR), 2022 Chenyi Zi Yuguang Yao Pin-Yu Chen Yihua Zhang Sijia Liu VPVLM VLM 491 97 0 21 Nov 2022
Scaling & Shifting Your Features: A New Baseline for Efficient Model TuningNeural Information Processing Systems (NeurIPS), 2022 Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 330 328 0 17 Oct 2022
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningNeural Information Processing Systems (NeurIPS), 2022 Haokun Liu Derek Tam Mohammed Muqeeth Jay Mohta Tenghao Huang Joey Tianyi Zhou Colin Raffel 449 1,138 0 11 May 2022
Visual Prompt TuningEuropean Conference on Computer Vision (ECCV), 2022 Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 554 2,189 0 23 Mar 2022
Training Verifiers to Solve Math Word Problems K. Cobbe V. Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun ... Jerry Tworek Jacob Hilton Reiichiro Nakano Christopher Hesse John Schulman ReLM OffRL LRM 1.0K 6,623 0 27 Oct 2021
Towards a Unified View of Parameter-Efficient Transfer LearningInternational Conference on Learning Representations (ICLR), 2021 Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 535 1,085 0 08 Oct 2021
Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning Runxin Xu Fuli Luo Zhiyuan Zhang Chuanqi Tan Baobao Chang Songfang Huang Fei Huang LRM 291 212 0 13 Sep 2021
Program Synthesis with Large Language Models Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski ... Ellen Jiang Carrie J. Cai Michael Terry Quoc V. Le Charles Sutton ELM AIMat ReCod ALM 398 2,790 0 16 Aug 2021
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 1.2K 7,552 0 07 Jul 2021
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Elad Ben-Zaken Shauli Ravfogel Yoav Goldberg 936 1,513 0 18 Jun 2021
LoRA: Low-Rank Adaptation of Large Language ModelsInternational Conference on Learning Representations (ICLR), 2021 J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 1.5K 14,961 0 17 Jun 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 733 839 0 22 Apr 2021
Learning Transferable Visual Models From Natural Language SupervisionInternational Conference on Machine Learning (ICML), 2021 Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 2.0K 40,340 0 26 Feb 2021
Prefix-Tuning: Optimizing Continuous Prompts for GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Xiang Lisa Li Abigail Z. Jacobs 650 5,127 0 01 Jan 2021
Making Pre-trained Language Models Better Few-shot LearnersAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Tianyu Gao Adam Fisch Danqi Chen 785 2,164 0 31 Dec 2020
Parameter-Efficient Transfer Learning with Diff PruningAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Demi Guo Alexander M. Rush Yoon Kim 282 464 0 14 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 1.3K 53,970 0 22 Oct 2020
AdapterDrop: On the Efficiency of Adapters in Transformers Andreas Rucklé Gregor Geigle Max Glockner Tilman Beck Jonas Pfeiffer Nils Reimers Iryna Gurevych 329 288 0 22 Oct 2020
Measuring Massive Multitask Language UnderstandingInternational Conference on Learning Representations (ICLR), 2020 Dan Hendrycks Collin Burns Steven Basart Andy Zou Mantas Mazeika Basel Alomair Jacob Steinhardt ELM RALM 1.4K 6,344 0 07 Sep 2020
Language Models are Few-Shot LearnersNeural Information Processing Systems (NeurIPS), 2020 Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 2.0K 51,554 0 28 May 2020
PIQA: Reasoning about Physical Commonsense in Natural LanguageAAAI Conference on Artificial Intelligence (AAAI), 2019 Yonatan Bisk Rowan Zellers Ronan Le Bras Jianfeng Gao Yejin Choi OOD LRM 1.2K 2,447 0 26 Nov 2019
ViGGO: A Video Game Corpus for Data-To-Text Generation in Open-Domain ConversationInternational Conference on Natural Language Generation (INLG), 2019 Juraj Juraska Kevin K. Bowden M. Walker 90 53 0 26 Oct 2019
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLInternational Conference on Learning Representations (ICLR), 2019 Aniruddh Raghu M. Raghu Samy Bengio Oriol Vinyals 490 706 0 19 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 2.3K 27,615 0 26 Jul 2019

All Papers

Parameter-Efficient Fine-Tuning via Circular Convolution

Papers citing "Parameter-Efficient Fine-Tuning via Circular Convolution"