Title
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model AdaptationIEEE Transactions on Knowledge and Data Engineering (TKDE), 2022 Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao VLM CLL 169 50 0 22 Aug 2022
Z-Code++: A Pre-trained Language Model Optimized for Abstractive SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Pengcheng He Baolin Peng Liyang Lu Song Wang Jie Mei ... Chenguang Zhu Wayne Xiong Michael Zeng Jianfeng Gao Xuedong Huang 178 51 0 21 Aug 2022
Conv-Adapter: Exploring Parameter Efficient Transfer Learning for ConvNets Hao Chen R. Tao Han Zhang Yidong Wang Kaijie Zhu Weirong Ye Yongfeng Zhang Guosheng Hu Marios Savvides VPVLM 298 79 0 15 Aug 2022
Disentangled Modeling of Domain and Relevance for Adaptable Dense Retrieval Jingtao Zhan Jiaxin Mao Yiqun Liu Jiaxin Mao Xiaohui Xie Hao Fei Shaoping Ma 97 11 0 11 Aug 2022
Frozen CLIP Models are Efficient Video LearnersEuropean Conference on Computer Vision (ECCV), 2022 Ziyi Lin Shijie Geng Renrui Zhang Shiyang Feng Gerard de Melo Xiaogang Wang Jifeng Dai Yu Qiao Jiaming Song CLIP VLM 227 251 0 06 Aug 2022
Efficient Fine-Tuning of Compressed Language Models with Learners Danilo Vucetic Mohammadreza Tayaranian M. Ziaeefard J. Clark B. Meyer W. Gross 138 3 0 03 Aug 2022
Pro-tuning: Unified Prompt Tuning for Vision Tasks Xing Nie Bolin Ni Jianlong Chang Gaomeng Meng Chunlei Huo Zhaoxiang Zhang Shiming Xiang Qi Tian Chunhong Pan AAML VPVLM VLM 370 96 0 28 Jul 2022
Training Large-Vocabulary Neural Language Models by Private Federated Learning for Resource-Constrained DevicesIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022 Mingbin Xu Congzheng Song Ye Tian Neha Agrawal Filip Granqvist ... Shiyi Han Yaqiao Deng Leo Liu Anmol Walia Alex Jin FedML 175 28 0 18 Jul 2022
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text RetrieversConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Weng Lam Tam Xiao Liu Kaixuan Ji Lilong Xue Xing Zhang Yuxiao Dong Jiahua Liu Maodi Hu Jie Tang VPVLM 161 31 0 14 Jul 2022
Convolutional Bypasses Are Better Vision Transformer AdaptersEuropean Conference on Artificial Intelligence (ECAI), 2022 Shibo Jie Zhi-Hong Deng VPVLM 229 156 0 14 Jul 2022
Meta-Learning the Difference: Preparing Large Language Models for Efficient AdaptationTransactions of the Association for Computational Linguistics (TACL), 2022 Zejiang Hou Julian Salazar George Polovets 166 20 0 07 Jul 2022
When Does Differentially Private Learning Not Suffer in High Dimensions?Neural Information Processing Systems (NeurIPS), 2022 Xuechen Li Daogao Liu Tatsunori Hashimoto Huseyin A. Inan Janardhan Kulkarni Y. Lee Abhradeep Thakurta 301 62 0 01 Jul 2022
On-Device Training Under 256KB MemoryNeural Information Processing Systems (NeurIPS), 2022 Ji Lin Ligeng Zhu Wei-Ming Chen Wei-Chen Wang Chuang Gan Song Han MQ 393 257 0 30 Jun 2022
ST-Adapter: Parameter-Efficient Image-to-Video Transfer LearningNeural Information Processing Systems (NeurIPS), 2022 Junting Pan Ziyi Lin Xiatian Zhu Jing Shao Jiaming Song 320 259 0 27 Jun 2022
REVECA -- Rich Encoder-decoder framework for Video Event CAptioner Jaehyuk Heo YongGi Jeong Sunwoo Kim Jaehee Kim Pilsung Kang 98 0 0 18 Jun 2022
FiT: Parameter Efficient Few-shot Transfer Learning for Personalized and Federated Image ClassificationInternational Conference on Learning Representations (ICLR), 2022 Aliaksandra Shysheya J. Bronskill Massimiliano Patacchiola Sebastian Nowozin Richard Turner 3DH FedML 217 35 0 17 Jun 2022
Know your audience: specializing grounded language models with listener subtractionConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022 Aaditya K. Singh David Ding Andrew M. Saxe Felix Hill Andrew Kyle Lampinen 204 2 0 16 Jun 2022
Zero-Shot Video Question Answering via Frozen Bidirectional Language ModelsNeural Information Processing Systems (NeurIPS), 2022 Antoine Yang Antoine Miech Josef Sivic Ivan Laptev Cordelia Schmid 403 275 0 16 Jun 2022
Self-Generated In-Context Learning: Leveraging Auto-regressive Language Models as a Demonstration Generator Sungmin Cho Hyunsoo Cho Junyeob Kim Taeuk Kim Kang Min Yoo Sang-goo Lee 202 81 0 16 Jun 2022
Sparse Structure Search for Parameter-Efficient Tuning Shengding Hu Zhen Zhang Ning Ding Yadao Wang Yasheng Wang Zhiyuan Liu Maosong Sun 133 19 0 15 Jun 2022
Automatic Clipping: Differentially Private Deep Learning Made Easier and StrongerNeural Information Processing Systems (NeurIPS), 2022 Zhiqi Bu Yu Wang Sheng Zha George Karypis 550 96 0 14 Jun 2022
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning TasksNeural Information Processing Systems (NeurIPS), 2022 Tuan Dinh Yuchen Zeng Ruisu Zhang Ziqian Lin Michael Gira Shashank Rajput Jy-yong Sohn Dimitris Papailiopoulos Kangwook Lee LMTD 511 166 0 14 Jun 2022
LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer LearningNeural Information Processing Systems (NeurIPS), 2022 Yi-Lin Sung Jaemin Cho Joey Tianyi Zhou VLM 296 289 0 13 Jun 2022
Neural Prompt SearchIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Yuanhan Zhang Kaiyang Zhou Ziwei Liu VPVLM VLM 347 170 0 09 Jun 2022
Unveiling Transformers with LEGO: a synthetic reasoning task Yi Zhang A. Backurs Sébastien Bubeck Ronen Eldan Suriya Gunasekar Tal Wagner LRM 358 101 0 09 Jun 2022
Making Large Language Models Better Reasoners with Step-Aware VerifierAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Yifei Li Zeqi Lin Shizhuo Zhang Qiang Fu B. Chen Jian-Guang Lou Weizhu Chen ReLM LRM 277 283 0 06 Jun 2022
Prompt Injection: Parameterization of Fixed Inputs Eunbi Choi Yongrae Jo Joel Jang Minjoon Seo 238 35 0 31 May 2022
Modular and On-demand Bias Mitigation with Attribute-Removal SubnetworksAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Lukas Hauzenberger Shahed Masoudian Deepak Kumar Markus Schedl Navid Rekabsaz 286 21 0 30 May 2022
Parameter-Efficient and Student-Friendly Knowledge DistillationIEEE transactions on multimedia (IEEE TMM), 2022 Jun Rao Xv Meng Liang Ding Shuhan Qi Dacheng Tao 221 67 0 28 May 2022
Can Foundation Models Help Us Achieve Perfect Secrecy? Simran Arora Christopher Ré FedML 209 12 0 27 May 2022
AdaptFormer: Adapting Vision Transformers for Scalable Visual RecognitionNeural Information Processing Systems (NeurIPS), 2022 Shoufa Chen Chongjian Ge Zhan Tong Jiangliu Wang Yibing Song Jue Wang Ping Luo 562 915 0 26 May 2022
Ground-Truth Labels Matter: A Deeper Look into Input-Label DemonstrationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Kang Min Yoo Junyeob Kim Sungmin Cho Hyunsoo Cho Hwiyeol Jo Sang-Woo Lee Sang-goo Lee Taeuk Kim 305 143 0 25 May 2022
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Tu Vu Aditya Barua Brian Lester Daniel Cer Mohit Iyyer Noah Constant CLL 313 70 0 25 May 2022
Memorization in NLP Fine-tuning Methods Fatemehsadat Mireshghallah Archit Uniyal Tianhao Wang David Evans Taylor Berg-Kirkpatrick AAML 274 52 0 25 May 2022
Know Where You're Going: Meta-Learning for Parameter-Efficient Fine-TuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Mozhdeh Gheini Xuezhe Ma Jonathan May 125 9 0 25 May 2022
ClaimDiff: Comparing and Contrasting Claims on Contentious IssuesAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Miyoung Ko Ingyu Seong Hwaran Lee Joonsuk Park Minsuk Chang Minjoon Seo 201 4 0 24 May 2022
Representation Projection Invariance Mitigates Representation CollapseConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Anastasia Razdaibiedina A. Khetan Zohar Karnin Daniel Khashabi Vishaal Kapoor V. Madan 215 7 0 23 May 2022
When does Parameter-Efficient Transfer Learning Work for Machine Translation?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Ahmet Üstün Asa Cooper Stickland 160 8 0 23 May 2022
BBTv2: Towards a Gradient-Free Future with Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Tianxiang Sun Zhengfu He Hong Qian Yunhua Zhou Xuanjing Huang Xipeng Qiu 254 70 0 23 May 2022
Parameter-Efficient Sparsity for Large Language Models Fine-TuningInternational Joint Conference on Artificial Intelligence (IJCAI), 2022 Yuchao Li Fuli Luo Chuanqi Tan Mengdi Wang Songfang Huang Shen Li Junjie Bai MQ 159 37 0 23 May 2022
A Unified and Biologically-Plausible Relational Graph Representation of Vision TransformersIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022 Yuzhong Chen Yu Du Zhe Xiao Lin Zhao Lu Zhang ... Dajiang Zhu Tuo Zhang Xiaoyan Cai Tianming Liu Xi Jiang ViT 183 6 0 20 May 2022
AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling Haoqin Tu Zhongliang Yang Jinshuai Yang Yong Huang 187 13 0 12 May 2022
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningNeural Information Processing Systems (NeurIPS), 2022 Haokun Liu Derek Tam Mohammed Muqeeth Jay Mohta Tenghao Huang Joey Tianyi Zhou Colin Raffel 449 1,143 0 11 May 2022
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention Yifan Chen Devamanyu Hazarika Mahdi Namazifar Yang Liu Di Jin Dilek Z. Hakkani-Tür 117 8 0 07 May 2022
Engineering flexible machine learning systems by traversing functionally-invariant paths G. Raghavan Bahey Tharwat S. N. Hari Dhruvil Satani Matt Thomson OOD AI4CE 435 13 0 30 Apr 2022
AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks Chin-Lun Fu Zih-Ching Chen Yun-Ru Lee Hung-yi Lee 166 52 0 30 Apr 2022
Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Sanghwan Bae Donghyun Kwak Sungdong Kim Dong-hyun Ham Soyoung Kang Sang-Woo Lee W. Park ALM 249 42 0 30 Apr 2022
Prompt Consistency for Zero-Shot Task GeneralizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Chunting Zhou Junxian He Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig VLM 337 86 0 29 Apr 2022
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Joel Jang Seonghyeon Ye Changho Lee Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Minjoon Seo CLL KELM 409 114 0 29 Apr 2022
On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language ModelNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Seongjin Shin Sang-Woo Lee Hwijeen Ahn Sungdong Kim Hyoungseok Kim ... Dong Wang Gichang Lee W. Park Jung-Woo Ha Nako Sung LRM 295 104 0 28 Apr 2022

All Papers

LoRA: Low-Rank Adaptation of Large Language Models

Papers citing "LoRA: Low-Rank Adaptation of Large Language Models"