TaskWeb: Selecting Better Source Tasks for Multi-task NLP

TaskWeb: Selecting Better Source Tasks for Multi-task NLP

22 May 2023

Gabriel Ilharco

Hannaneh Hajishirzi

Papers citing "TaskWeb: Selecting Better Source Tasks for Multi-task NLP"

15 / 15 papers shown

Title
Residual Policy Learning for Perceptive Quadruped Control Using Differentiable Simulation Jing Yuan Luo Yunlong Song Victor Klemm Fan Shi Davide Scaramuzza Marco Hutter 26 1 0 04 Oct 2024
Instruction Embedding: Latent Representations of Instructions Towards Task Identification Yiwei Li Jiayi Shi Shaoxiong Feng Peiwen Yuan Xinglin Wang Boyuan Pan Heda Wang Yao Hu Kan Li 18 1 0 29 Sep 2024
Exploring the Effectiveness and Consistency of Task Selection in Intermediate-Task Transfer Learning Pin-Jie Lin Miaoran Zhang Marius Mosbach Dietrich Klakow 23 0 0 23 Jul 2024
Back to the Basics on Predicting Transfer Performance Levy G. Chaves Eduardo Valle Alceu Bissoto Sandra Avila MedIm 26 0 0 30 May 2024
Laying the Foundation First? Investigating the Generalization from Atomic Skills to Complex Reasoning Tasks Yuncheng Huang Qi He Yipei Xu Jiaqing Liang Yanghua Xiao LRM 36 1 0 14 Mar 2024
BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing Hieu Tran Zhichao Yang Zonghai Yao Hong-ye Yu ALM LM&MA 26 23 0 30 Oct 2023
CITB: A Benchmark for Continual Instruction Tuning Zihan Zhang Meng Fang Ling-Hao Chen Mohammad-Reza Namazi-Rad ALM CLL 39 20 0 23 Oct 2023
Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models Mayee F. Chen Nicholas Roberts Kush S. Bhatia Jue Wang Ce Zhang Frederic Sala Christopher Ré SyDa 18 50 0 26 Jul 2023
ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts Akari Asai Mohammadreza Salehi Matthew E. Peters Hannaneh Hajishirzi 120 98 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts Stephen H. Bach Victor Sanh Zheng-Xin Yong Albert Webson Colin Raffel ... Khalid Almubarak Xiangru Tang Dragomir R. Radev Mike Tian-Jian Jiang Alexander M. Rush VLM 215 335 0 02 Feb 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 203 1,651 0 15 Oct 2021
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Matthew Cer VLM LRM 134 276 0 15 Oct 2021
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP Qinyuan Ye Bill Yuchen Lin Xiang Ren 209 179 0 18 Apr 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 278 3,784 0 18 Apr 2021