Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistance

22 May 2023

Leyang Cui

Wei Bi

Papers citing "Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A Preliminary Study on Writing Assistance"

30 / 30 papers shown

Title
Federated Instruction Tuning of LLMs with Domain Coverage Augmentation Zezhou Wang Yaxin Du Zhuzhong Qian Yugang Jiang Zhuzhong Qian Siheng Chen FedML 35 0 0 30 Sep 2024
From Linguistic Giants to Sensory Maestros: A Survey on Cross-Modal Reasoning with Large Language Models Shengsheng Qian Zuyi Zhou Dizhan Xue Bing Wang Changsheng Xu LRM 34 1 0 19 Sep 2024
CyberPal.AI: Empowering LLMs with Expert-Driven Cybersecurity Instructions Matan Levi Yair Alluouche Daniel Ohayon Anton Puzanov 19 0 0 17 Aug 2024
FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism for Language Models Kaixin Lan Tao Fang Derek F. Wong Yabo Xu Lidia S. Chao Cecilia G. Zhao 48 4 0 02 Jun 2024
GPT-3.5 for Grammatical Error Correction Anisia Katinskaia R. Yangarber KELM 21 9 0 14 May 2024
Pillars of Grammatical Error Correction: Comprehensive Inspection Of Contemporary Approaches In The Era of Large Language Models Kostiantyn Omelianchuk Andrii Liubonko Oleksandr Skurzhanskyi Artem Chernodub Oleksandr Korniienko Igor Samokhin 19 2 0 23 Apr 2024
Intuition-aware Mixture-of-Rank-1-Experts for Parameter Efficient Finetuning Yijiang Liu Rongyu Zhang Huanrui Yang Kurt Keutzer Yuan Du Li Du Shanghang Zhang MoE 31 5 0 13 Apr 2024
Pitfalls of Conversational LLMs on News Debiasing Ipek Baris Schlicht Defne Altiok Maryanne Taouk Lucie Flek 19 2 0 09 Apr 2024
Unveiling the Generalization Power of Fine-Tuned Large Language Models Haoran Yang Yumeng Zhang Jiaqi Xu Hongyuan Lu Pheng Ann Heng Wai Lam 38 7 0 14 Mar 2024
To Err Is Human, but Llamas Can Learn It Too Agnes Luhtaru Taido Purason Martin Vainikko Maksym Del Mark Fishel SyDa ALM 22 2 0 08 Mar 2024
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction Yinghui Li Shang Qin Jingheng Ye Shirong Ma Yangning Li Libo Qin Xuming Hu Wenhao Jiang Hai-Tao Zheng Philip S. Yu LRM 15 5 0 18 Feb 2024
MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning Shu Yang Muhammad Asif Ali Cheng-Long Wang Lijie Hu Di Wang CLL MoE 32 36 0 17 Feb 2024
Alirector: Alignment-Enhanced Chinese Grammatical Error Corrector Haihui Yang Xiaojun Quan 3DV 11 2 0 07 Feb 2024
Alleviating Hallucinations of Large Language Models through Induced Hallucinations Yue Zhang Leyang Cui Wei Bi Shuming Shi HILM 16 47 0 25 Dec 2023
DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selection Devleena Das Vivek Khetan 8 0 0 25 Oct 2023
Specialist or Generalist? Instruction Tuning for Specific NLP Tasks Chufan Shi Yixuan Su Cheng Yang Yujiu Yang Deng Cai 21 14 0 23 Oct 2023
Explore-Instruct: Enhancing Domain-Specific Instruction Coverage through Active Exploration Fanqi Wan Xinting Huang Tao Yang Xiaojun Quan Wei Bi Shuming Shi ALM 19 18 0 13 Oct 2023
KwaiYiiMath: Technical Report Jia-Yi Fu Lei Lin Xiaoyang Gao Pengli Liu Zhengzong Chen ... Zijia Lin Fuzheng Zhang Zhongyuan Wang Di Zhang Kun Gai LRM ReLM RALM 38 2 0 11 Oct 2023
RobustGEC: Robust Grammatical Error Correction Against Subtle Context Perturbation Yue Zhang Leyang Cui Enbo Zhao Wei Bi Shuming Shi 20 6 0 11 Oct 2023
Instruction Tuning for Large Language Models: A Survey Shengyu Zhang Linfeng Dong Xiaoya Li Sen Zhang Xiaofei Sun ... Jiwei Li Runyi Hu Tianwei Zhang Fei Wu Guoyin Wang LM&MA 13 524 0 21 Aug 2023
On the (In)Effectiveness of Large Language Models for Chinese Text Correction Yinghui Li Haojing Huang Shirong Ma Yong-jia Jiang Y. Li F. Zhou Haitao Zheng Qingyu Zhou 13 42 0 18 Jul 2023
NaSGEC: a Multi-Domain Chinese Grammatical Error Correction Dataset from Native Speaker Texts Yue Zhang Bo-Wen Zhang Haochen Jiang Zhenghua Li Chen Li Fei Huang Min Zhang 16 7 0 25 May 2023
InstructIE: A Bilingual Instruction-based Information Extraction Dataset Honghao Gui Shuofei Qiao Jintian Zhang Hongbin Ye Mengshu Sun Lei Liang Jeff Z. Pan Huajun Chen Ningyu Zhang 21 6 0 19 May 2023
Instruction Tuning with GPT-4 Baolin Peng Chunyuan Li Pengcheng He Michel Galley Jianfeng Gao SyDa ALM LM&MA 154 576 0 06 Apr 2023
A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capability Aiwei Liu Xuming Hu Lijie Wen Philip S. Yu LMTD AI4MH 61 143 0 12 Mar 2023
SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parser Yue Zhang Bo Zhang Zhenghua Li Rasna Goyal Chen Li Min Zhang 16 42 0 22 Oct 2022
EditEval: An Instruction-Based Benchmark for Text Improvements Jane Dwivedi-Yu Timo Schick Zhengbao Jiang Maria Lomeli Patrick Lewis Gautier Izacard Edouard Grave Sebastian Riedel Fabio Petroni 45 26 0 27 Sep 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 227 1,281 0 18 Mar 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 220 3,054 0 23 Jan 2020