Large Language Models Are Reasoning Teachers

20 December 2022

Papers citing "Large Language Models Are Reasoning Teachers"

50 / 232 papers shown

Title
LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillation Fangxun Shu Yue Liao Le Zhuo Chenning Xu Guanghao Zhang ... Bolin Li Zhelun Yu Si Liu Hongsheng Li Hao Jiang VLM MoE 32 8 0 28 Aug 2024
Path-Consistency: Prefix Enhancement for Efficient Inference in LLM Jiace Zhu Yingtao Shen Jie Zhao An Zou LLMAG LRM 27 4 0 25 Aug 2024
Is Functional Correctness Enough to Evaluate Code Language Models? Exploring Diversity of Generated Codes Heejae Chon Seonghyeon Lee Jinyoung Yeo Dongha Lee ALM 19 1 0 24 Aug 2024
Fine-tuning Smaller Language Models for Question Answering over Financial Documents Karmvir Singh Phogat Sai Akhil Puranam Sridhar Dasaratha Chetan Harsha Shashishekar Ramakrishna LRM 24 2 0 22 Aug 2024
Language Modeling on Tabular Data: A Survey of Foundations, Techniques and Evolution Yucheng Ruan Xiang Lan Jingying Ma Yizhi Dong Kai He Mengling Feng LMTD 65 3 0 20 Aug 2024
Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations Leo Donisch Sigurd Schacht Carsten Lanquillon 22 2 0 06 Aug 2024
Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning Tianduo Wang Shichen Li Wei Lu LRM AI4CE 45 14 1 25 Jul 2024
Sentiment Reasoning for Healthcare Khai Le-Duc Khai-Nguyen Nguyen Bach Phan Tat Duy Le Jerry Ngo Long Vo-Dang Anh Totti Nguyen Truong Son-Hy LRM 33 0 0 24 Jul 2024
DDK: Distilling Domain Knowledge for Efficient Large Language Models Jiaheng Liu Chenchen Zhang Jinyang Guo Yuanxing Zhang Haoran Que ... Congnan Liu Wenbo Su Jiamang Wang Lin Qu Bo Zheng 43 3 0 23 Jul 2024
Data-Centric Human Preference Optimization with Rationales H. Just Ming Jin Anit Kumar Sahu Huy Phan Ruoxi Jia 30 3 0 19 Jul 2024
LAPIS: Language Model-Augmented Police Investigation System Heedou Kim Dain Kim Jiwoo Lee Chanwoong Yoon Donghee Choi Mogan Gim Jaewoo Kang RALM 21 1 0 19 Jul 2024
Key-Point-Driven Mathematical Reasoning Distillation of Large Language Model Xunyu Zhu Jian Li Can Ma Weiping Wang LRM 36 0 0 14 Jul 2024
Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision Orr Zohar Xiaohan Wang Yonatan Bitton Idan Szpektor Serena Yeung-Levy VLM LRM 48 8 0 08 Jul 2024
Retrieved In-Context Principles from Previous Mistakes Hao-Lun Sun Yong-jia Jiang Bo Wang Yingyan Hou Yan Zhang Pengjun Xie Fei Huang 50 1 0 08 Jul 2024
Training Task Experts through Retrieval Based Distillation Jiaxin Ge Xueying Jia Vijay Viswanathan Hongyin Luo Graham Neubig 34 3 0 07 Jul 2024
AI Safety in Generative AI Large Language Models: A Survey Jaymari Chua Yun Yvonna Li Shiyi Yang Chen Wang Lina Yao LM&MA 34 12 0 06 Jul 2024
Fine-Tuning with Divergent Chains of Thought Boosts Reasoning Through Self-Correction in Language Models Haritz Puerto Tilek Chubakov Xiaodan Zhu Harish Tayyar Madabushi Iryna Gurevych ReLM LRM 39 9 1 03 Jul 2024
RDBE: Reasoning Distillation-Based Evaluation Enhances Automatic Essay Scoring Ali Ghiasvand Mohammadkhani 16 0 0 03 Jul 2024
RVISA: Reasoning and Verification for Implicit Sentiment Analysis Wenna Lai H. Xie Guandong Xu Qing Li LRM 34 1 0 02 Jul 2024
Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction Chenlong Deng Kelong Mao Yuyao Zhang Zhicheng Dou ELM AILaw 25 1 0 02 Jul 2024
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application Chuanpeng Yang Wang Lu Yao Zhu Yidong Wang Qian Chen Chenlong Gao Bingjie Yan Yiqiang Chen ALM KELM 44 22 0 02 Jul 2024
PORT: Preference Optimization on Reasoning Traces Salem Lahlou Abdalgader Abubaker Hakim Hacid LRM 31 1 0 23 Jun 2024
Investigating Mysteries of CoT-Augmented Distillation Somin Wadhwa Silvio Amir Byron C. Wallace ReLM LRM 19 8 0 20 Jun 2024
Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation Yuhang Zhou Jing Zhu Paiheng Xu Xiaoyu Liu Xiyao Wang Danai Koutra Wei Ai Furong Huang 73 4 0 19 Jun 2024
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Devichand Budagam Sankalp KJ Ashutosh Kumar Vinija Jain Aman Chadha 28 0 0 18 Jun 2024
Abstraction-of-Thought Makes Language Models Better Reasoners Ruixin Hong Hongming Zhang Xiaoman Pan Dong Yu Changshui Zhang LRM 43 3 0 18 Jun 2024
PDSS: A Privacy-Preserving Framework for Step-by-Step Distillation of Large Language Models Tao Fan Yan Kang Weijing Chen Hanlin Gu Yuanfeng Song Lixin Fan Kai Chen Qiang Yang 19 0 0 18 Jun 2024
Learning from Natural Language Explanations for Generalizable Entity Matching Somin Wadhwa Adit Krishnan Runhui Wang Byron C. Wallace Chris Kong LRM 37 3 0 13 Jun 2024
Limited Out-of-Context Knowledge Reasoning in Large Language Models Peng Hu Changjiang Gao Ruiqi Gao Jiajun Chen Shujian Huang LRM 27 3 0 11 Jun 2024
Teaching-Assistant-in-the-Loop: Improving Knowledge Distillation from Imperfect Teacher Models in Low-Budget Scenarios Yuhang Zhou Wei Ai 27 5 0 08 Jun 2024
SUBLLM: A Novel Efficient Architecture with Token Sequence Subsampling for LLM Quandong Wang Yuxuan Yuan Xiaoyu Yang Ruike Zhang Kang Zhao Wei Liu Jian Luan Daniel Povey Bin Wang 41 0 0 03 Jun 2024
Improve Student's Reasoning Generalizability through Cascading Decomposed CoTs Distillation Chengwei Dai Kun Li Wei Zhou Song Hu LRM 44 3 0 30 May 2024
Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation Chengwei Dai Kun Li Wei Zhou Song Hu LRM 36 5 0 30 May 2024
Adaptive In-conversation Team Building for Language Model Agents Linxin Song Jiale Liu Jieyu Zhang Shaokun Zhang Ao Luo Shijian Wang Qingyun Wu Chi Wang LLMAG 63 10 0 29 May 2024
TIE: Revolutionizing Text-based Image Editing for Complex-Prompt Following and High-Fidelity Editing Xinyu Zhang Mengxue Kang Fei Wei Shuang Xu Yuhe Liu Lin Ma MLLM DiffM 31 2 0 27 May 2024
Keypoint-based Progressive Chain-of-Thought Distillation for LLMs Kaituo Feng Changsheng Li Xiaolu Zhang Jun Zhou Ye Yuan Guoren Wang LRM 40 1 0 25 May 2024
Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models Qiji Zhou Ruochen Zhou Zike Hu Panzhong Lu Siyang Gao Yue Zhang LRM 38 12 0 22 May 2024
Large Language Models Meet NLP: A Survey Libo Qin Qiguang Chen Xiachong Feng Yang Wu Yongheng Zhang Yinghui Li Min Li Wanxiang Che Philip S. Yu ALM LM&MA ELM LRM 38 46 0 21 May 2024
DOP: Diagnostic-Oriented Prompting for Large Language Models in Mathematical Correction Hao Chen Biaojie Zeng Xin Lin Liang He Aimin Zhou LRM 33 0 0 20 May 2024
ECR-Chain: Advancing Generative Language Models to Better Emotion-Cause Reasoners through Reasoning Chains Zhaopei Huang Jinming Zhao Qin Jin ReLM LRM 31 3 0 17 May 2024
MuMath-Code: Combining Tool-Use Large Language Models with Multi-perspective Data Augmentation for Mathematical Reasoning Shuo Yin Weihao You Zhilong Ji Guoqiang Zhong Jinfeng Bai LRM SyDa 35 9 0 13 May 2024
Self-Refine Instruction-Tuning for Aligning Reasoning in Language Models Leonardo Ranaldi André Freitas LRM ReLM 29 8 0 01 May 2024
Tool Calling: Enhancing Medication Consultation via Retrieval-Augmented Large Language Models Zhongzhen Huang Kui Xue Yongqi Fan Linjie Mu Ruoyu Liu Tong Ruan Shaoting Zhang Xiaofan Zhang LM&MA RALM 33 5 0 27 Apr 2024
Cantor: Inspiring Multimodal Chain-of-Thought of MLLM Timin Gao Peixian Chen Mengdan Zhang Chaoyou Fu Yunhang Shen ... Shengchuan Zhang Xiawu Zheng Xing Sun Liujuan Cao Rongrong Ji MLLM LRM 44 15 0 24 Apr 2024
Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Solvers for Math Word Problems Qihuang Zhong Kang Wang Ziyang Xu Juhua Liu Liang Ding Bo Du LRM AIMat 55 3 0 23 Apr 2024
A Survey on Efficient Inference for Large Language Models Zixuan Zhou Xuefei Ning Ke Hong Tianyu Fu Jiaming Xu ... Shengen Yan Guohao Dai Xiao-Ping Zhang Yuhan Dong Yu-Xiang Wang 46 80 0 22 Apr 2024
Relevant or Random: Can LLMs Truly Perform Analogical Reasoning? Chengwei Qin Wenhan Xia Tan Wang Fangkai Jiao Yuchen Hu Bosheng Ding Ruirui Chen Shafiq R. Joty LRM 35 3 0 19 Apr 2024
Incubating Text Classifiers Following User Instruction with Nothing but LLM Letian Peng Jingbo Shang 32 3 0 16 Apr 2024
Distilling Reasoning Ability from Large Language Models with Adaptive Thinking Xiao Chen Sihang Zhou K. Liang Xinwang Liu ReLM LRM 27 2 0 14 Apr 2024
Improving Language Model Reasoning with Self-motivated Learning Yunlong Feng Yang Xu Libo Qin Yasheng Wang Wanxiang Che LRM ReLM 29 7 0 10 Apr 2024