Measuring and Narrowing the Compositionality Gap in Language Models

7 October 2022

Ofir Press

Papers citing "Measuring and Narrowing the Compositionality Gap in Language Models"

50 / 419 papers shown

Title
Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning Xin Su Tiep Le Steven Bethard Phillip Howard LRM KELM 12 5 0 14 Nov 2023
Fast Chain-of-Thought: A Glance of Future from Parallel Decoding Leads to Answers Faster Hongxuan Zhang Zhining Liu Yao Zhao Jiaqi Zheng Chenyi Zhuang Jinjie Gu Guihai Chen LRM MLLM 8 1 0 14 Nov 2023
A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models He Cao Zhenwei An Jiazhan Feng Kun Xu Liwei Chen Dongyan Zhao HILM 15 1 0 13 Nov 2023
On the Discussion of Large Language Models: Symmetry of Agents and Interplay with Prompts Qineng Wang Zihao W. Wang Ying Su Yangqiu Song AI4CE LLMAG 26 0 0 13 Nov 2023
Large Language Models are In-context Teachers for Knowledge Reasoning Jiachen Zhao Zonghai Yao Zhichao Yang Hong-ye Yu ReLM LRM 14 1 0 12 Nov 2023
From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models Junbing Yan Chengyu Wang Taolin Zhang Xiaofeng He Jun Huang Wei Zhang ReLM LRM 21 7 0 12 Nov 2023
Simple and Effective Input Reformulations for Translation Brian Yu Hansen Lillemark Kurt Keutzer 23 0 0 12 Nov 2023
Analyzing Modular Approaches for Visual Question Decomposition Apoorv Khandelwal Ellie Pavlick Chen Sun 35 4 0 10 Nov 2023
Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications Zhangyin Feng Weitao Ma Weijiang Yu Lei Huang Haotian Wang Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu KELM 21 34 0 10 Nov 2023
Deep Natural Language Feature Learning for Interpretable Prediction Felipe Urrutia Cristian Buc Valentin Barriere 8 1 0 09 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 31 684 0 09 Nov 2023
Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselves Yihe Deng Weitong Zhang Zixiang Chen Quanquan Gu LRM 13 72 0 07 Nov 2023
Instruct Me More! Random Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 20 15 0 07 Nov 2023
Hint-enhanced In-Context Learning wakes Large Language Models up for knowledge-intensive tasks Yifan Wang Qingyan Guo Xinzhe Ni Chufan Shi Lemao Liu Haiyun Jiang Yujiu Yang ReLM RALM 17 8 0 03 Nov 2023
In-Context Ability Transfer for Question Decomposition in Complex QA Venktesh V Sourangshu Bhattacharya Avishek Anand LRM ReLM 10 4 0 26 Oct 2023
Improving Few-shot Generalization of Safety Classifiers via Data Augmented Parameter-Efficient Fine-Tuning Ananth Balashankar Xiao Ma Aradhana Sinha Ahmad Beirami Yao Qin Jilin Chen Alex Beutel 8 2 0 25 Oct 2023
PreWoMe: Exploiting Presuppositions as Working Memory for Long Form Question Answering Wookje Han Jinsol Park Kyungjae Lee 19 3 0 24 Oct 2023
What Algorithms can Transformers Learn? A Study in Length Generalization Hattie Zhou Arwen Bradley Etai Littwin Noam Razin Omid Saremi Josh Susskind Samy Bengio Preetum Nakkiran 20 107 0 24 Oct 2023
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models Yuanfeng Song Yuanqin He Xuefang Zhao Hanlin Gu Di Jiang Haijun Yang Lixin Fan Qiang Yang 30 2 0 24 Oct 2023
Evaluating Subjective Cognitive Appraisals of Emotions from Large Language Models Hongli Zhan Desmond C. Ong Junyi Jessy Li 39 7 0 22 Oct 2023
Tree Prompting: Efficient Task Adaptation without Fine-Tuning John X. Morris Chandan Singh Alexander M. Rush Jianfeng Gao Yuntian Deng VLM LRM 12 17 0 21 Oct 2023
Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning Jinyuan Wang Junlong Li Hai Zhao LRM ReLM 37 20 0 20 Oct 2023
AutoMix: Automatically Mixing Language Models Pranjal Aggarwal Aman Madaan Ankit Anand Srividya Pranavi Potharaju Swaroop Mishra ... Karthik Kappaganthu Yiming Yang Shyam Upadhyay Manaal Faruqui Mausam 40 17 0 19 Oct 2023
Large Language Model for Multi-objective Evolutionary Optimization Fei Liu Xi Lin Zhenkun Wang Shunyu Yao Xialiang Tong Mingxuan Yuan Qingfu Zhang 11 37 0 19 Oct 2023
A Comprehensive Evaluation of Tool-Assisted Generation Strategies Alon Jacovi Avi Caciularu Jonathan Herzig Roee Aharoni Bernd Bohnet Mor Geva ELM 16 6 0 16 Oct 2023
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models David Chuan-En Lin Nikolas Martelaro 24 18 0 12 Oct 2023
KwaiYiiMath: Technical Report Jia-Yi Fu Lei Lin Xiaoyang Gao Pengli Liu Zhengzong Chen ... Zijia Lin Fuzheng Zhang Zhongyuan Wang Di Zhang Kun Gai LRM ReLM RALM 38 2 0 11 Oct 2023
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances Zihan Zhang Meng Fang Lingxi Chen Mohammad-Reza Namazi-Rad Jun Wang KELM 14 21 0 11 Oct 2023
Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models Anni Zou Zhuosheng Zhang Hai Zhao Xiangru Tang LRM ReLM 34 1 0 10 Oct 2023
Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models Huaixiu Steven Zheng Swaroop Mishra Xinyun Chen Heng-Tze Cheng Ed H. Chi Quoc V. Le Denny Zhou RALM LRM 15 103 0 09 Oct 2023
FireAct: Toward Language Agent Fine-tuning Baian Chen Chang Shu Ehsan Shareghi Nigel Collier Karthik Narasimhan Shunyu Yao ALM LLMAG 99 96 0 09 Oct 2023
Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models Haoran Wang Kai Shu LRM 30 22 0 08 Oct 2023
DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models Chengcheng Han Xiaowei Du Che Zhang Yixin Lian Xiang Li Ming Gao Baoyuan Wang LRM 21 14 0 08 Oct 2023
Self-Knowledge Guided Retrieval Augmentation for Large Language Models Yile Wang Peng Li Maosong Sun Yang Liu RALM KELM 21 42 0 08 Oct 2023
Towards Better Chain-of-Thought Prompting Strategies: A Survey Zihan Yu Liang He Zhen Wu Xinyu Dai Jiajun Chen LRM 115 40 0 08 Oct 2023
Chain of Natural Language Inference for Reducing Large Language Model Ungrounded Hallucinations Deren Lei Yaxi Li Mengya Hu Mingyu Wang Vincent Yun Emily Ching Eslam Kamal HILM LRM 24 39 0 06 Oct 2023
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines Omar Khattab Arnav Singhvi Paridhi Maheshwari Zhiyuan Zhang Keshav Santhanam ... Thomas T. Joshi Hanna Moazam Heather Miller Matei A. Zaharia Christopher Potts RALM 22 220 0 05 Oct 2023
FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation Tu Vu Mohit Iyyer Xuezhi Wang Noah Constant Jerry W. Wei ... Chris Tar Yun-hsuan Sung Denny Zhou Quoc Le Thang Luong KELM HILM LRM 14 184 0 05 Oct 2023
How FaR Are Large Language Models From Agents with Theory-of-Mind? Pei Zhou Aman Madaan Srividya Pranavi Potharaju Aditya Gupta Kevin R. McKee ... Xiang Ren Swaroop Mishra Aida Nematzadeh Shyam Upadhyay Manaal Faruqui LRM AI4CE 15 47 0 04 Oct 2023
Large Language Models as Analogical Reasoners Michihiro Yasunaga Xinyun Chen Yujia Li Panupong Pasupat J. Leskovec Percy Liang Ed H. Chi Denny Zhou ReLM LRM 13 73 0 03 Oct 2023
Making Retrieval-Augmented Language Models Robust to Irrelevant Context Ori Yoran Tomer Wolfson Ori Ram Jonathan Berant RALM LRM 16 175 0 02 Oct 2023
Knowledge Crosswords: Geometric Knowledge Reasoning with Large Language Models Wenxuan Ding Shangbin Feng Yuhan Liu Zhaoxuan Tan Vidhisha Balachandran Tianxing He Yulia Tsvetkov LRM 23 2 0 02 Oct 2023
Resolving Knowledge Conflicts in Large Language Models Yike Wang Shangbin Feng Heng Wang Weijia Shi Vidhisha Balachandran Tianxing He Yulia Tsvetkov 48 12 0 02 Oct 2023
Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Method Xuan Zhang Wei Gao LRM 19 79 0 30 Sep 2023
SCALE: Synergized Collaboration of Asymmetric Language Translation Engines Xin Cheng Xun Wang Tao Ge Si-Qing Chen Y. Li Dongyan Zhao Rui Yan 43 2 0 29 Sep 2023
Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future Zheng Chu Jingchang Chen Qianglong Chen Weijiang Yu Tao He Haotian Wang Weihua Peng Ming-Yu Liu Bing Qin Ting Liu LRM AI4CE 16 148 0 27 Sep 2023
Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces Hariharan Subramonyam Roy Pea Christopher Pondoc Maneesh Agrawala Colleen M. Seifert 25 44 0 25 Sep 2023
Furthest Reasoning with Plan Assessment: Stable Reasoning Path with Retrieval-Augmented Large Language Models Yin Zhu Zhiling Luo Gong Cheng LRM 14 0 0 22 Sep 2023
The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A" Lukas Berglund Meg Tong Max Kaufmann Mikita Balesni Asa Cooper Stickland Tomasz Korbak Owain Evans LRM 20 233 0 21 Sep 2023
LLM Guided Inductive Inference for Solving Compositional Problems Abhigya Sodani Lauren Moos Matthew Mirman LRM 31 0 0 20 Sep 2023