Title
Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model Mikail Khona Maya Okawa Jan Hula Rahul Ramesh Kento Nishi Robert P. Dick Ekdeep Singh Lubana Hidenori Tanaka 38 5 0 12 Feb 2024
Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models Jiacheng Ye Shansan Gong Liheng Chen Lin Zheng Jiahui Gao ... Chuan Wu Xin Jiang Zhenguo Li Wei Bi Lingpeng Kong DiffM LRM AI4CE 38 12 0 12 Feb 2024
InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning Huaiyuan Ying Shuo Zhang Linyang Li Zhejian Zhou Yunfan Shao ... Hang Yan Xipeng Qiu Jiayu Wang Kai-xiang Chen Dahua Lin ReLM LRM 25 69 0 09 Feb 2024
In-Context Learning Can Re-learn Forbidden Tasks Sophie Xhonneux David Dobre Jian Tang Gauthier Gidel Dhanya Sridhar 19 3 0 08 Feb 2024
Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought Alex Havrilla Maia Iyer 19 7 0 06 Feb 2024
RevOrder: A Novel Method for Enhanced Arithmetic in Language Models Si Shen Peijun Shen Danhao Zhu MU 22 1 0 06 Feb 2024
Self-Discover: Large Language Models Self-Compose Reasoning Structures Pei Zhou Jay Pujara Xiang Ren Xinyun Chen Heng-Tze Cheng Quoc V. Le Ed H. Chi Denny Zhou Swaroop Mishra Huaixiu Steven Zheng LRM ReLM 27 48 0 06 Feb 2024
LLM Multi-Agent Systems: Challenges and Open Problems Shanshan Han Qifan Zhang Yuhang Yao Weizhao Jin Zhaozhuo Xu LLMAG 35 36 0 05 Feb 2024
A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications Pranab Sahoo Ayush Kumar Singh Sriparna Saha Vinija Jain S. Mondal Aman Chadha 49 272 0 05 Feb 2024
Investigating Recurrent Transformers with Dynamic Halt Jishnu Ray Chowdhury Cornelia Caragea 34 1 0 01 Feb 2024
LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law Toni J. B. Liu Nicolas Boullé Raphael Sarfati Christopher Earls AI4TS 25 11 0 01 Feb 2024
Large Language Models for Mathematical Reasoning: Progresses and Challenges Janice Ahn Rishu Verma Renze Lou Di Liu Rui Zhang Wenpeng Yin LRM 36 115 0 31 Jan 2024
EEG-GPT: Exploring Capabilities of Large Language Models for EEG Classification and Interpretation Jonathan W. Kim Ahmed Alaa Danilo Bernardo 28 14 0 31 Jan 2024
Equipping Language Models with Tool Use Capability for Tabular Data Analysis in Finance Adrian Theuma Ehsan Shareghi 19 4 0 27 Jan 2024
Zero-shot Sequential Neuro-symbolic Reasoning for Automatically Generating Architecture Schematic Designs Milin Kodnongbua Lawrence H. Curtis Adriana Schulz AI4CE 37 2 0 25 Jan 2024
Transformer-Based Models Are Not Yet Perfect At Learning to Emulate Structural Recursion Dylan Zhang Curt Tigges Zory Zhang Stella Biderman Maxim Raginsky Talia Ringer 24 11 0 23 Jan 2024
Closing the Gap between TD Learning and Supervised Learning -- A Generalisation Point of View Raj Ghugare Matthieu Geist Glen Berseth Benjamin Eysenbach OffRL 25 14 0 20 Jan 2024
Code Simulation Challenges for Large Language Models Emanuele La Malfa Christoph Weinhuber Orazio Torre Fangru Lin Samuele Marro Anthony Cohn Nigel Shadbolt Michael Wooldridge LLMAG LRM 17 8 0 17 Jan 2024
ReFT: Reasoning with Reinforced Fine-Tuning Trung Quoc Luong Xinbo Zhang Zhanming Jie Peng Sun Xiaoran Jin Hang Li OffRL LRM ReLM 32 79 0 17 Jan 2024
Large Language Models Can Learn Temporal Reasoning Siheng Xiong Ali Payani Ramana Rao Kompella Faramarz Fekri LRM 27 73 0 12 Jan 2024
Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges Qingyao Li Lingyue Fu Weiming Zhang Xianyu Chen Jingwei Yu Wei Xia Weinan Zhang Ruiming Tang Yong Yu AI4Ed ELM 27 18 0 27 Dec 2023
Supervised Knowledge Makes Large Language Models Better In-context Learners Linyi Yang Shuibai Zhang Zhuohao Yu Guangsheng Bao Yidong Wang ... Ruochen Xu Weirong Ye Xing Xie Weizhu Chen Yue Zhang 16 14 0 26 Dec 2023
Moderating New Waves of Online Hate with Chain-of-Thought Reasoning in Large Language Models Nishant Vishwamitra Keyan Guo Farhan Tajwar Romit Isabelle Ondracek Long Cheng Ziming Zhao Hongxin Hu 16 11 0 22 Dec 2023
SimLM: Can Language Models Infer Parameters of Physical Systems? Sean Memery Mirella Lapata Kartic Subr LRM AI4CE 16 2 0 21 Dec 2023
LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarks Saad Ullah Mingji Han Saurabh Pujar Hammond Pearce Ayse K. Coskun Gianluca Stringhini ELM LRM 19 58 0 19 Dec 2023
GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning Mehran Kazemi Hamidreza Alvari Ankit Anand Jialin Wu Xi Chen Radu Soricut LRM ReLM 20 53 0 19 Dec 2023
Active Preference Inference using Language Models and Probabilistic Reasoning Wasu Top Piriyakulkij Volodymyr Kuleshov Kevin Ellis LRM 25 12 0 19 Dec 2023
diff History for Neural Language Agents Ulyana Piterbarg Lerrel Pinto Rob Fergus 22 3 0 12 Dec 2023
AI capabilities can be significantly improved without expensive retraining Tom Davidson Jean-Stanislas Denain Pablo Villalobos Guillem Bas OffRL VLM 24 26 0 12 Dec 2023
Multi-Defendant Legal Judgment Prediction via Hierarchical Reasoning Yougang Lyu Jitai Hao Zihan Wang Kai Zhao Shen Gao Pengjie Ren Zhumin Chen Fang Wang Zhaochun Ren AILaw 11 9 0 10 Dec 2023
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models Hongzhan Lin Ziyang Luo Jing Ma Long Chen 27 9 0 09 Dec 2023
PathFinder: Guided Search over Multi-Step Reasoning Paths O. Yu. Golovneva Sean O'Brien Ramakanth Pasunuru Tianlu Wang Luke Zettlemoyer Maryam Fazel-Zarandi Asli Celikyilmaz LRM 16 7 0 08 Dec 2023
Latent Skill Discovery for Chain-of-Thought Reasoning Zifan Xu Haozhu Wang Dmitriy Bespalov Peter Stone Yanjun Qi ReLM LRM 51 2 0 07 Dec 2023
Using Large Language Models for Hyperparameter Optimization Michael Ruogu Zhang Nishkrit Desai Juhan Bae Jonathan Lorraine Jimmy Ba 34 51 0 07 Dec 2023
Chain of Code: Reasoning with a Language Model-Augmented Code Emulator Chengshu Li Jacky Liang Andy Zeng Xinyun Chen Karol Hausman Dorsa Sadigh Sergey Levine Fei-Fei Li Fei Xia Brian Ichter LLMAG LRM 31 70 0 07 Dec 2023
CLadder: Assessing Causal Reasoning in Language Models Zhijing Jin Yuen Chen Felix Leeb Luigi Gresele Ojasv Kamal ... Kevin Blin Fernando Gonzalez Adauto Max Kleiman-Weiner Mrinmaya Sachan Bernhard Schölkopf ReLM ELM LRM 38 62 0 07 Dec 2023
A Study on the Calibration of In-context Learning Hanlin Zhang Yi-Fan Zhang Yaodong Yu Dhruv Madeka Dean Phillips Foster Eric Xing Hima Lakkaraju Sham Kakade 21 7 0 07 Dec 2023
Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model Responses Xiao Ma Swaroop Mishra Ariel Liu S. Su Jilin Chen Chinmay Kulkarni Heng-Tze Cheng Quoc V. Le Ed H. Chi LM&Ro 20 36 0 01 Dec 2023
Training Chain-of-Thought via Latent-Variable Inference Du Phan Matthew D. Hoffman David Dohan Sholto Douglas Tuan Anh Le Aaron T Parisi Pavel Sountsov Charles Sutton Sharad Vikram Rif A. Saurous BDL ReLM LRM 19 22 0 28 Nov 2023
Releasing the CRaQAn (Coreference Resolution in Question-Answering): An open-source dataset and dataset creation methodology using instruction-following models Rob Grzywinski Joshua DÁrcy Rob Naidoff Ashish Shukla Alex Browne Ren Gibbons Brinnae Bent 19 0 0 27 Nov 2023
Novel Preprocessing Technique for Data Embedding in Engineering Code Generation Using Large Language Model Yu-Chen Lin Akhilesh Kumar Norman Chang Wen-Liang Zhang Muhammad Zakir Rucha Apte Haiyang He Chao Wang Jyh-Shing Roger Jang 22 1 0 27 Nov 2023
Conditions for Length Generalization in Learning Reasoning Skills Changnan Xiao Bing Liu LRM 32 7 0 22 Nov 2023
Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks Rahul Ramesh Ekdeep Singh Lubana Mikail Khona Robert P. Dick Hidenori Tanaka CoGe 27 6 0 21 Nov 2023
Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey Yunpeng Huang Jingwei Xu Junyu Lai Zixu Jiang Taolue Chen ... Xiaoxing Ma Lijuan Yang Zhou Xin Shupeng Li Penghao Zhao LLMAG KELM 28 54 0 21 Nov 2023
Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agents Zhuosheng Zhang Yao Yao Aston Zhang Xiangru Tang Xinbei Ma ... Yiming Wang Mark B. Gerstein Rui Wang Gongshen Liu Hai Zhao LLMAG LM&Ro LRM 31 52 0 20 Nov 2023
Towards Evaluating AI Systems for Moral Status Using Self-Reports Ethan Perez Robert Long ELM 31 8 0 14 Nov 2023
Just Ask One More Time! Self-Agreement Improves Reasoning of Language Models in (Almost) All Scenarios Lei Lin Jiayi Fu Pengli Liu Qingyang Li Yan Gong Junchen Wan Fuzheng Zhang Zhongyuan Wang Di Zhang Kun Gai LRM 27 7 0 14 Nov 2023
It's Not Easy Being Wrong: Large Language Models Struggle with Process of Elimination Reasoning Nishant Balepur Shramay Palta Rachel Rudinger LRM 10 7 0 13 Nov 2023
Explanation-aware Soft Ensemble Empowers Large Language Model In-context Learning Yue Yu Jiaming Shen Tianqi Liu Zhen Qin Jing Nathan Yan Jialu Liu Chao Zhang Michael Bendersky 44 6 0 13 Nov 2023
Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanations Zilu Tang Mayank Agarwal Alex Shypula Bailin Wang Derry Wijaya Jie Chen Yoon Kim LRM 28 15 0 13 Nov 2023