v1v2 (latest)

Transformers as Soft Reasoners over Language

International Joint Conference on Artificial Intelligence (IJCAI), 2020

14 February 2020

Oyvind Tafjord

Papers citing "Transformers as Soft Reasoners over Language"

50 / 256 papers shown

Title
Large Language Models Can Be Easily Distracted by Irrelevant ContextInternational Conference on Machine Learning (ICML), 2023 Freda Shi Xinyun Chen Kanishka Misra Nathan Scales David Dohan Ed H. Chi Nathanael Scharli Denny Zhou ReLM RALM LRM 548 782 0 31 Jan 2023
Case-Based Reasoning with Language Models for Classification of Logical FallaciesInternational Joint Conference on Artificial Intelligence (IJCAI), 2023 Zhivar Sourati Filip Ilievski Hông-Ân Sandlin Alain Mermoud LRM 213 14 0 27 Jan 2023
Language Models as Inductive ReasonersConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022 Zonglin Yang Li Dong Xinya Du Hao Cheng Xiaoshi Zhong Xiaodong Liu Jianfeng Gao Furu Wei ReLM LRM 236 51 0 21 Dec 2022
LAMBADA: Backward Chaining for Automated Reasoning in Natural LanguageAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Seyed Mehran Kazemi Najoung Kim Deepti Bhatia Xinyuan Xu Deepak Ramachandran LRM 250 90 0 20 Dec 2022
Reasoning with Language Model Prompting: A SurveyAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Shuofei Qiao Yixin Ou Ningyu Zhang Xiang Chen Yunzhi Yao Shumin Deng Chuanqi Tan Fei Huang Huajun Chen ReLM ELM LRM 587 380 0 19 Dec 2022
APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Soumya Sanyal Yichong Xu Shuohang Wang Ziyi Yang Reid Pryzant Wenhao Yu Chenguang Zhu Xiang Ren ReLM LRM 243 12 0 19 Dec 2022
Evaluating Step-by-Step Reasoning through Symbolic Verification Yi-Fan Zhang Hanlin Zhang Li Erran Li Eric P. Xing ReLM LRM 239 10 0 16 Dec 2022
The KITMUS Test: Evaluating Knowledge Integration from Multiple Sources in Natural Language Understanding SystemsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Akshatha Arodi Martin Pömsl Kaheer Suleman Adam Trischler Alexandra Olteanu Jackie C.K. Cheung ELM 199 5 0 15 Dec 2022
Despite "super-human" performance, current LLMs are unsuited for decisions about ethics and safety Joshua Albrecht Ellie Kitanidis Abraham J. Fetterman ELM ReLM ALM LRM 139 23 0 13 Dec 2022
Robust and Explainable Identification of Logical Fallacies in Natural Language ArgumentsKnowledge-Based Systems (KBS), 2022 Zhivar Sourati Vishnu Priya Prasanna Venkatesh D. Deshpande Himanshu Rawlani Filip Ilievski Hông-Ân Sandlin Alain Mermoud AAML 227 25 0 12 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief ReviewIEEE Data Engineering Bulletin (DEB), 2022 Jiangjie Chen Yanghua Xiao 200 5 0 07 Dec 2022
TRAC: A Textual Benchmark for Reasoning about Actions and Change Weinan He Canming Huang Zhanhao Xiao Yongmei Liu LLMAG ReLM LRM 130 1 0 25 Nov 2022
Can Transformers Reason in Fragments of Natural Language?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Viktor Schlegel Kamen V. Pavlov Ian Pratt-Hartmann LRM ReLM 158 9 0 10 Nov 2022
Natural Language Deduction with Incomplete InformationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Zayne Sprague Kaj Bostrom Swarat Chaudhuri Greg Durrett LRM 123 21 0 01 Nov 2022
Transfer Learning with Synthetic Corpora for Spatial Role Labeling and ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Roshanak Mirzaee Parisa Kordjamshidi SyDa LRM 189 42 0 30 Oct 2022
MetaLogic: Logical Reasoning Explanations with Fine-Grained StructureConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Yinya Huang Hongming Zhang Ruixin Hong Xiaodan Liang Changshui Zhang Dong Yu LRM 183 8 0 22 Oct 2022
Entailer: Answering Questions with Faithful and Truthful Chains of ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Oyvind Tafjord Bhavana Dalvi Peter Clark ReLM KELM LRM 202 60 0 21 Oct 2022
Solving Reasoning Tasks with a Slot Transformer Ryan Faulkner Daniel Zoran LRM 124 1 0 20 Oct 2022
ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence ChainsACM Cloud and Autonomic Computing Conference (CAC), 2022 Minjun Zhu Yixuan Weng Shizhu He Kang Liu Jun Zhao LRM 169 6 0 17 Oct 2022
Can Pretrained Language Models (Yet) Reason Deductively?Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2022 Moy Yuan Songbo Hu Ivan Vulić Anna Korhonen Zaiqiao Meng ReLM ELM LRM 180 10 0 12 Oct 2022
Quasi-symbolic Semantic Geometry over Transformer-based Variational AutoEncoder Yingji Zhang Danilo S. Carvalho Ian Pratt-Hartmann 225 4 0 12 Oct 2022
Embeddings as Epistemic States: Limitations on the Use of Pooling Operators for Accumulating KnowledgeInternational Journal of Approximate Reasoning (IJAR), 2022 Steven Schockaert FAtt 167 6 0 11 Oct 2022
Towards Faithful Model Explanation in NLP: A SurveyComputational Linguistics (CL), 2022 Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 426 162 0 22 Sep 2022
NELLIE: A Neuro-Symbolic Inference Engine for Grounded, Compositional, and Explainable ReasoningInternational Joint Conference on Artificial Intelligence (IJCAI), 2022 Nathaniel Weir Peter Clark Benjamin Van Durme ReLM NAI LRM 209 21 0 16 Sep 2022
FOLIO: Natural Language Reasoning with First-Order LogicConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Simeng Han Hailey Schoelkopf Yilun Zhao Zhenting Qi Martin Riddell ... Yingbo Zhou Caiming Xiong Rex Ying Arman Cohan Dragomir R. Radev ReLM LRM 321 151 0 02 Sep 2022
Generating Intermediate Steps for NLI with Next-Step Supervision Deepanway Ghosal Somak Aditya Monojit Choudhury LRM 157 1 0 31 Aug 2022
Going Beyond Approximation: Encoding Constraints for Explainable Multi-hop Inference via Differentiable Combinatorial Solvers Mokanarangan Thayaparan Marco Valentino André Freitas 136 0 0 05 Aug 2022
Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution GeneralisationInternational Workshop on Neural-Symbolic Learning and Reasoning (NeSy), 2022 Qiming Bao A. Peng Tim Hartill N. Tan Zhenyun Deng Michael Witbrock Jiamou Liu ReLM OOD NAI LRM 393 17 0 28 Jul 2022
Language models show human-like content effects on reasoning tasks Ishita Dasgupta Andrew Kyle Lampinen Stephanie C. Y. Chan Hannah R. Sheahan Antonia Creswell D. Kumaran James L. McClelland Felix Hill ReLM LRM 411 210 0 14 Jul 2022
Exploring Length Generalization in Large Language ModelsNeural Information Processing Systems (NeurIPS), 2022 Cem Anil Yuhuai Wu Anders Andreassen Aitor Lewkowycz Vedant Misra V. Ramasesh Ambrose Slone Guy Gur-Ari Ethan Dyer Behnam Neyshabur ReLM LRM 284 205 0 11 Jul 2022
Discourse-Aware Graph Networks for Textual Logical ReasoningIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Yinya Huang Lemao Liu Kun Xu Meng Fang Liang Lin Xi Liang NAI 169 8 0 04 Jul 2022
Linguistically inspired roadmap for building biologically reliable protein language modelsNature Machine Intelligence (Nat. Mach. Intell.), 2022 Mai Ha Vu Rahmad Akbar Philippe A. Robert B. Swiatczak Victor Greiff G. K. Sandve Dag Trygve Tryslew Haug 245 45 0 03 Jul 2022
cViL: Cross-Lingual Training of Vision-Language Models using Knowledge DistillationInternational Conference on Pattern Recognition (ICPR), 2022 Kshitij Gupta Devansh Gautam R. Mamidi VLM 187 4 0 07 Jun 2022
A Survey in Mathematical Language Processing Jordan Meadows André Freitas AIMat 160 18 0 30 May 2022
Reasoning over Logically Interacted Conditions for Question Answering Haitian Sun William W. Cohen Ruslan Salakhutdinov 227 5 0 25 May 2022
RobustLR: Evaluating Robustness to Logical Perturbation in Deductive ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Soumya Sanyal Zeyi Liao Xiang Ren ELM ReLM LRM 210 25 0 25 May 2022
Generating Natural Language Proofs with Verifier-Guided SearchConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Kaiyu Yang Gaowen Liu Danqi Chen LRM 450 81 0 25 May 2022
On the Paradox of Learning to Reason from DataInternational Joint Conference on Artificial Intelligence (IJCAI), 2022 Honghua Zhang Liunian Harold Li Tao Meng Kai-Wei Chang Karen Ullrich NAI ReLM OOD LRM 308 130 0 23 May 2022
Logical Reasoning with Span-Level Predictions for Interpretable and Robust NLI ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Joe Stacey Pasquale Minervini Haim Dubossarsky Marek Rei ReLM LRM 247 17 0 23 May 2022
Chain of Thought Imitation with Procedure CloningNeural Information Processing Systems (NeurIPS), 2022 Mengjiao Yang Dale Schuurmans Pieter Abbeel Ofir Nachum OffRL 199 42 0 22 May 2022
Interpretable Proof Generation via Iterative Backward ReasoningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Hanhao Qu Yu Cao Jun Gao Liang Ding Ruifeng Xu LRM 708 19 0 22 May 2022
Life after BERT: What do Other Muppets Understand about Language?Annual Meeting of the Association for Computational Linguistics (ACL), 2022 Vladislav Lialin Kevin Zhao Namrata Shivagunde Anna Rumshisky 261 7 0 21 May 2022
Selection-Inference: Exploiting Large Language Models for Interpretable Logical ReasoningInternational Conference on Learning Representations (ICLR), 2022 Antonia Creswell Murray Shanahan I. Higgins ReLM LRM 277 421 0 19 May 2022
Automatic Rule Induction for Interpretable Semi-Supervised LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Reid Pryzant Ziyi Yang Yichong Xu Chenguang Zhu Michael Zeng 241 10 0 18 May 2022
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERTInternational Conference on Pattern Recognition (ICPR), 2022 Beiduo Chen Wu Guo Quan Liu Kun Tao 196 3 0 17 May 2022
METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation Ruixin Hong Hongming Zhang Xintong Yu Changshui Zhang ReLM LRM 181 37 0 05 May 2022
Logically Consistent Adversarial Attacks for Soft Theorem ProversInternational Joint Conference on Artificial Intelligence (IJCAI), 2022 Alexander Gaskell Yishu Miao Lucia Specia Francesca Toni AAML 160 7 0 29 Apr 2022
Inferring Implicit Relations in Complex Questions with Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Uri Katz Mor Geva Jonathan Berant ReLM LRM 118 12 0 28 Apr 2022
Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System ImprovementConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Bhavana Dalvi Oyvind Tafjord Peter Clark LRM KELM ReLM 235 44 0 27 Apr 2022
What Makes Instruction Learning Hard? An Investigation and a New Challenge in a Synthetic EnvironmentConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Matthew Finlayson Kyle Richardson Ashish Sabharwal Peter Clark 221 13 0 19 Apr 2022

All Papers

Transformers as Soft Reasoners over Language

Papers citing "Transformers as Soft Reasoners over Language"