v1v2 (latest)

Transformers as Soft Reasoners over Language

International Joint Conference on Artificial Intelligence (IJCAI), 2020

14 February 2020

Oyvind Tafjord

Papers citing "Transformers as Soft Reasoners over Language"

50 / 256 papers shown

Title
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 284 208 0 12 Apr 2022
AbductionRules: Training Transformers to Explain Unexpected InputsFindings (Findings), 2022 Nathan Young Qiming Bao Joshua Bensemann Michael Witbrock AI4CE LRM 193 32 0 23 Mar 2022
FaiRR: Faithful and Robust Deductive Reasoning over Natural LanguageAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Soumya Sanyal Harman Singh Xiang Ren ReLM LRM 227 48 0 19 Mar 2022
E-KAR: A Benchmark for Rationalizing Natural Language Analogical ReasoningFindings (Findings), 2022 Jiangjie Chen Rui Xu Ziquan Fu Wei Shi Zhongqiao Li Xinbo Zhang Changzhi Sun Lei Li Yanghua Xiao Hao Zhou ELM 134 46 0 16 Mar 2022
MERIt: Meta-Path Guided Contrastive Learning for Logical ReasoningFindings (Findings), 2022 Fangkai Jiao Yangyang Guo Xuemeng Song Liqiang Nie LRM 161 43 0 01 Mar 2022
Do Transformers know symbolic rules, and would we know if they did? Tommi Gröndahl Yu-Wen Guo Nirmal Asokan 230 0 0 19 Feb 2022
Logical Reasoning for Task Oriented Dialogue Systems Sajjad Beygi Maryam Fazel-Zarandi Alessandra Cervone Prakash Krishnan Siddhartha Reddy Jonnalagadda LRM 161 7 0 08 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsNeural Information Processing Systems (NeurIPS), 2022 Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 2.2K 14,255 0 28 Jan 2022
Does Entity Abstraction Help Generative Transformers Reason? Nicolas Angelard-Gontier Siva Reddy C. Pal 199 6 0 05 Jan 2022
Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability Kyle Richardson Ashish Sabharwal ReLM LRM 214 27 0 16 Dec 2021
Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge Ian Porada Alessandro Sordoni Jackie C.K. Cheung 158 9 0 16 Dec 2021
Interscript: A dataset for interactive learning of scripts through error feedback Niket Tandon Aman Madaan Peter Clark Keisuke Sakaguchi Yiming Yang 178 11 0 15 Dec 2021
Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking Ronen Tamari Kyle Richardson Aviad Sar-Shalom Noam Kahlon Nelson F. Liu Reut Tsarfaty Dafna Shahaf 319 6 0 30 Nov 2021
Learning Symbolic Rules for Reasoning in Quasi-Natural Language Kaiyu Yang Gaowen Liu NAI ReLM LRM 179 14 0 23 Nov 2021
Hey AI, Can You Solve Complex Tasks by Talking to Agents? Tushar Khot Kyle Richardson Daniel Khashabi Ashish Sabharwal RALM LRM 164 15 0 16 Oct 2021
GNN is a Counter? Revisiting GNN for Question Answering Kuan-Chieh Wang Yuyu Zhang Diyi Yang Le Song Tao Qin LMTD 159 36 0 07 Oct 2021
DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models Gregor Betz Kyle Richardson 232 9 0 04 Oct 2021
BeliefBank: Adding Memory to a Pre-Trained Language Model for a Systematic Notion of Belief Nora Kassner Oyvind Tafjord Hinrich Schütze Peter Clark KELM LRM 459 67 0 29 Sep 2021
Abstraction, Reasoning and Deep Learning: A Study of the "Look and Say" Sequence Wlodek Zadrozny 90 2 0 27 Sep 2021
RuleBert: Teaching Soft Rules to Pre-trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Mohammed Saeed N. Ahmadi Preslav Nakov Paolo Papotti LRM 475 34 0 24 Sep 2021
Neural Unification for Logic Reasoning over Natural Language Gabriele Picco Hoang Thanh Lam M. Sbodio Vanessa Lopez Garcia NAI LRM 146 15 0 17 Sep 2021
On the Challenges of Evaluating Compositional Explanations in Multi-Hop Inference: Relevance, Completeness, and Expert RatingsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Peter Alexander Jansen Kelly Smith Dan Moreno Huitzilin Ortiz CoGe ReLM LRM 127 10 0 07 Sep 2021
Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning Cunxiang Wang Boyuan Zheng Y. Niu Yue Zhang LRM 175 23 0 15 Aug 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning SkillsAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Ori Yoran Alon Talmor Jonathan Berant ReLM LRM 360 55 0 15 Jul 2021
Probabilistic Graph Reasoning for Natural Proof Generation Changzhi Sun Xinbo Zhang Jiangjie Chen Chun Gan Man Lan Jiaze Chen Hao Zhou Lei Li 127 9 0 06 Jul 2021
Thinking Like TransformersInternational Conference on Machine Learning (ICML), 2021 Gail Weiss Yoav Goldberg Eran Yahav AI4CE 305 166 0 13 Jun 2021
Ethical-Advice Taker: Do Language Models Understand Natural Language Interventions?Findings (Findings), 2021 Jieyu Zhao Daniel Khashabi Tushar Khot Ashish Sabharwal Kai-Wei Chang KELM 200 56 0 02 Jun 2021
multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule ReasoningNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Swarnadeep Saha Prateek Yadav Joey Tianyi Zhou ReLM LRM 206 27 0 02 Jun 2021
Diff-Explainer: Differentiable Convex Optimization for Explainable Multi-hop InferenceTransactions of the Association for Computational Linguistics (TACL), 2021 Mokanarangan Thayaparan Marco Valentino Deborah Ferreira Julia Rozanova André Freitas 316 11 0 07 May 2021
Towards General Natural Language Understanding with Probabilistic WorldbuildingTransactions of the Association for Computational Linguistics (TACL), 2021 Abulhair Saparov Tom Michael Mitchell 300 7 0 06 May 2021
Flexible Generation of Natural Language DeductionsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Kaj Bostrom Xinyu Zhao Swarat Chaudhuri Greg Durrett ReLM LRM 508 37 0 18 Apr 2021
Relational World Knowledge Representation in Contextual Language Models: A ReviewConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Tara Safavi Danai Koutra KELM 218 56 0 12 Apr 2021
Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2 Gregor Betz Kyle Richardson Christian Voigt ReLM LRM 167 32 0 24 Mar 2021
NaturalProofs: Mathematical Theorem Proving in Natural Language Sean Welleck Hamish Ivison Ronan Le Bras Hannaneh Hajishirzi Yejin Choi Kyunghyun Cho AIMat 235 88 0 24 Mar 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingNeural Information Processing Systems (NeurIPS), 2021 Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 619 219 0 16 Feb 2021
Exploring Transitivity in Neural NLI Models through VeridicalityConference of the European Chapter of the Association for Computational Linguistics (EACL), 2021 Hitomi Yanaka K. Mineshima Kentaro Inui 177 23 0 26 Jan 2021
Analyzing Commonsense Emergence in Few-shot Knowledge ModelsConference on Automated Knowledge Base Construction (AKBC), 2021 Jeff Da Ronan Le Bras Ximing Lu Yejin Choi Antoine Bosselut AI4MH KELM 428 42 0 01 Jan 2021
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural LanguageFindings (Findings), 2020 Oyvind Tafjord Bhavana Dalvi Peter Clark 395 360 0 24 Dec 2020
Can Transformers Reason About Effects of Actions? Pratyay Banerjee Chitta Baral Man Luo Arindam Mitra Kuntal Kumar Pal Tran Cao Son Neeraj Varshney LRM AI4CE 179 10 0 17 Dec 2020
Natural Language Inference in Context -- Investigating Contextual Reasoning over Long Texts Hanmeng Liu Leyang Cui Jian Liu Yue Zhang ReLM LRM 111 53 0 10 Nov 2020
HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verification Yichen Jiang Shikha Bordia Zheng Zhong Charles Dognin M. Singh Joey Tianyi Zhou 353 194 0 05 Nov 2020
Neural Databases James Thorne Majid Yazdani Marzieh Saeidi Fabrizio Silvestri Sebastian Riedel A. Halevy NAI 201 9 0 14 Oct 2020
PRover: Proof Generation for Interpretable Reasoning over Rules Swarnadeep Saha Sayan Ghosh Shashank Srivastava Joey Tianyi Zhou ReLM LRM 202 80 0 06 Oct 2020
ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down AttentionConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 José Manuél Gómez-Pérez Raúl Ortega 127 29 0 01 Oct 2020
Measuring Systematic Generalization in Neural Proof Generation with Transformers Nicolas Angelard-Gontier Koustuv Sinha Siva Reddy C. Pal LRM 203 67 0 30 Sep 2020
Hacking with God: a Common Programming Language of Robopsychology and Robophilosophy Norbert Bátfai 77 2 0 16 Sep 2020
Critical Thinking for Language ModelsInternational Conference on Computational Semantics (IWCS), 2020 Gregor Betz Christian Voigt Kyle Richardson SyDa ReLM LRM AI4CE 246 39 0 15 Sep 2020
Knowledge-Aware Language Model Pretraining Corby Rosset Chenyan Xiong M. Phan Xia Song Paul N. Bennett Saurabh Tiwary KELM 217 88 0 29 Jun 2020
Are Pretrained Language Models Symbolic Reasoners Over Knowledge? Nora Kassner Benno Kroje Hinrich Schütze ReLM LRM 106 4 0 18 Jun 2020
Conversational Neuro-Symbolic Commonsense Reasoning Forough Arabshahi Jennifer Lee Mikayla Gawarecki Kathryn Mazaitis A. Azaria Tom Michael Mitchell LRM 243 51 0 17 Jun 2020