Injecting Numerical Reasoning Skills into Language Models

9 April 2020

Papers citing "Injecting Numerical Reasoning Skills into Language Models"

37 / 137 papers shown

Title
Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Models Yu Feng Jing Zhang Yanling Wang Lemao Liu Cuiping Li Hong Chen AIMat 42 5 0 12 Dec 2021
DeepA2: A Modular Framework for Deep Argument Analysis with Pretrained Neural Text2Text Language Models Gregor Betz Kyle Richardson 80 8 0 04 Oct 2021
Numerical reasoning in machine reading comprehension tasks: are we there yet? Hadeel Al-Negheimish Pranava Madhyastha A. Russo AIMat ReLM 64 13 0 16 Sep 2021
FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretraining Zhoujun Cheng Haoyu Dong Ran Jia Pengfei Wu Shi Han Fan Cheng Dongmei Zhang AIMat ReLM LMTD LRM 75 27 0 15 Sep 2021
SHAPE: Shifted Absolute Position Embedding for Transformers Shun Kiyono Sosuke Kobayashi Jun Suzuki Kentaro Inui 290 47 0 13 Sep 2021
Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model Kuntal Kumar Pal Chitta Baral 171 19 0 10 Sep 2021
NumGPT: Improving Numeracy Ability of Generative Pre-trained Models Zhihua Jin Xin Jiang Xingbo Wang Qun Liu Yong Wang Xiaozhe Ren Huamin Qu 74 19 0 07 Sep 2021
Teaching Autoregressive Language Models Complex Tasks By Demonstration Gabriel Recchia 79 22 0 05 Sep 2021
EviDR: Evidence-Emphasized Discrete Reasoning for Reasoning Machine Reading Comprehension Yongwei Zhou Junwei Bao Haipeng Sun Jiahui Liang Youzheng Wu Xiaodong He Bowen Zhou Tiejun Zhao 29 5 0 18 Aug 2021
Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning Cunxiang Wang Boyuan Zheng Y. Niu Yue Zhang LRM 78 23 0 15 Aug 2021
MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving Zhenwen Liang Jipeng Zhang Lei Wang Wei Qin Yunshi Lan Jie Shao Xiangliang Zhang AIMat 83 65 0 28 Jul 2021
CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision Zhongyang Li Xiao Ding Kuo Liao Bing Qin Ting Liu CML 107 19 0 21 Jul 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills Ori Yoran Alon Talmor Jonathan Berant ReLM LRM 236 54 0 15 Jul 2021
A Theoretical Analysis of Fine-tuning with Linear Teachers Gal Shachaf Alon Brutzkus Amir Globerson 86 17 0 04 Jul 2021
TIMEDIAL: Temporal Commonsense Reasoning in Dialog Lianhui Qin Aditya Gupta Shyam Upadhyay Luheng He Yejin Choi Manaal Faruqui LRM 95 72 0 08 Jun 2021
Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning Piotr Pikekos Henryk Michalewski Mateusz Malinowski 74 28 0 07 Jun 2021
NT5?! Training T5 to Perform Numerical Reasoning Peng Yang Ying Chen Yuechan Chen Daniel Cer AIMat LRM 65 15 0 15 Apr 2021
What's in your Head? Emergent Behaviour in Multi-Task Transformer Models Mor Geva Uri Katz Aviv Ben-Arie Jonathan Berant LRM 78 11 0 13 Apr 2021
Annotating Columns with Pre-trained Language Models Yoshihiko Suhara Jinfeng Li Yuliang Li Dan Zhang cCaugatay Demiralp Chen Chen W. Tan LMTD 53 90 0 05 Apr 2021
TAPAS at SemEval-2021 Task 9: Reasoning over tables with intermediate pre-training Thomas Müller Julian Martin Eisenschlos Syrine Krichene LMTD 67 15 0 02 Apr 2021
Representing Numbers in NLP: a Survey and a Vision Avijit Thawani Jay Pujara Pedro A. Szekely Filip Ilievski 91 119 0 24 Mar 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 106 130 0 25 Feb 2021
Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar Nora Kassner Shauli Ravfogel Abhilasha Ravichander Eduard H. Hovy Hinrich Schütze Yoav Goldberg HILM 335 371 0 01 Feb 2021
Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoning Amrita Saha Shafiq Joty Guosheng Lin NAI AIMat LRM 36 20 0 28 Jan 2021
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 117 21 0 31 Dec 2020
ParsiNLU: A Suite of Language Understanding Challenges for Persian Daniel Khashabi Arman Cohan Siamak Shakeri Pedram Hosseini Pouya Pezeshkpour ... Niloofar Safi Samghabadi Mahsa Shafaei Saber Sheybani Ali Tazarv Yadollah Yaghoobzadeh 62 44 0 11 Dec 2020
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 67 439 0 02 Dec 2020
An Empirical Investigation of Contextualized Number Prediction Daniel M. Spokoyny Taylor Berg-Kirkpatrick AI4TS 73 38 0 20 Oct 2020
Do Language Embeddings Capture Scales? Xikun Zhang Deepak Ramachandran Ian Tenney Yanai Elazar Dan Roth MILM ReLM LRM 78 94 0 11 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 87 109 0 08 Oct 2020
Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment Zhiyuan Liu Yixin Cao Liangming Pan Juan-Zi Li Zhiyuan Liu Tat-Seng Chua 102 133 0 07 Oct 2020
Understanding tables with intermediate pre-training Julian Martin Eisenschlos Syrine Krichene Thomas Müller LMTD 153 121 0 01 Oct 2020
Question Directed Graph Attention Network for Numerical Reasoning over Text Kunlong Chen Weidi Xu Xingyi Cheng Zou Xiaochuan Yuyu Zhang Le Song Taifeng Wang Yuan Qi Wei Chu AIMat OOD 85 67 0 16 Sep 2020
Latent Compositional Representations Improve Systematic Generalization in Grounded Question Answering Ben Bogin Sanjay Subramanian Matt Gardner Jonathan Berant ReLM OOD BDL LRM 55 28 0 01 Jul 2020
GMAT: Global Memory Augmentation for Transformers Ankit Gupta Jonathan Berant RALM 73 50 0 05 Jun 2020
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models Bill Yuchen Lin Seyeon Lee Rahul Khanna Xiang Ren AIMat 97 158 0 02 May 2020
Diversify Your Datasets: Analyzing Generalization via Controlled Variance in Adversarial Datasets Ohad Rozen Vered Shwartz Roee Aharoni Ido Dagan AAML 87 38 0 21 Oct 2019