Injecting Numerical Reasoning Skills into Language Models

9 April 2020

Papers citing "Injecting Numerical Reasoning Skills into Language Models"

50 / 137 papers shown

Title
Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models Alberto Testolin AIMat 64 22 0 14 Mar 2023
Extracting Victim Counts from Text Mian Zhong Shehzaad Dhuliawala Niklas Stoehr 40 5 0 23 Feb 2023
Do Deep Neural Networks Capture Compositionality in Arithmetic Reasoning? Keito Kudo Yoichi Aoki Tatsuki Kuribayashi Ana Brassard Masashi Yoshikawa Keisuke Sakaguchi Kentaro Inui CoGe 88 12 0 15 Feb 2023
Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning Siyuan Wang Zhongyu Wei Jiarong Xu Taishan Li Zhihao Fan LRM 80 5 0 21 Jan 2023
Tracing and Manipulating Intermediate Values in Neural Math Problem Solvers Yuta Matsumoto Benjamin Heinzerling Masashi Yoshikawa Kentaro Inui AIFin 53 5 0 17 Jan 2023
SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images Ryota Tanaka Kyosuke Nishida Kosuke Nishida Taku Hasegawa Itsumi Saito Kuniko Saito 66 85 0 12 Jan 2023
A Survey of Deep Learning for Mathematical Reasoning Pan Lu Liang Qiu Wenhao Yu Sean Welleck Kai-Wei Chang ReLM LRM 133 150 0 20 Dec 2022
Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks Kaiser Sun Peng Qi Yuhao Zhang Lan Liu William Yang Wang Zhiheng Huang 77 9 0 19 Dec 2022
Inducing Character-level Structure in Subword-based Language Models with Type-level Interchange Intervention Training Jing-ling Huang Zhengxuan Wu Kyle Mahowald Christopher Potts 83 14 0 19 Dec 2022
MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering Fangyu Liu Francesco Piccinno Syrine Krichene Chenxi Pang Kenton Lee Mandar Joshi Yasemin Altun Nigel Collier Julian Martin Eisenschlos VLM LRM 55 102 0 19 Dec 2022
Leveraging Data Recasting to Enhance Tabular Reasoning Aashna Jena Vivek Gupta Manish Shrivastava Julian Martin Eisenschlos LMTD 47 6 0 23 Nov 2022
PAL: Program-aided Language Models Luyu Gao Aman Madaan Shuyan Zhou Uri Alon Pengfei Liu Yiming Yang Jamie Callan Graham Neubig ReLM LRM 116 462 0 18 Nov 2022
NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering Tengxun Zhang Hongfei Xu Josef van Genabith Deyi Xiong Hongying Zan AIMat LRM 65 5 0 07 Nov 2022
Overcoming Barriers to Skill Injection in Language Modeling: Case Study in Arithmetic Mandar Sharma Nikhil Muralidhar Naren Ramakrishnan 53 6 0 03 Nov 2022
Piloting Copilot, Codex, and StarCoder2: Hot Temperature, Cold Prompts, or Black Magic? Jean-Baptiste Döderlein Nguessan Hermann Kouadio M. Acher D. Khelladi B. Combemale 92 36 0 26 Oct 2022
Do Language Models Understand Measurements? Sungjin Park Seung-kook Ryu Edward Choi ReLM LRM 74 4 0 23 Oct 2022
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples Yilun Zhao Linyong Nan Zhenting Qi Rui Zhang Dragomir R. Radev ReLM LMTD LRM 109 39 0 22 Oct 2022
A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models Alessandro Stolfo Zhijing Jin Kumar Shridhar Bernhard Schölkopf Mrinmaya Sachan ELM OOD LRM 129 66 0 21 Oct 2022
ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler Jiaxin Zhang Yashar Moshfeghi AIMat 68 18 0 18 Oct 2022
PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance Yang Deng Wenqiang Lei Wenxuan Zhang W. Lam Tat-Seng Chua 94 56 0 17 Oct 2022
UniRPG: Unified Discrete Reasoning over Table and Text as Program Generation Yongwei Zhou Junwei Bao Chaoqun Duan Youzheng Wu Xiaodong He Tiejun Zhao ReLM RALM LMTD LRM 49 21 0 15 Oct 2022
Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems Fan Zhou Haoyu Dong Qian Liu Zhoujun Cheng Shi Han Dongmei Zhang ReLM LRM 85 6 0 11 Oct 2022
Teaching Neural Module Networks to Do Arithmetic Jiayi Chen Xiao-Yu Guo Yuan-Fang Li Gholamreza Haffari AIMat LRM 52 2 0 06 Oct 2022
Induced Natural Language Rationales and Interleaved Markup Tokens Enable Extrapolation in Large Language Models M. Bueno Carlos Gemmel Jeffrey Stephen Dalton R. Lotufo Rodrigo Nogueira LRM 81 12 0 24 Aug 2022
Innovations in Neural Data-to-text Generation: A Survey Mandar Sharma Ajay K. Gogineni Naren Ramakrishnan 99 10 0 25 Jul 2022
Transformers discover an elementary calculation system exploiting local attention and grid-like problem representation Samuel Cognolato Alberto Testolin 71 7 0 06 Jul 2022
Discourse-Aware Graph Networks for Textual Logical Reasoning Yinya Huang Lemao Liu Kun Xu Meng Fang Liang Lin Xi Liang NAI 45 5 0 04 Jul 2022
Making Large Language Models Better Reasoners with Step-Aware Verifier Yifei Li Zeqi Lin Shizhuo Zhang Qiang Fu B. Chen Jian-Guang Lou Weizhu Chen ReLM LRM 99 230 0 06 Jun 2022
MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data Yilun Zhao Yunxiang Li Chenying Li Rui Zhang AIMat 65 107 0 03 Jun 2022
Semantic Probabilistic Layers for Neuro-Symbolic Learning Kareem Ahmed Stefano Teso Kai-Wei Chang Guy Van den Broeck Antonio Vergari TPM 62 83 0 01 Jun 2022
Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts H. Trivedi Niranjan Balasubramanian Tushar Khot Ashish Sabharwal ReLM LRM 94 11 0 25 May 2022
LogiGAN: Learning Logical Reasoning via Adversarial Pre-training Xinyu Pi Wanjun Zhong Yan Gao Nan Duan Jian-Guang Lou NAI GAN LRM AI4CE 85 16 0 18 May 2022
Arithmetic-Based Pretraining -- Improving Numeracy of Pretrained Language Models Dominic Petrak N. Moosavi Iryna Gurevych AIMat 33 2 0 13 May 2022
Improving Downstream Task Performance by Treating Numbers as Entities Dhanasekar Sundararaman Vivek Subramanian Guoyin Wang Liyan Xu Lawrence Carin 50 5 0 07 May 2022
OPERA:Operation-Pivoted Discrete Reasoning over Text Yongwei Zhou Junwei Bao Chaoqun Duan Haipeng Sun Jiahui Liang Yifan Wang Jing Zhao Youzheng Wu Xiaodong He Tiejun Zhao LRM 81 11 0 29 Apr 2022
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks Ruixiang Cui Daniel Hershcovich Anders Søgaard 87 13 0 22 Apr 2022
Unsupervised Numerical Reasoning to Extract Phenotypes from Clinical Text by Leveraging External Knowledge Ashwani Tanwar Jingqing Zhang Julia Ive Vibhor Gupta Yike Guo 71 3 0 19 Apr 2022
Probing for the Usage of Grammatical Number Karim Lasri Tiago Pimentel Alessandro Lenci Thierry Poibeau Ryan Cotterell 80 58 0 19 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 113 155 0 15 Apr 2022
Self-Consistency Improves Chain of Thought Reasoning in Language Models Xuezhi Wang Jason W. Wei Dale Schuurmans Quoc Le Ed H. Chi Sharan Narang Aakanksha Chowdhery Denny Zhou ReLM BDL LRM AI4CE 577 3,756 0 21 Mar 2022
Cluster & Tune: Boost Cold Start Performance in Text Classification Eyal Shnarch Ariel Gera Alon Halfon Lena Dankin Leshem Choshen R. Aharonov Noam Slonim 67 22 0 20 Mar 2022
ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning Ahmed Masry Do Xuan Long J. Tan Shafiq Joty Enamul Hoque AIMat 134 687 0 19 Mar 2022
FiNER: Financial Numeric Entity Recognition for XBRL Tagging Lefteris Loukas Manos Fergadiotis Ilias Chalkidis Eirini Spyropoulou Prodromos Malakasiotis Ion Androutsopoulos George Giannakopoulos 81 61 0 12 Mar 2022
Impact of Pretraining Term Frequencies on Few-Shot Reasoning Yasaman Razeghi Robert L Logan IV Matt Gardner Sameer Singh ReLM LRM 110 157 0 15 Feb 2022
Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey Prajjwal Bhargava Vincent Ng ReLM LRM 139 63 0 28 Jan 2022
Schema-Free Dependency Parsing via Sequence Generation Boda Lin Zijun Yao Jiaxin Shi S. Cao Binghao Tang Si Li Yong Luo Juanzi Li Lei Hou 60 0 0 28 Jan 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 923 9,784 0 28 Jan 2022
Reasoning Like Program Executors Xinyu Pi Qian Liu Bei Chen Morteza Ziyadi Zeqi Lin Qiang Fu Yan Gao Jian-Guang Lou Weizhu Chen ReLM LRM 307 53 0 27 Jan 2022
Artefact Retrieval: Overview of NLP Models with Knowledge Base Access Vilém Zouhar Marius Mosbach Debanjali Biswas Dietrich Klakow KELM 90 4 0 24 Jan 2022
Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context Daniel M. Spokoyny Ivan Lee Zhao Jin Taylor Berg-Kirkpatrick 59 8 0 16 Dec 2021