v1v2 (latest)

Do NLP Models Know Numbers? Probing Numeracy in Embeddings

17 September 2019

Sujian Li

Papers citing "Do NLP Models Know Numbers? Probing Numeracy in Embeddings"

50 / 147 papers shown

Title
Learning Non-linguistic Skills without Sacrificing Linguistic Proficiency Mandar Sharma Nikhil Muralidhar Naren Ramakrishnan CLL 68 4 0 14 May 2023
How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language model Michael Hanna Ollie Liu Alexandre Variengien LRM 341 132 0 30 Apr 2023
Evaluating Transformer Language Models on Arithmetic Operations Using Number Decomposition Matteo Muffo A. Cocco Enrico Bertino ReLM 75 25 0 21 Apr 2023
KitchenScale: Learning to predict ingredient quantities from recipe contexts Donghee Choi Mogan Gim Samy Badreddine Hajung Kim Donghyeon Park Jaewoo Kang 58 7 0 21 Apr 2023
Adapting Pretrained Language Models for Solving Tabular Prediction Problems in the Electronic Health Record C. McMaster D. Liew Douglas E. V. Pires 114 5 0 27 Mar 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 120 109 0 20 Mar 2023
Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models Alberto Testolin AIMat 72 22 0 14 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 95 29 0 14 Mar 2023
A Survey of Deep Learning for Mathematical Reasoning Pan Lu Liang Qiu Wenhao Yu Sean Welleck Kai-Wei Chang ReLM LRM 135 150 0 20 Dec 2022
Memorization of Named Entities in Fine-tuned BERT Models Andor Diera N. Lell Aygul Garifullina A. Scherp 68 0 0 07 Dec 2022
Towards Robust Numerical Question Answering: Diagnosing Numerical Capabilities of NLP Systems Jialiang Xu Mengyu Zhou Xinyi He Shi Han Dongmei Zhang AAML ELM AIMat 58 6 0 14 Nov 2022
Overcoming Barriers to Skill Injection in Language Modeling: Case Study in Arithmetic Mandar Sharma Nikhil Muralidhar Naren Ramakrishnan 62 6 0 03 Nov 2022
Do Language Models Understand Measurements? Sungjin Park Seung-kook Ryu Edward Choi ReLM LRM 89 4 0 23 Oct 2022
What do Large Language Models Learn beyond Language? Avinash Madasu Shashank Srivastava LRM AI4CE 83 5 0 21 Oct 2022
Probing with Noise: Unpicking the Warp and Weft of Embeddings Filip Klubicka John D. Kelleher 78 4 0 21 Oct 2022
A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models Alessandro Stolfo Zhijing Jin Kumar Shridhar Bernhard Schölkopf Mrinmaya Sachan ELM OOD LRM 147 66 0 21 Oct 2022
A Survey of Parameters Associated with the Quality of Benchmarks in NLP Swaroop Mishra Anjana Arunkumar Chris Bryan Chitta Baral 105 1 0 14 Oct 2022
Can Language Representation Models Think in Bets? Zhi–Bin Tang Mayank Kejriwal 55 6 0 14 Oct 2022
Language Models are Realistic Tabular Data Generators V. Borisov Kathrin Seßler Tobias Leemann Martin Pawelczyk Gjergji Kasneci LMTD 127 256 0 12 Oct 2022
Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems Fan Zhou Haoyu Dong Qian Liu Zhoujun Cheng Shi Han Dongmei Zhang ReLM LRM 89 6 0 11 Oct 2022
Understanding Prior Bias and Choice Paralysis in Transformer-based Language Representation Models through Four Experimental Probes Ke Shen Mayank Kejriwal 89 4 0 03 Oct 2022
Probing of Quantitative Values in Abstractive Summarization Models Nathan M. White 80 0 0 03 Oct 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 246 121 0 22 Sep 2022
On the Effectiveness of Compact Biomedical Transformers Omid Rohanian Mohammadmahdi Nouriborji Samaneh Kouchaki David Clifton MedIm 87 31 0 07 Sep 2022
Extend and Explain: Interpreting Very Long Language Models Joel Stremmel B. Hill Jeffrey S. Hertzberg Jaime Murillo Llewelyn Allotey Eran Halperin 59 4 0 02 Sep 2022
Induced Natural Language Rationales and Interleaved Markup Tokens Enable Extrapolation in Large Language Models M. Bueno Carlos Gemmel Jeffrey Stephen Dalton R. Lotufo Rodrigo Nogueira LRM 92 12 0 24 Aug 2022
Innovations in Neural Data-to-text Generation: A Survey Mandar Sharma Ajay K. Gogineni Naren Ramakrishnan 105 10 0 25 Jul 2022
Test2Vec: An Execution Trace Embedding for Test Case Prioritization E. Jabbar Soheila Zangeneh Hadi Hemmati R. Feldt 91 5 0 28 Jun 2022
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks Tuan Dinh Yuchen Zeng Ruisu Zhang Ziqian Lin Michael Gira Shashank Rajput Jy-yong Sohn Dimitris Papailiopoulos Kangwook Lee LMTD 181 140 0 14 Jun 2022
Arithmetic-Based Pretraining -- Improving Numeracy of Pretrained Language Models Dominic Petrak N. Moosavi Iryna Gurevych AIMat 40 2 0 13 May 2022
Beyond Distributional Hypothesis: Let Language Models Learn Meaning-Text Correspondence Myeongjun Jang Frank Mtumbuka Thomas Lukasiewicz 89 10 0 08 May 2022
Improving Downstream Task Performance by Treating Numbers as Entities Dhanasekar Sundararaman Vivek Subramanian Guoyin Wang Liyan Xu Lawrence Carin 73 5 0 07 May 2022
Probing for the Usage of Grammatical Number Karim Lasri Tiago Pimentel Alessandro Lenci Thierry Poibeau Ryan Cotterell 80 58 0 19 Apr 2022
Probing Pre-Trained Language Models for Cross-Cultural Differences in Values Arnav Arora Lucie-Aimée Kaffee Isabelle Augenstein VLM 95 136 0 25 Mar 2022
Impact of Pretraining Term Frequencies on Few-Shot Reasoning Yasaman Razeghi Robert L Logan IV Matt Gardner Sameer Singh ReLM LRM 123 157 0 15 Feb 2022
What Has Been Enhanced in my Knowledge-Enhanced Language Model? Buse Giledereli Guoji Fu Mrinmaya Sachan KELM 135 1 0 02 Feb 2022
Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey Prajjwal Bhargava Vincent Ng ReLM LRM 146 63 0 28 Jan 2022
Reasoning Like Program Executors Xinyu Pi Qian Liu Bei Chen Morteza Ziyadi Zeqi Lin Qiang Fu Yan Gao Jian-Guang Lou Weizhu Chen ReLM LRM 335 53 0 27 Jan 2022
NumHTML: Numeric-Oriented Hierarchical Transformer Model for Multi-task Financial Forecasting Linyi Yang Jiazheng Li Ruihai Dong Yue Zhang Barry Smyth AI4TS 44 39 0 05 Jan 2022
Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context Daniel M. Spokoyny Ivan Lee Zhao Jin Taylor Berg-Kirkpatrick 74 8 0 16 Dec 2021
Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Models Yu Feng Jing Zhang Yanling Wang Lemao Liu Cuiping Li Hong Chen AIMat 61 5 0 12 Dec 2021
LoNLI: An Extensible Framework for Testing Diverse Logical Reasoning Capabilities for NLI Ishan Tarunesh Somak Aditya Monojit Choudhury ELM LRM 64 4 0 04 Dec 2021
Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Text Christopher Clark Jordi Salvador Dustin Schwenk Derrick Bonafilia Mark Yatskar ... Aaron Sarnat Hannaneh Hajishirzi Aniruddha Kembhavi Oren Etzioni Ali Farhadi MLLM 57 5 0 01 Dec 2021
What Do You See in this Patient? Behavioral Testing of Clinical NLP Models Betty van Aken S. Herrmann Alexander Loser 53 12 0 30 Nov 2021
TraVLR: Now You See It, Now You Don't! A Bimodal Dataset for Evaluating Visio-Linguistic Reasoning Keng Ji Chow Samson Tan MingSung Kan LRM 65 4 0 21 Nov 2021
Probing Language Models for Understanding of Temporal Expressions Shivin Thukral Kunal Kukreja Christian Kavouras 175 23 0 03 Oct 2021
What BERT Based Language Models Learn in Spoken Transcripts: An Empirical Study Ayush Kumar Mukuntha Narayanan Sundararaman Jithendra Vepa 62 11 0 19 Sep 2021
Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model Kuntal Kumar Pal Chitta Baral 171 19 0 10 Sep 2021
NumGPT: Improving Numeracy Ability of Generative Pre-trained Models Zhihua Jin Xin Jiang Xingbo Wang Qun Liu Yong Wang Xiaozhe Ren Huamin Qu 80 19 0 07 Sep 2021
Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning Cunxiang Wang Boyuan Zheng Y. Niu Yue Zhang LRM 78 23 0 15 Aug 2021