v1v2 (latest)

Do NLP Models Know Numbers? Probing Numeracy in Embeddings

17 September 2019

Sujian Li

Papers citing "Do NLP Models Know Numbers? Probing Numeracy in Embeddings"

47 / 147 papers shown

Title
How to Query Language Models? Leonard Adolphs Shehzaad Dhuliawala Thomas Hofmann KELM 86 15 0 04 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 437 4,053 0 28 Jul 2021
MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving Zhenwen Liang Jipeng Zhang Lei Wang Wei Qin Yunshi Lan Jie Shao Xiangliang Zhang AIMat 85 66 0 28 Jul 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills Ori Yoran Alon Talmor Jonathan Berant ReLM LRM 238 54 0 15 Jul 2021
A Closer Look at How Fine-tuning Changes BERT Yichu Zhou Vivek Srikumar 84 68 0 27 Jun 2021
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases Boxi Cao Hongyu Lin Xianpei Han Le Sun Lingyong Yan M. Liao Tong Xue Jin Xu 79 136 0 17 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 179 865 0 14 Jun 2021
Better than BERT but Worse than Baseline Boxiang Liu Jiaji Huang Xingyu Cai Kenneth Church 31 3 0 12 May 2021
TABBIE: Pretrained Representations of Tabular Data H. Iida Dung Ngoc Thai Varun Manjunatha Mohit Iyyer LMTD SSL VLM 95 178 0 06 May 2021
CombOptNet: Fit the Right NP-Hard Problem by Learning Integer Programming Constraints Anselm Paulus Michal Rolínek Vít Musil Brandon Amos Georg Martius 92 62 0 05 May 2021
Random Embeddings and Linear Regression can Predict Protein Function Tianyu Lu Alex X. Lu Alan M. Moses SSL 53 5 0 25 Apr 2021
Subsentence Extraction from Text Using Coverage-Based Deep Learning Language Models Jongyoon Lim Inkyu Sa H. Ahn N. Gasteiger S. Lee B. MacDonald 36 9 0 20 Apr 2021
NT5?! Training T5 to Perform Numerical Reasoning Peng Yang Ying Chen Yuechan Chen Daniel Cer AIMat LRM 82 15 0 15 Apr 2021
DirectProbe: Studying Representations without Classifiers Yichu Zhou Vivek Srikumar 97 29 0 13 Apr 2021
Transformers: "The End of History" for NLP? Anton Chernyavskiy Dmitry Ilvovsky Preslav Nakov 117 30 0 09 Apr 2021
Detecting of a Patient's Condition From Clinical Narratives Using Natural Language Representation Thanh-Dung Le R. Noumeir J. Rambaud Guillaume Sans P. Jouvet 72 18 0 08 Apr 2021
Annotating Columns with Pre-trained Language Models Yoshihiko Suhara Jinfeng Li Yuliang Li Dan Zhang cCaugatay Demiralp Chen Chen W. Tan LMTD 60 90 0 05 Apr 2021
Representing Numbers in NLP: a Survey and a Vision Avijit Thawani Jay Pujara Pedro A. Szekely Filip Ilievski 106 119 0 24 Mar 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 133 130 0 25 Feb 2021
Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration Betty van Aken Jens-Michalis Papaioannou M. Mayrdorfer Klemens Budde Felix Alexander Gers Alexander Loser 54 73 0 08 Feb 2021
Data-to-text Generation with Macro Planning Ratish Puduppully Mirella Lapata 110 74 0 04 Feb 2021
Zero-shot Generalization in Dialog State Tracking through Generative Question Answering Shuyang Li Jin Cao Mukund Sridhar Henghui Zhu Shang-Wen Li Wael Hamza Julian McAuley BDL 74 46 0 20 Jan 2021
Seeing past words: Testing the cross-modal capabilities of pretrained V&L models on counting tasks Letitia Parcalabescu Albert Gatt Anette Frank Iacer Calixto LRM 101 49 0 22 Dec 2020
Trex: Learning Execution Semantics from Micro-Traces for Binary Similarity Kexin Pei Zhou Xuan Junfeng Yang Suman Jana Baishakhi Ray 121 91 0 16 Dec 2020
Infusing Finetuning with Semantic Dependencies Zhaofeng Wu Hao Peng Noah A. Smith 91 37 0 10 Dec 2020
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 73 439 0 02 Dec 2020
Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT Rik van Noord Antonio Toral Johan Bos 76 4 0 09 Nov 2020
An Empirical Investigation of Contextualized Number Prediction Daniel M. Spokoyny Taylor Berg-Kirkpatrick AI4TS 85 38 0 20 Oct 2020
Bootleg: Chasing the Tail with Self-Supervised Named Entity Disambiguation Laurel J. Orr Megan Leszczynski Simran Arora Sen Wu Neel Guha Xiao Ling Christopher Ré 220 48 0 20 Oct 2020
Probing for Multilingual Numerical Understanding in Transformer-Based Language Models Devin J. Johnson Denise Mak Drew Barker Lexi Loessberg-Zahl LRM 52 18 0 13 Oct 2020
Do Language Embeddings Capture Scales? Xikun Zhang Deepak Ramachandran Ian Tenney Yanai Elazar Dan Roth MILM ReLM LRM 104 94 0 11 Oct 2020
Intrinsic Probing through Dimension Selection Lucas Torroba Hennigen Adina Williams Ryan Cotterell 78 58 0 06 Oct 2020
Understanding tables with intermediate pre-training Julian Martin Eisenschlos Syrine Krichene Thomas Müller LMTD 172 121 0 01 Oct 2020
Towards Question Format Independent Numerical Reasoning: A Set of Prerequisite Tasks Swaroop Mishra Arindam Mitra Neeraj Varshney Bhavdeep Singh Sachdeva Chitta Baral AIMat 59 13 0 18 May 2020
INFOTABS: Inference on Tables as Semi-structured Data Vivek Gupta Maitrey Mehta Pegah Nokhiz Vivek Srikumar LMTD 75 112 0 13 May 2020
Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-trained Language Models Bill Yuchen Lin Seyeon Lee Rahul Khanna Xiang Ren AIMat 99 158 0 02 May 2020
Natural Language Premise Selection: Finding Supporting Statements for Mathematical Text Deborah Ferreira André Freitas AIMat 65 32 0 30 Apr 2020
What Happens To BERT Embeddings During Fine-tuning? Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 117 189 0 29 Apr 2020
Attention is Not Only a Weight: Analyzing Transformers with Vector Norms Goro Kobayashi Tatsuki Kuribayashi Sho Yokoi Kentaro Inui 71 15 0 21 Apr 2020
Joint translation and unit conversion for end-to-end localization Georgiana Dinu Prashant Mathur Marcello Federico Stanislas Lauly Yaser Al-Onaizan 71 4 0 10 Apr 2020
Injecting Numerical Reasoning Skills into Language Models Mor Geva Ankit Gupta Jonathan Berant AIMat LRM 93 227 0 09 Apr 2020
TAPAS: Weakly Supervised Table Parsing via Pre-training Jonathan Herzig Pawel Krzysztof Nowak Thomas Müller Francesco Piccinno Julian Martin Eisenschlos LMTD RALM 187 658 0 05 Apr 2020
R3: A Reading Comprehension Benchmark Requiring Reasoning Processes Ran Wang Kun Tao Dingjie Song Zhilong Zhang Xiao Ma Xiáo Su Xinyu Dai 64 3 0 02 Apr 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 173 1,511 0 27 Feb 2020
oLMpics -- On what Language Model Pre-training Captures Alon Talmor Yanai Elazar Yoav Goldberg Jonathan Berant LRM 109 304 0 31 Dec 2019
Learning Numeral Embeddings Chengyue Jiang Zhonglin Nian Kaihao Guo Shanbo Chu Yinggong Zhao Libin Shen Kewei Tu 94 22 0 28 Dec 2019
WaLDORf: Wasteless Language-model Distillation On Reading-comprehension J. Tian A. Kreuzer Pai-Hung Chen Hans-Martin Will VLM 60 3 0 13 Dec 2019