v1v2 (latest)

Do NLP Models Know Numbers? Probing Numeracy in Embeddings

17 September 2019

Sujian Li

Papers citing "Do NLP Models Know Numbers? Probing Numeracy in Embeddings"

50 / 147 papers shown

Title
SCOPE: Compress Mathematical Reasoning Steps for Efficient Automated Process Annotation Huimin Xu Xin Mao Feng-Lin Li Xiaobao Wu Wang Chen Wei Zhang Anh Tuan Luu 47 1 0 20 May 2025
Geospatial Mechanistic Interpretability of Large Language Models Stef De Sabbata Stefano Mizzaro Kevin Roitero AI4CE 138 0 0 06 May 2025
Understanding and Improving Information Preservation in Prompt Compression for LLMs Weronika Łajewska Momchil Hardalov Laura Aina Neha Anna John Hang Su Lluís Marquez 162 1 0 24 Mar 2025
A Survey on Mathematical Reasoning and Optimization with Large Language Models Ali Forootani OffRL LRM AI4CE 127 1 0 22 Mar 2025
BPQA Dataset: Evaluating How Well Language Models Leverage Blood Pressures to Answer Biomedical Questions Chi Hang Ruiqi Deng L. Jiang Zihao Yang Anton Alyakin Daniel Alber E. Oermann AI4MH LM&MA 95 0 0 06 Mar 2025
Tokenization is Sensitive to Language Variation Anna Wegmann Dong Nguyen David Jurgens 168 2 0 21 Feb 2025
Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language Models Haoyang Li Xuejia Chen Zhanchao Xu Darian Li Nicole Hu ... Yongbin Li Luyu Qiu C. Zhang Qing Li Lei Chen ELM LRM 120 1 0 16 Feb 2025
Ignore the KL Penalty! Boosting Exploration on Critical Tokens to Enhance RL Fine-Tuning Jean Vassoyan Nathanaël Beau Roman Plaud OffRL 167 2 0 10 Feb 2025
Disambiguating Numeral Sequences to Decipher Ancient Accounting Corpora Logan Born M. Willis Monroe Kemal Kurniawan Anoop Sarkar 255 1 0 31 Jan 2025
Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets Vatsal Gupta Pranshu Pandya Tushar Kataria Vivek Gupta Dan Roth AAML 192 1 0 03 Jan 2025
Mathematical Language Models: A Survey Wen Liu Hanglei Hu Jie Zhou Yuyang Ding Junsong Li ... Mengliang He Qin Chen Bo Jiang Aimin Zhou Liang He LRM 237 14 0 03 Jan 2025
Implicit Priors Editing in Stable Diffusion via Targeted Token Adjustment Feng He Chao Zhang Zhixue Zhao 183 0 0 04 Dec 2024
Number Cookbook: Number Understanding of Language Models and How to Improve It Haotong Yang Yi Hu Shijia Kang Zhouchen Lin Muhan Zhang LRM 118 8 0 06 Nov 2024
Regress, Don't Guess -- A Regression-like Loss on Number Tokens for Language Models Jonas Zausinger Lars Pennig Anamarija Kozina Sean Sdahl Julian Sikora ... Anna Ketteler Thorben Prein Vishwa Mohan Singh Michael Morris Danziger Jannis Born 84 3 0 04 Nov 2024
Interleaving Text and Number Embeddings to Solve Mathemathics Problems Marvin Alberts Gianmarco Gabrieli Irina Espejo Morales 51 2 0 25 Oct 2024
The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces Ahmed Oumar El-Shangiti Tatsuya Hiraoka Hilal AlQuabeh Benjamin Heinzerling Kentaro Inui 146 1 0 17 Oct 2024
Language Models Encode Numbers Using Digit Representations in Base 10 Amit Arnold Levy Mor Geva 75 8 0 15 Oct 2024
Gem: Gaussian Mixture Model Embeddings for Numerical Feature Distributions Hafiz Tayyab Rauf Alex Bogatu N. Paton André Freitas 62 0 0 09 Oct 2024
LRHP: Learning Representations for Human Preferences via Preference Pairs Chenglong Wang Yang Gan Yifu Huo Yongyu Mu Qiaozhi He Murun Yang Tong Xiao Chunliang Zhang Tongran Liu Jingbo Zhu AI4TS 120 1 0 06 Oct 2024
Numbers Matter! Bringing Quantity-awareness to Retrieval Systems Satya Almasian Milena Bruseva Michael Gertz 74 0 0 14 Jul 2024
How to Leverage Digit Embeddings to Represent Numbers? Jasivan Sivakumar N. Moosavi 65 0 0 01 Jul 2024
CTSyn: A Foundational Model for Cross Tabular Data Generation Xiaofeng Lin Chenheng Xu Matthew Yang Guang Cheng 83 4 0 07 Jun 2024
NUMCoT: Numerals and Units of Measurement in Chain-of-Thought Reasoning using Large Language Models Ancheng Xu Minghuan Tan Lei Wang Min Yang Ruifeng Xu LRM 81 0 0 05 Jun 2024
Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks Mahdi Sabbaghi George Pappas Hamed Hassani Surbhi Goel 118 6 0 04 Jun 2024
SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems Patrick Emami Zhaonan Li Saumya Sinha Truc Nguyen 170 1 0 30 May 2024
Multi-objective Representation for Numbers in Clinical Narratives: A CamemBERT-Bio-Based Alternative to Large-Scale LLMs Boammani Aser Lompo Thanh-Dung Le 134 1 0 28 May 2024
Exploring Internal Numeracy in Language Models: A Case Study on ALBERT Ulme Wennberg G. Henter MILM 73 1 0 25 Apr 2024
Pre-Calc: Learning to Use the Calculator Improves Numeracy in Language Models Vishruth Veerendranath Vishwa Shah Kshitish Ghate 108 0 0 22 Apr 2024
Laying Anchors: Semantically Priming Numerals in Language Modeling Mandar Sharma Rutuja Murlidhar Taware Pravesh Koirala Nikhil Muralidhar Naren Ramakrishnan 60 2 0 02 Apr 2024
Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization Andreas Waldis Yufang Hou Iryna Gurevych ELM 75 8 0 02 Feb 2024
Semantic Sensitivities and Inconsistent Predictions: Measuring the Fragility of NLI Models Erik Arakelyan Zhaoqi Liu Isabelle Augenstein AAML 145 12 0 25 Jan 2024
A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates Raphael Milliere Cameron Buckner LRM ELM 97 23 0 08 Jan 2024
Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning Subhabrata Dutta Joykirat Singh Ishan Pandey Sunny Manchanda Soumen Chakrabarti Tanmoy Chakraborty ReLM LRM 88 4 0 09 Dec 2023
RELIC: Investigating Large Language Model Responses using Self-Consistency Furui Cheng Vilém Zouhar Simran Arora Mrinmaya Sachan Hendrik Strobelt Mennatallah El-Assady HILM 86 22 0 28 Nov 2023
Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Data Mubashara Akhtar Abhilash Shankarampeta Vivek Gupta Arpit Patil O. Cocarascu Elena Simperl LRM ReLM LMTD ELM 91 25 0 03 Nov 2023
LLM-Prop: Predicting Physical And Electronic Properties Of Crystalline Solids From Their Text Descriptions Andre Niyongabo Rubungo Craig Arnold Barry P. Rand Adji Bousso Dieng AI4CE 83 31 0 21 Oct 2023
Learn Your Tokens: Word-Pooled Tokenization for Language Modeling Avijit Thawani Saurabh Ghanekar Xiaoyuan Zhu Jay Pujara 114 5 0 17 Oct 2023
Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks Erfan Shayegani Md Abdullah Al Mamun Yu Fu Pedram Zaree Yue Dong Nael B. Abu-Ghazaleh AAML 249 164 0 16 Oct 2023
Targeted Image Data Augmentation Increases Basic Skills Captioning Robustness Valentin Barriere Felipe del Rio Andres Carvallo De Ferari Carlos Aspillaga Eugenio Herrera-Berg Cristian Buc Calderon DiffM 78 0 0 27 Sep 2023
Evaluating Transformer's Ability to Learn Mildly Context-Sensitive Languages Shunjie Wang Shane Steinert-Threlkeld 79 4 0 02 Sep 2023
Arithmetic with Language Models: from Memorization to Computation Davide Maltoni Matteo Ferrara KELM LRM 99 7 0 02 Aug 2023
Teaching Smaller Language Models To Generalise To Unseen Compositional Questions Tim Hartill N. Tan Michael Witbrock Patricia J. Riddle ReLM KELM LRM 92 2 0 02 Aug 2023
Teaching Arithmetic to Small Transformers Nayoung Lee Kartik K. Sreenivasan Jason D. Lee Kangwook Lee Dimitris Papailiopoulos LRM 108 94 0 07 Jul 2023
Mass-Producing Failures of Multimodal Systems with Language Models Shengbang Tong Erik Jones Jacob Steinhardt 108 36 0 21 Jun 2023
Enhancing Documents with Multidimensional Relevance Statements in Cross-encoder Re-ranking Rishabh Upadhyay Arian Askari G. Pasi Marco Viviani 63 1 0 19 Jun 2023
Learning Multi-Step Reasoning by Solving Arithmetic Tasks Tianduo Wang Wei Lu ReLM LRM 73 16 0 02 Jun 2023
Mitigating Temporal Misalignment by Discarding Outdated Facts Michael J.Q. Zhang Eunsol Choi KELM HILM 103 20 0 24 May 2023
Can Language Models Understand Physical Concepts? Lei Li Jingjing Xu Qingxiu Dong Ce Zheng Qi Liu Lingpeng Kong Xu Sun ALM 61 22 0 23 May 2023
Human Behavioral Benchmarking: Numeric Magnitude Comparison Effects in Large Language Models Raj Sanjay Shah Vijay Marupudi Reba Koenen Khushi Bhardwaj Sashank Varma 83 6 0 18 May 2023
Generative Table Pre-training Empowers Models for Tabular Prediction Tianze Zhang Shaowen Wang Shuicheng Yan Jian Li Qian Liu LMTD 87 46 0 16 May 2023