Linear Algebraic Structure of Word Senses, with Applications to Polysemy

14 January 2016

Andrej Risteski

Papers citing "Linear Algebraic Structure of Word Senses, with Applications to Polysemy"

48 / 48 papers shown

Title
Superposition Yields Robust Neural Scaling Yizhou Liu Ziming Liu Jeff Gore MILM 29 0 0 15 May 2025
Are Sparse Autoencoders Useful for Java Function Bug Detection? Rui Melo Claudia Mamede Andre Catarino Rui Abreu Henrique Lopes Cardoso 31 0 0 15 May 2025
Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition Zhengfu He Rongxiang Weng Rui Lin Xuyang Ge Wentao Shu Qiong Tang Jiaming Zhang Xipeng Qiu 70 0 0 29 Apr 2025
I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data? Yuhang Liu Dong Gong Erdun Gao Zhen Zhang Zhen Zhang Biwei Huang Anton van den Hengel Javen Qinfeng Shi Javen Qinfeng Shi 229 0 0 12 Mar 2025
Semantic Wave Functions: Exploring Meaning in Large Language Models Through Quantum Formalism Timo Aukusti Laine 44 1 0 09 Mar 2025
Superscopes: Amplifying Internal Feature Representations for Language Model Interpretation Jonathan Jacobi Gal Niv LRM ReLM 65 0 0 03 Mar 2025
The Representation and Recall of Interwoven Structured Knowledge in LLMs: A Geometric and Layered Analysis Ge Lei Samuel J. Cooper KELM 51 0 0 15 Feb 2025
The Complexity of Learning Sparse Superposed Features with Feedback Akash Kumar 241 0 0 08 Feb 2025
Out-of-distribution generalization via composition: a lens through induction heads in Transformers Jiajun Song Zhuoyan Xu Yiqiao Zhong 88 5 0 31 Dec 2024
Mechanistic Permutability: Match Features Across Layers Nikita Balagansky Ian Maksimov Daniil Gavrilov 29 4 0 10 Oct 2024
CodeUnlearn: Amortized Zero-Shot Machine Unlearning in Language Models Using Discrete Concept YuXuan Wu Bonaventure F. P. Dossou Dianbo Liu MU 26 0 0 08 Oct 2024
On the Complexity of Neural Computation in Superposition Micah Adler Nir Shavit 123 3 0 05 Sep 2024
The Geometry of Categorical and Hierarchical Concepts in Large Language Models Kiho Park Yo Joong Choe Yibo Jiang Victor Veitch 52 28 0 03 Jun 2024
Contrastive Learning on Multimodal Analysis of Electronic Health Records Tianxi Cai Feiqing Huang Ryumei Nakada Linjun Zhang Doudou Zhou 61 0 0 22 Mar 2024
Interpreting CLIP with Sparse Linear Concept Embeddings (SpLiCE) Usha Bhalla Alexander X. Oesterling Suraj Srinivas Flavio du Pin Calmon Himabindu Lakkaraju 49 36 0 16 Feb 2024
Codebook Features: Sparse and Discrete Interpretability for Neural Networks Alex Tamkin Mohammad Taufeeque Noah D. Goodman 35 27 0 26 Oct 2023
Interpretable Neural Embeddings with Sparse Self-Representation Minxue Xia Hao Zhu MILM 6 0 0 25 Jun 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 26 35 0 24 May 2023
Discovering Universal Geometry in Embeddings with ICA Hiroaki Yamagiwa Momose Oyama Hidetoshi Shimodaira 31 15 0 22 May 2023
Shades of meaning: Uncovering the geometry of ambiguous word representations through contextualised language models Benedetta Cevoli C. Watkins Yang Gao K. Rastle 29 3 0 26 Apr 2023
Word Sense Induction with Knowledge Distillation from BERT Anik Saha Alex Gittens B. Yener 20 1 0 20 Apr 2023
Dialectograms: Machine Learning Differences between Discursive Communities Thyge R Enggaard August Lohse M. Pedersen Sune Lehmann 13 2 0 11 Feb 2023
Tsetlin Machine Embedding: Representing Words Using Logical Expressions Bimal Bhattarai Ole-Christoffer Granmo Lei Jiao Rohan Kumar Yadav Jivitesh Sharma NAI 14 12 0 02 Jan 2023
Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition Jennifer C. White Ryan Cotterell DiffM 38 5 0 23 Nov 2022
Interpreting Embedding Spaces by Conceptualization Adi Simhi Shaul Markovitch 24 5 0 22 Aug 2022
To Know by the Company Words Keep and What Else Lies in the Vicinity Jake Williams H. Heidenreich 24 0 0 30 Apr 2022
From Pivots to Graphs: Augmented CycleDensity as a Generalization to One Time InverseConsultation Shashwat Goel K. Grover 30 2 0 27 Aug 2021
Theoretical foundations and limits of word embeddings: what types of meaning can they capture? Alina Arseniev-Koehler 36 19 0 22 Jul 2021
Integrating topic modeling and word embedding to characterize violent deaths Alina Arseniev-Koehler S. Cochran V. Mays Kai-Wei Chang J. Foster 27 31 0 28 Jun 2021
Improving Entity Linking through Semantic Reinforced Entity Embeddings Feng Hou Ruili Wang Jun He Yi Zhou AI4TS 20 39 0 16 Jun 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 32 131 0 31 May 2021
SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts Arie Cattan Sophie Johnson Daniel S. Weld Ido Dagan Iz Beltagy Doug Downey Tom Hope 28 23 0 18 Apr 2021
Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval Kyoung-Rok Jang Junmo Kang Giwon Hong Sung-Hyon Myaeng Joohee Park Taewon Yoon Heecheol Seo 39 20 0 15 Apr 2021
Low-skilled Occupations Face the Highest Upskilling Pressure Di Tong Lingfei Wu James Allen Evans 32 1 0 27 Jan 2021
Cultural Cartography with Word Embeddings Dustin S. Stoltz Marshall A. Taylor 23 38 0 09 Jul 2020
Feature Purification: How Adversarial Training Performs Robust Deep Learning Zeyuan Allen-Zhu Yuanzhi Li MLT AAML 39 147 0 20 May 2020
Machine learning as a model for cultural learning: Teaching an algorithm what it means to be fat Alina Arseniev-Koehler J. Foster 43 46 0 24 Mar 2020
What do you mean, BERT? Assessing BERT as a Distributional Semantics Model Timothee Mickus Denis Paperno Mathieu Constant Kees van Deemter 29 45 0 13 Nov 2019
Multi-sense Definition Modeling using Word Sense Decompositions Ruimin Zhu Thanapon Noraset Alisa Liu Wenxin Jiang Doug Downey 22 9 0 19 Sep 2019
SECNLP: A Survey of Embeddings in Clinical Natural Language Processing Katikapalli Subramanyam Kalyan S. Sangeetha 17 81 0 04 Mar 2019
Learning Gender-Neutral Word Embeddings Jieyu Zhao Yichao Zhou Zeyu Li Wei Wang Kai-Wei Chang FaML 17 407 0 29 Aug 2018
Imparting Interpretability to Word Embeddings while Preserving Semantic Structure Lutfi Kerem Senel Ihsan Utlu Furkan Şahinuç H. Ozaktas Aykut Kocc 32 14 0 19 Jul 2018
N-Gram Graph: Simple Unsupervised Representation for Graphs, with Applications to Molecules Shengchao Liu M. F. Demirel Yingyu Liang GNN NAI 13 192 0 24 Jun 2018
A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors M. Khodak Nikunj Saunshi Yingyu Liang Tengyu Ma Brandon M Stewart Sanjeev Arora 42 99 0 14 May 2018
AspEm: Embedding Learning by Aspects in Heterogeneous Information Networks Yu Shi Huan Gui Qi Zhu Lance M. Kaplan Jiawei Han 39 83 0 05 Mar 2018
Ontology-Aware Token Embeddings for Prepositional Phrase Attachment Pradeep Dasigi Bridger Waleed Ammar Chris Dyer Eduard H. Hovy 24 30 0 08 May 2017
Geometry of Polysemy Jiaqi Mu S. Bhat Pramod Viswanath 25 21 0 24 Oct 2016
From Frequency to Meaning: Vector Space Models of Semantics Peter D. Turney Patrick Pantel 110 2,982 0 04 Mar 2010