v1v2v3v4v5v6v7 (latest)

Towards Understanding Linear Word Analogies

11 October 2018

Papers citing "Towards Understanding Linear Word Analogies"

36 / 36 papers shown

Title
How do Transformer Embeddings Represent Compositions? A Functional Analysis Aishik Nagar Ishaan Singh Rawal Mansi Dhanania Cheston Tan CoGe 71 0 0 01 Jun 2025
Eta-WavLM: Efficient Speaker Identity Removal in Self-Supervised Speech Representations Using a Simple Linear Equation Giuseppe Ruggiero Matteo Testa Jurgen Van de Walle Luigi Di Caro 111 1 0 25 May 2025
On the Emergence of Linear Analogies in Word Embeddings Daniel J. Korchinski Dhruva Karkada Yasaman Bahri Matthieu Wyart 56 0 0 24 May 2025
On the Geometry of Semantics in Next-token Prediction Yize Zhao Christos Thrampoulidis 62 0 0 13 May 2025
Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations Yize Zhao Tina Behnia V. Vakilian Christos Thrampoulidis 195 10 0 20 Feb 2025
The Geometry of Categorical and Hierarchical Concepts in Large Language Models Kiho Park Yo Joong Choe Yibo Jiang Victor Veitch 133 41 0 03 Jun 2024
Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNets Arthur Jacot Alexandre Kaiser 74 1 0 27 May 2024
Uncovering Meanings of Embeddings via Partial Orthogonality Yibo Jiang Bryon Aragam Victor Veitch 89 15 0 26 Oct 2023
Contrastive Loss is All You Need to Recover Analogies as Parallel Lines Narutatsu Ri Fei-Tzin Lee Nakul Verma 53 3 0 14 Jun 2023
Simulating News Recommendation Ecosystem for Fun and Profit Guangping Zhang Dongsheng Li Hansu Gu Tun Lu Li Shang Ning Gu 42 0 0 23 May 2023
Solving Cosine Similarity Underestimation between High Frequency Words by L2 Norm Discounting Saeth Wannasuphoprasit Yi Zhou Danushka Bollegala 75 4 0 17 May 2023
Learning a Formality-Aware Japanese Sentence Representation Lin Zhang Ray Lee Jerry Chen Kelly Marchisio CVBM AI4TS 47 0 0 17 Jan 2023
Multimodal Analogical Reasoning over Knowledge Graphs Ningyu Zhang Lei Li Xiang Chen Xiaozhuan Liang Shumin Deng Huajun Chen 141 28 0 01 Oct 2022
Assessing the Limits of the Distributional Hypothesis in Semantic Spaces: Trait-based Relational Knowledge and the Impact of Co-occurrences Mark Anderson Jose Camacho-Collados 71 0 0 16 May 2022
Richer Countries and Richer Representations Kaitlyn Zhou Kawin Ethayarajh Dan Jurafsky 80 9 0 10 May 2022
Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words Kaitlyn Zhou Kawin Ethayarajh Dallas Card Dan Jurafsky 94 69 0 10 May 2022
Large-scale Bilingual Language-Image Contrastive Learning ByungSoo Ko Geonmo Gu VLM 112 14 0 28 Mar 2022
E-KAR: A Benchmark for Rationalizing Natural Language Analogical Reasoning Jiangjie Chen Rui Xu Ziquan Fu Wei Shi Zhongqiao Li Xinbo Zhang Changzhi Sun Lei Li Yanghua Xiao Hao Zhou ELM 78 35 0 16 Mar 2022
Residual2Vec: Debiasing graph embedding with random graphs Sadamori Kojaku Jisung Yoon I. Constantino Yong-Yeol Ahn CML 81 23 0 14 Oct 2021
Theoretical foundations and limits of word embeddings: what types of meaning can they capture? Alina Arseniev-Koehler 70 21 0 22 Jul 2021
Revisiting Additive Compositionality: AND, OR and NOT Operations with Word Embeddings Masahiro Naito Sho Yokoi Geewook Kim Hidetoshi Shimodaira CoGe 88 4 0 18 May 2021
The Rediscovery Hypothesis: Language Models Need to Meet Linguistics Vassilina Nikoulina Maxat Tezekbayev Nuradil Kozhakhmet Madina Babazhanova Matthias Gallé Z. Assylbekov 69 8 0 02 Mar 2021
Paraphrases do not explain word analogies Louis Fournier Ewan Dunbar OOD 42 4 0 23 Feb 2021
On the Sentence Embeddings from Pre-trained Language Models Bohan Li Hao Zhou Junxian He Mingxuan Wang Yiming Yang Lei Li 85 222 0 02 Nov 2020
Robustness and Reliability of Gender Bias Assessment in Word Embeddings: The Role of Base Pairs Haiyang Zhang Alison Sneyd Mark Stevenson 41 15 0 06 Oct 2020
Utility is in the Eye of the User: A Critique of NLP Leaderboards Kawin Ethayarajh Dan Jurafsky ELM 103 52 0 29 Sep 2020
Semantic Relations and Deep Learning Vivi Nastase Stan Szpakowicz GNN 54 0 0 11 Sep 2020
SketchEmbedNet: Learning Novel Concepts by Imitating Drawings Alexander Wang Mengye Ren R. Zemel SSL 60 22 0 27 Aug 2020
BLEU Neighbors: A Reference-less Approach to Automatic Evaluation Kawin Ethayarajh Dorsa Sadigh 32 4 0 27 Apr 2020
Squashed Shifted PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces Z. Assylbekov Alibi Jangeldin 40 0 0 27 Feb 2020
SBERT-WK: A Sentence Embedding Method by Dissecting BERT-based Word Models Bin Wang C.-C. Jay Kuo 52 156 0 16 Feb 2020
Humpty Dumpty: Controlling Word Meanings via Corpus Poisoning R. Schuster Tal Schuster Yoav Meri Vitaly Shmatikov AAML 70 39 0 14 Jan 2020
Word Embedding Visualization Via Dictionary Learning Juexiao Zhang Yubei Chen Brian Cheung Bruno A. Olshausen 80 17 0 09 Oct 2019
Rotate King to get Queen: Word Relationships as Orthogonal Transformations in Embedding Space Kawin Ethayarajh LLMSV 66 13 0 02 Sep 2019
Understanding Undesirable Word Embedding Associations Kawin Ethayarajh David Duvenaud Graeme Hirst FaML 71 125 0 18 Aug 2019
Analogies Explained: Towards Understanding Word Embeddings Carl Allen Timothy M. Hospedales 104 144 0 28 Jan 2019