Discovering Universal Geometry in Embeddings with ICA

22 May 2023

Papers citing "Discovering Universal Geometry in Embeddings with ICA"

15 / 15 papers shown

Title
Discrete Speech Unit Extraction via Independent Component Analysis Tomohiko Nakamura Kwanghee Choi Keigo Hojo Yoshiaki Bando Satoru Fukayama Shinji Watanabe 43 0 0 11 Jan 2025
Understanding Higher-Order Correlations Among Semantic Components in Embeddings Momose Oyama Hiroaki Yamagiwa Hidetoshi Shimodaira CML 22 0 0 30 Sep 2024
Transforming Hidden States into Binary Semantic Features Tomáš Musil David Marecek OffRL 23 0 0 29 Sep 2024
Norm of Mean Contextualized Embeddings Determines their Variance Hiroaki Yamagiwa Hidetoshi Shimodaira 25 0 0 17 Sep 2024
Fine-grained length controllable video captioning with ordinal embeddings Tomoya Nitta Takumi Fukuzawa Toru Tamaki 40 0 0 27 Aug 2024
Investigating the Contextualised Word Embedding Dimensions Responsible for Contextual and Temporal Semantic Changes Taichi Aida Danushka Bollegala 19 0 0 03 Jul 2024
Exploring Intra and Inter-language Consistency in Embeddings with ICA Rongzhi Li Takeru Matsuda Hitomi Yanaka 35 1 0 18 Jun 2024
Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings Hiroaki Yamagiwa Momose Oyama Hidetoshi Shimodaira LLMSV 38 2 0 16 Jun 2024
DefSent+: Improving sentence embeddings of language models by projecting definition sentences into a quasi-isotropic or isotropic vector space of unlimited dictionary entries Xiaodong Liu 32 0 0 25 May 2024
A Semantic Distance Metric Learning approach for Lexical Semantic Change Detection Taichi Aida Danushka Bollegala 19 3 0 01 Mar 2024
Axis Tour: Word Tour Determines the Order of Axes in ICA-transformed Embeddings Hiroaki Yamagiwa Yusuke Takase Hidetoshi Shimodaira 16 2 0 11 Jan 2024
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality William Timkey Marten van Schijndel 213 110 0 09 Sep 2021
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 167 1,635 0 11 Oct 2017
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 282 39,190 0 01 Sep 2014
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 228 31,244 0 16 Jan 2013