Word Embedding Visualization Via Dictionary Learning

v1v2 (latest)

Word Embedding Visualization Via Dictionary Learning

9 October 2019

Juexiao Zhang

Bruno A. Olshausen

ArXiv (abs)PDF HTML

Papers citing "Word Embedding Visualization Via Dictionary Learning"

12 / 12 papers shown

Title
Dense SAE Latents Are Features, Not Bugs Xiaoqing Sun Alessandro Stolfo Joshua Engels Ben Wu Senthooran Rajamanoharan Mrinmaya Sachan Max Tegmark 65 0 0 18 Jun 2025
On the Geometry of Semantics in Next-token Prediction Yize Zhao Christos Thrampoulidis 62 0 0 13 May 2025
Mind the Gap: Bridging the Divide Between AI Aspirations and the Reality of Autonomous Characterization Grace Guinan Addison Salvador Michelle A. Smeaton Andrew Glaws Hilary Egan Brian C. Wyatt Babak Anasori K. Fiedler M. Olszta Steven Spurgeon 133 0 0 25 Feb 2025
Sparse Autoencoders for Scientifically Rigorous Interpretation of Vision Models Samuel Stevens Wei-Lun Chao T. Berger-Wolf Yu-Chuan Su VLM 150 6 0 10 Feb 2025
The Complexity of Learning Sparse Superposed Features with Feedback Akash Kumar 482 0 0 08 Feb 2025
The Geometry of Concepts: Sparse Autoencoder Feature Structure Yuxiao Li Eric J. Michaud David D. Baek Joshua Engels Xiaoqing Sun Max Tegmark 114 21 0 10 Oct 2024
Automatically Identifying Local and Global Circuits with Linear Computation Graphs Xuyang Ge Fukang Zhu Wentao Shu Junxuan Wang Zhengfu He Xipeng Qiu 105 10 0 22 May 2024
Dictionary Learning Improves Patch-Free Circuit Discovery in Mechanistic Interpretability: A Case Study on Othello-GPT Zhengfu He Xuyang Ge Qiong Tang Tianxiang Sun Qinyuan Cheng Xipeng Qiu 96 22 0 19 Feb 2024
Minimalistic Unsupervised Learning with the Sparse Manifold Transform Yubei Chen Zeyu Yun Yi Ma Bruno A. Olshausen Yann LeCun 117 8 0 30 Sep 2022
Transformer visualization via dictionary learning: contextualized embedding as a linear superposition of transformer factors Zeyu Yun Yubei Chen Bruno A. Olshausen Yann LeCun 65 78 0 29 Mar 2021
RG-Flow: A hierarchical and explainable flow model based on renormalization group and sparse prior Hong-Ye Hu Dian Wu Yi-Zhuang You Bruno A. Olshausen Yubei Chen BDL DRL 89 16 0 30 Sep 2020
Word Equations: Inherently Interpretable Sparse Word Embeddingsthrough Sparse Coding Adly Templeton 36 7 0 08 Apr 2020