Exploring Causes of Representational Similarity in Machine Learning Models

20 May 2025

Papers citing "Exploring Causes of Representational Similarity in Machine Learning Models"

36 / 36 papers shown

Title
We're Different, We're the Same: Creative Homogeneity Across LLMs Emily Wenger Yoed Kenett 105 8 0 31 Jan 2025
Objective drives the consistency of representational similarity across datasets Laure Ciernik Lorenz Linhardt Marco Morik Jonas Dippel Simon Kornblith Lukas Muttenthaler 38 5 0 08 Nov 2024
Jamba-1.5: Hybrid Transformer-Mamba Models at Scale Jamba Team Barak Lenz Alan Arazi Amir Bergman Avshalom Manevich ... Yehoshua Cohen Yonatan Belinkov Y. Globerson Yuval Peleg Levy Y. Shoham 57 32 0 22 Aug 2024
The Platonic Representation Hypothesis Minyoung Huh Brian Cheung Tongzhou Wang Phillip Isola 88 123 0 13 May 2024
AI and the Problem of Knowledge Collapse Andrew J. Peterson 57 20 0 04 Apr 2024
Neural Redshift: Random Networks are not Random Functions Damien Teney A. Nicolicioiu Valentin Hartmann Ehsan Abbasnejad 117 22 0 04 Mar 2024
Universal Neurons in GPT2 Language Models Wes Gurnee Theo Horsley Zifan Carl Guo Tara Rezaei Kheirkhah Qinyi Sun Will Hathaway Neel Nanda Dimitris Bertsimas MILM 121 43 0 22 Jan 2024
Towards Measuring Representational Similarity of Large Language Models Max Klabunde Mehdi Ben Amor Michael Granitzer Florian Lemmerich 44 2 0 05 Dec 2023
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model Karsten Roth Lukas Thede Almut Sophia Koepke Oriol Vinyals Olivier J. Hénaff Zeynep Akata AAML 52 12 0 26 Oct 2023
Getting aligned on representational alignment Ilia Sucholutsky Lukas Muttenthaler Adrian Weller Andi Peng Andreea Bobu ... Thomas Unterthiner Andrew Kyle Lampinen Klaus-Robert Muller M. Toneva Thomas Griffiths 82 82 0 18 Oct 2023
A Comprehensive Overview of Large Language Models Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Ajmal Mian OffRL 83 564 0 12 Jul 2023
Large Language Models Michael R Douglas LLMAG LM&MA 80 598 0 11 Jul 2023
Rosetta Neurons: Mining the Common Units in a Model Zoo Amil Dravid Yossi Gandelsman Alexei A. Efros Assaf Shocher 42 27 0 15 Jun 2023
Similarity of Neural Network Models: A Survey of Functional and Representational Measures Max Klabunde Tobias Schumacher M. Strohmaier Florian Lemmerich 95 67 0 10 May 2023
LLaMA: Open and Efficient Foundation Language Models Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux ... Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave Guillaume Lample ALM PILM 644 12,840 0 27 Feb 2023
Relative representations enable zero-shot latent space communication Luca Moschella Valentino Maiorca Marco Fumero Antonio Norelli Francesco Locatello Emanuele Rodolà 57 101 0 30 Sep 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 45 128 0 27 Jul 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 314 6,132 0 05 Apr 2022
Divergent representations of ethological visual inputs emerge from supervised, unsupervised, and reinforcement learning Grace W. Lindsay J. Merel T. Mrsic-Flogel M. Sahani SSL DRL 52 6 0 03 Dec 2021
Revisiting Model Stitching to Compare Neural Representations Yamini Bansal Preetum Nakkiran Boaz Barak FedML 62 110 0 14 Jun 2021
Towards Understanding Knowledge Distillation Mary Phuong Christoph H. Lampert 52 314 0 27 May 2021
Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depth Thao Nguyen M. Raghu Simon Kornblith OOD 29 271 0 29 Oct 2020
On Linear Identifiability of Learned Representations Geoffrey Roeder Luke Metz Diederik P. Kingma CML 32 78 0 01 Jul 2020
Beyond accuracy: quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency Robert Geirhos Kristof Meding Felix Wichmann 39 118 0 30 Jun 2020
What shapes feature representations? Exploring datasets, architectures, and training Katherine L. Hermann Andrew Kyle Lampinen OOD 49 156 0 22 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 461 41,106 0 28 May 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 440 4,662 0 23 Jan 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 218 42,038 0 03 Dec 2019
On the Efficacy of Knowledge Distillation Ligang He Rui Mao 74 603 0 03 Oct 2019
An Introduction to Variational Autoencoders Diederik P. Kingma Max Welling BDL SSL DRL 63 2,322 0 06 Jun 2019
Let's Agree to Agree: Neural Networks Share Classification Order on Real Datasets Guy Hacohen Leshem Choshen D. Weinshall AI4TS OOD 37 56 0 26 May 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 122 1,382 0 01 May 2019
Insights on representational similarity in neural networks with canonical correlation Ari S. Morcos M. Raghu Samy Bengio DRL 42 440 0 14 Jun 2018
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 152 2,783 0 26 Sep 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.3K 192,638 0 10 Dec 2015
Convergent Learning: Do different neural networks learn the same representations? Yixuan Li J. Yosinski Jeff Clune Hod Lipson John E. Hopcroft SSL 74 358 0 24 Nov 2015