Revisiting Model Stitching to Compare Neural Representations

14 June 2021

Papers citing "Revisiting Model Stitching to Compare Neural Representations"

30 / 80 papers shown

Title
Stitchable Neural Networks Zizheng Pan Jianfei Cai Bohan Zhuang 53 22 0 13 Feb 2023
A Toy Model of Universality: Reverse Engineering How Networks Learn Group Operations Bilal Chughtai Lawrence Chan Neel Nanda 18 96 0 06 Feb 2023
Referential communication in heterogeneous communities of pre-trained visual deep networks Matéo Mahaut Francesca Franzon Roberto Dessì Marco Baroni 25 7 0 04 Feb 2023
Model Stitching and Visualization How GAN Generators can Invert Networks in Real-Time Rudolf Herdt Maximilian Schmidt Daniel Otero Baguer Jean LeĆlerc Arrastia Peter Maass 23 2 0 04 Feb 2023
Projected Subnetworks Scale Adaptation Siddhartha Datta N. Shadbolt VLM CLL 28 0 0 27 Jan 2023
StitchNet: Composing Neural Networks from Pre-Trained Fragments Surat Teerapittayanon Marcus Z. Comiter Bradley McDanel H. T. Kung 18 1 0 05 Jan 2023
Deep Incubation: Training Large Models by Divide-and-Conquering Zanlin Ni Yulin Wang Jiangwei Yu Haojun Jiang Yu Cao Gao Huang VLM 18 11 0 08 Dec 2022
ModelDiff: A Framework for Comparing Learning Algorithms Harshay Shah Sung Min Park Andrew Ilyas A. Madry SyDa 51 26 0 22 Nov 2022
Do Neural Networks Trained with Topological Features Learn Different Internal Representations? Sarah McGuire Shane Jackson Tegan H. Emerson Henry Kvinge 14 5 0 14 Nov 2022
Much Easier Said Than Done: Falsifying the Causal Relevance of Linear Decoding Methods L. Hayne Abhijit Suresh Hunar Jain Rahul Kumar R. M. Carter FAtt 25 1 0 08 Nov 2022
Deep Model Reassembly Xingyi Yang Zhou Daquan Songhua Liu Jingwen Ye Xinchao Wang MoMe 20 120 0 24 Oct 2022
Relative representations enable zero-shot latent space communication Luca Moschella Valentino Maiorca Marco Fumero Antonio Norelli Francesco Locatello Emanuele Rodolà 19 94 0 30 Sep 2022
Linearly Mapping from Image to Text Space Jack Merullo Louis Castricato Carsten Eickhoff Ellie Pavlick VLM 164 104 0 30 Sep 2022
Analyzing Transformers in Embedding Space Guy Dar Mor Geva Ankit Gupta Jonathan Berant 19 83 0 06 Sep 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 23 124 0 27 Jul 2022
Using Anomaly Detection to Detect Poisoning Attacks in Federated Learning Applications Ali Raza Shujun Li K. Tran L. Koehl Kim Duc Tran AAML 25 3 0 18 Jul 2022
Measuring Representational Robustness of Neural Networks Through Shared Invariances Vedant Nanda Till Speicher Camila Kolling John P. Dickerson Krishna P. Gummadi Adrian Weller 11 12 0 23 Jun 2022
Identifiability of deep generative models without auxiliary information Bohdan Kivva Goutham Rajendran Pradeep Ravikumar Bryon Aragam DRL 23 48 0 20 Jun 2022
Understanding Robust Learning through the Lens of Representation Similarities Christian Cianfarani A. Bhagoji Vikash Sehwag Ben Y. Zhao Prateek Mittal Haitao Zheng OOD 21 16 0 20 Jun 2022
What do CNNs Learn in the First Layer and Why? A Linear Systems Perspective Rhea Chowers Yair Weiss 33 2 0 06 Jun 2022
On the Symmetries of Deep Learning Models and their Internal Representations Charles Godfrey Davis Brown Tegan H. Emerson Henry Kvinge 20 40 0 27 May 2022
How do Variational Autoencoders Learn? Insights from Representational Similarity Lisa Bonheme M. Grzes CoGe SSL DRL 27 10 0 17 May 2022
DeepSE-WF: Unified Security Estimation for Website Fingerprinting Defenses Alexander Veicht Cédric Renggli Diogo Barradas AAML 27 7 0 08 Mar 2022
Datamodels: Predicting Predictions from Training Data Andrew Ilyas Sung Min Park Logan Engstrom Guillaume Leclerc A. Madry TDI 38 130 0 01 Feb 2022
Similarity and Matching of Neural Network Representations Adrián Csiszárik Péter Korösi-Szabó Á. Matszangosz Gergely Papp D. Varga 11 64 0 27 Oct 2021
Pretrained Language Models are Symbolic Mathematics Solvers too! Kimia Noorbakhsh Modar Sulaiman M. Sharifi Kallol Roy Pooyan Jamshidi LRM 20 18 0 07 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 317 5,775 0 29 Apr 2021
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 58 22 0 16 Oct 2020
On the surprising similarities between supervised and self-supervised models Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Matthias Bethge Felix Wichmann Wieland Brendel OOD SSL DRL 74 46 0 16 Oct 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 237 4,469 0 23 Jan 2020