Opening the Black Box of Deep Neural Networks via Information

2 March 2017

Papers citing "Opening the Black Box of Deep Neural Networks via Information"

50 / 183 papers shown

Title
Memorization-Compression Cycles Improve Generalization Fangyuan Yu 39 0 0 13 May 2025
Compression, Regularity, Randomness and Emergent Structure: Rethinking Physical Complexity in the Data-Driven Era Nima Dehghani AI4CE 32 0 0 12 May 2025
Toward Onboard AI-Enabled Solutions to Space Object Detection for Space Sustainability Wenxuan Zhang Peng Hu 37 0 0 03 May 2025
Quantifying Privacy Leakage in Split Inference via Fisher-Approximated Shannon Information Analysis Ruijun Deng Zhihui Lu Qiang Duan FedML 46 0 0 14 Apr 2025
Improving Deep Regression with Tightness Shihao Zhang Yuguang Yan Angela Yao OOD 84 0 0 13 Feb 2025
The Cake that is Intelligence and Who Gets to Bake it: An AI Analogy and its Implications for Participation Martin Mundt Anaelia Ovalle Felix Friedrich A Pranav Subarnaduti Paul Manuel Brack Kristian Kersting William Agnew 273 0 0 05 Feb 2025
An Information Criterion for Controlled Disentanglement of Multimodal Data Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 37 1 0 31 Oct 2024
CLOSER: Towards Better Representation Learning for Few-Shot Class-Incremental Learning Junghun Oh Sungyong Baik Kyoung Mu Lee CLL 34 3 0 08 Oct 2024
Layerwise Change of Knowledge in Neural Networks Xu Cheng Lei Cheng Zhaoran Peng Yang Xu Tian Han Quanshi Zhang KELM FAtt 33 6 0 13 Sep 2024
Blessing of Dimensionality for Approximating Sobolev Classes on Manifolds Hong Ye Tan Subhadip Mukherjee Junqi Tang Carola-Bibiane Schönlieb 54 0 0 13 Aug 2024
DualFed: Enjoying both Generalization and Personalization in Federated Learning via Hierachical Representations Guogang Zhu Xuefeng Liu Jianwei Niu Shaojie Tang Xinghao Wu Jiayuan Zhang AI4CE 47 1 0 25 Jul 2024
Training Foundation Models as Data Compression: On Information, Model Weights and Copyright Law Giorgio Franceschelli Claudia Cevenini Mirco Musolesi 44 0 0 18 Jul 2024
Representations as Language: An Information-Theoretic Framework for Interpretability Henry Conklin Kenny Smith MILM 36 1 0 04 Jun 2024
FTS: A Framework to Find a Faithful TimeSieve Songning Lai Ninghui Feng Haochen Sui Ze Ma Hao Wang Zichen Song Hang Zhao Yutao Yue AI4TS 37 14 0 30 May 2024
Pretraining with Random Noise for Fast and Robust Learning without Weight Transport Jeonghwan Cheon Sang Wan Lee Se-Bum Paik OOD 147 1 0 27 May 2024
Emergence of a High-Dimensional Abstraction Phase in Language Transformers Emily Cheng Diego Doimo Corentin Kervadec Iuri Macocco Jade Yu A. Laio Marco Baroni 112 11 0 24 May 2024
Understanding Multimodal Deep Neural Networks: A Concept Selection View Chenming Shang Hengyuan Zhang Hao Wen Yujiu Yang 43 5 0 13 Apr 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 35 4 0 04 Apr 2024
Tighter Bounds on the Information Bottleneck with Application to Deep Learning Nir Weingarten Z. Yakhini Moshe Butman Ran Gilad-Bachrach AAML 22 1 0 12 Feb 2024
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness Xiaoyun Xu Shujian Yu Jingzheng Wu S. Picek AAML 35 0 0 08 Dec 2023
Attribute-Aware Deep Hashing with Self-Consistency for Large-Scale Fine-Grained Image Retrieval Xiu-Shen Wei Yang Shen Xuhao Sun Peng Wang Yuxin Peng 22 10 0 21 Nov 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 57 1 0 08 Nov 2023
Elastic Information Bottleneck Yuyan Ni Yanyan Lan Ao Liu Zhiming Ma 22 2 0 07 Nov 2023
Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics Yehonatan Avidan Qianyi Li H. Sompolinsky 60 8 0 08 Sep 2023
Interpretation on Multi-modal Visual Fusion Hao Chen Hao Zhou Yongjian Deng 30 0 0 19 Aug 2023
MOLE: MOdular Learning FramEwork via Mutual Information Maximization Tianchao Li Yulong Pei 27 0 0 15 Aug 2023
Predicting and explaining nonlinear material response using deep Physically Guided Neural Networks with Internal Variables Javier Orera-Echeverria J. Ayensa-Jiménez Manuel Doblaré 22 1 0 07 Aug 2023
Universal Approximation of Linear Time-Invariant (LTI) Systems through RNNs: Power of Randomness in Reservoir Computing Shashank Jere Lizhong Zheng Karim A. Said Lingjia Liu 23 2 0 04 Aug 2023
Residual-based attention and connection to information bottleneck theory in PINNs Sokratis J. Anagnostopoulos Juan Diego Toscano Nikos Stergiopulos George Karniadakis 17 20 0 01 Jul 2023
Bi-fidelity Variational Auto-encoder for Uncertainty Quantification Nuojin Cheng Osman Asif Malik Subhayan De Stephen Becker Alireza Doostan 27 9 0 25 May 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 23 34 0 24 May 2023
Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach Masahiro Kaneko Graham Neubig Naoaki Okazaki 33 6 0 19 May 2023
TC-VAE: Uncovering Out-of-Distribution Data Generative Factors Cristian Meo Anirudh Goyal Justin Dauwels DRL CoGe CML 27 1 0 08 Apr 2023
Q-DETR: An Efficient Low-Bit Quantized Detection Transformer Sheng Xu Yanjing Li Mingbao Lin Penglei Gao Guodong Guo Jinhu Lu Baochang Zhang MQ 18 23 0 01 Apr 2023
Training Invertible Neural Networks as Autoencoders The-Gia Leo Nguyen Lynton Ardizzone Ullrich Kothe BDL DRL SSL 27 9 0 20 Mar 2023
Towards domain generalisation in ASR with elitist sampling and ensemble knowledge distillation Rehan Ahmad Md. Asif Jalal Muhammad Umar Farooq A. Ollerenshaw Thomas Hain 18 2 0 01 Mar 2023
Vision Learners Meet Web Image-Text Pairs Bingchen Zhao Quan Cui Hao Wu Osamu Yoshie Cheng Yang Oisin Mac Aodha VLM 24 5 0 17 Jan 2023
DExT: Detector Explanation Toolkit Deepan Padmanabhan Paul G. Plöger Octavio Arriaga Matias Valdenegro-Toro 30 2 0 21 Dec 2022
Learning useful representations for shifting tasks and distributions Jianyu Zhang Léon Bottou OOD 34 13 0 14 Dec 2022
Chroma-VAE: Mitigating Shortcut Learning with Generative Classifiers Wanqian Yang Polina Kirichenko Micah Goldblum A. Wilson DRL 24 10 0 28 Nov 2022
Internal Representations of Vision Models Through the Lens of Frames on Data Manifolds Henry Kvinge Grayson Jorgenson Davis Brown Charles Godfrey Tegan H. Emerson 52 2 0 19 Nov 2022
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning S. Takagi OffRL 18 7 0 17 Nov 2022
Masked Reconstruction Contrastive Learning with Information Bottleneck Principle Ziwen Liu Bonan Li Congying Han Tiande Guo Xuecheng Nie SSL 34 2 0 15 Nov 2022
Emergence of Concepts in DNNs? Tim Räz 19 0 0 11 Nov 2022
Dynamical systems' based neural networks E. Celledoni Davide Murari B. Owren Carola-Bibiane Schönlieb Ferdia Sherry OOD 40 10 0 05 Oct 2022
Learning Temporal Resolution in Spectrogram for Audio Classification Haohe Liu Xubo Liu Qiuqiang Kong Wenwu Wang Mark D. Plumbley 34 7 0 04 Oct 2022
Rethinking skip connection model as a learnable Markov chain Dengsheng Chen Jie Hu Wenwen Qiang Xiaoming Wei Enhua Wu BDL 19 1 0 30 Sep 2022
Label driven Knowledge Distillation for Federated Learning with non-IID Data Minh-Duong Nguyen Viet Quoc Pham D. Hoang Long Tran-Thanh Diep N. Nguyen W. Hwang 16 2 0 29 Sep 2022
Magnitude and Angle Dynamics in Training Single ReLU Neurons Sangmin Lee Byeongsu Sim Jong Chul Ye MLT 94 6 0 27 Sep 2022
Adaptation of Autoencoder for Sparsity Reduction From Clinical Notes Representation Learning Thanh-Dung Le R. Noumeir J. Rambaud Guillaume Sans P. Jouvet 30 7 0 26 Sep 2022