The Description Length of Deep Learning Models

20 February 2018

Papers citing "The Description Length of Deep Learning Models"

15 / 15 papers shown

Title
A Complexity-Based Theory of Compositionality Eric Elmoznino Thomas Jiralerspong Yoshua Bengio Guillaume Lajoie CoGe 56 3 0 18 Oct 2024
In-context learning and Occam's razor Eric Elmoznino Tom Marty Tejas Kasetty Léo Gagnon Sarthak Mittal Mahan Fathi Dhanya Sridhar Guillaume Lajoie 32 1 0 17 Oct 2024
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 13 0 0 20 Oct 2023
Bridging Information-Theoretic and Geometric Compression in Language Models Emily Cheng Corentin Kervadec Marco Baroni 18 16 0 20 Oct 2023
Language Modeling Is Compression Grégoire Delétang Anian Ruoss Paul-Ambroise Duquenne Elliot Catt Tim Genewein ... Wenliang Kevin Li Matthew Aitchison Laurent Orseau Marcus Hutter J. Veness AI4CE 22 128 0 19 Sep 2023
What is the best recipe for character-level encoder-only modelling? Kris Cao 25 2 0 09 May 2023
Mathematical Challenges in Deep Learning V. Nia Guojun Zhang I. Kobyzev Michael R. Metel Xinlin Li ... S. Hemati M. Asgharian Linglong Kong Wulong Liu Boxing Chen AI4CE VLM 24 1 0 24 Mar 2023
SynBench: Task-Agnostic Benchmarking of Pretrained Representations using Synthetic Data Ching-Yun Ko Pin-Yu Chen Jeet Mohapatra Payel Das Lucani E. Daniel 19 3 0 06 Oct 2022
Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey S. Sun AI4CE 23 10 0 08 Sep 2022
Minimum Description Length Control Theodore H. Moskovitz Ta-Chu Kao M. Sahani M. Botvinick 15 1 0 17 Jul 2022
Sparse Double Descent: Where Network Pruning Aggravates Overfitting Zhengqi He Zeke Xie Quanzhi Zhu Zengchang Qin 54 27 0 17 Jun 2022
Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks Tolga Birdal Aaron Lou Leonidas J. Guibas Umut cSimcsekli 16 60 0 25 Nov 2021
Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP Zhijing Jin Julius von Kügelgen Jingwei Ni Tejas Vaidhya Ayush Kaushal Mrinmaya Sachan Bernhard Schoelkopf CML 19 30 0 07 Oct 2021
Revisiting Self-Supervised Monocular Depth Estimation Ue-Hwan Kim Jong-Hwan Kim SSL MDE 20 7 0 23 Mar 2021
Information-Theoretic Probing with Minimum Description Length Elena Voita Ivan Titov 6 269 0 27 Mar 2020