Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2002.10689
Cited By
A Theory of Usable Information Under Computational Constraints
International Conference on Learning Representations (ICLR), 2020
25 February 2020
Yilun Xu
Shengjia Zhao
Jiaming Song
Russell Stewart
Stefano Ermon
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"A Theory of Usable Information Under Computational Constraints"
50 / 115 papers shown
Distilling Specialized Orders for Visual Generation
Rishav Pramanik
Antoine Poupon
Juan A. Rodriguez
Masih Aminbeidokhti
David Vazquez
Christopher Pal
Zhaozheng Yin
M. Pedersoli
Marco Pedersoli
VGen
VLM
327
1
0
10 Apr 2026
Detecting AI Hallucinations in Finance: An Information-Theoretic Method Cuts Hallucination Rate by 92%
Mainak Singha
HILM
326
0
0
02 Dec 2025
Fair Representation Learning with Controllable High Confidence Guarantees via Adversarial Inference
Yuhong Luo
Austin Hoag
Xintong Wang
Philip S Thomas
Przemyslaw A. Grabowicz
FaML
322
0
0
23 Oct 2025
Skip-It? Theoretical Conditions for Layer Skipping in Vision-Language Models
Max Hartman
Vidhata Arjun Jayaraman
Moulik Choraria
Akhil Bhimaraju
Lav Varshney
VLM
414
0
0
29 Sep 2025
On the Separability of Information in Diffusion Models
Akhil Premkumar
DiffM
380
0
0
28 Sep 2025
Data coarse graining can improve model performance
Alex Nguyen
D. Schwab
Vudtiwat Ngampruetikorn
130
0
0
18 Sep 2025
Reinforced Context Order Recovery for Adaptive Reasoning and Planning
Long Ma
Fangwei Zhong
Yizhou Wang
LRM
140
3
0
18 Aug 2025
Can LLMs Generate High-Quality Task-Specific Conversations?
Shengqi Li
Amarnath Gupta
LM&MA
199
0
0
04 Aug 2025
Categorical Distributions are Effective Neural Network Outputs for Event Prediction
Kevin Doran
Tom Baden
UQCV
195
0
0
29 Jul 2025
Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulation
François Rozet
Ruben Ohana
Michael McCabe
Gilles Louppe
F. Lanusse
S. Ho
DiffM
389
10
0
03 Jul 2025
Aligning Multimodal Representations through an Information Bottleneck
Antonio Almudévar
José Miguel Hernández-Lobato
Sameer Khurana
R. Marxer
Alfonso Ortega
SSL
380
8
0
05 Jun 2025
How much do language models memorize?
John X. Morris
Chawin Sitawarin
Chuan Guo
Narine Kokhlikyan
G. E. Suh
Alexander M. Rush
Kamalika Chaudhuri
Saeed Mahloujifar
KELM
ELM
469
37
0
30 May 2025
Laplace Sample Information: Data Informativeness Through a Bayesian Lens
International Conference on Learning Representations (ICLR), 2025
Johannes Kaiser
Kristian Schwethelm
Daniel Rueckert
Georgios Kaissis
263
1
0
21 May 2025
Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii
Kola Ayonrinde
Louis Jaburi
XAI
384
3
0
02 May 2025
On the generalization of language models from in-context learning and finetuning: a controlled study
Andrew Kyle Lampinen
Arslan Chaudhry
Stephanie Chan
Cody Wild
Diane Wan
Alex Ku
Jorg Bornschein
Razvan Pascanu
Murray Shanahan
James L. McClelland
754
39
0
01 May 2025
Exploiting Contextual Knowledge in LLMs through V-usable Information based Layer Enhancement
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Xiaowei Yuan
Zhao Yang
Ziyang Huang
Yucheng Wang
Siqi Fan
Yiming Ju
Jun Zhao
Kang Liu
239
3
0
22 Apr 2025
Geometric Median Matching for Robust k-Subset Selection from Noisy Data
Anish Acharya
Sujay Sanghavi
Alexandros G. Dimakis
Inderjit S Dhillon
AAML
536
0
0
01 Apr 2025
Fundamental Limits of Perfect Concept Erasure
International Conference on Artificial Intelligence and Statistics (AISTATS), 2025
Somnath Basu Roy Chowdhury
Avinava Dubey
Ahmad Beirami
Rahul Kidambi
Nicholas Monath
Amr Ahmed
Snigdha Chaturvedi
318
3
0
25 Mar 2025
Statistical Deficiency for Task Inclusion Estimation
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Loïc Fosse
Frédéric Béchet
Benoit Favre
Géraldine Damnati
Gwénolé Lecorvé
Maxime Darrin
Philippe Formont
Pablo Piantanida
1.3K
1
0
07 Mar 2025
Geometric Median (GM) Matching for Robust Data Pruning
Anish Acharya
Inderjit S Dhillon
Sujay Sanghavi
AAML
397
3
0
20 Jan 2025
One-shot Federated Learning via Synthetic Distiller-Distillate Communication
Neural Information Processing Systems (NeurIPS), 2024
Junyuan Zhang
Songhua Liu
Xinchao Wang
DD
FedML
305
11
0
06 Dec 2024
Understanding the Role of Equivariance in Self-supervised Learning
Neural Information Processing Systems (NeurIPS), 2024
Yifei Wang
Kaiwen Hu
Sharut Gupta
Ziyu Ye
Yisen Wang
Stefanie Jegelka
SSL
442
7
0
10 Nov 2024
Identifying Task Groupings for Multi-Task Learning Using Pointwise V-Usable Information
Journal of Biomedical Informatics (JBI), 2024
Yingya Li
Timothy A. Miller
Steven Bethard
G. Savova
350
5
0
16 Oct 2024
A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets
Neural Information Processing Systems (NeurIPS), 2024
Kyungeun Lee
Wonjong Rhee
290
11
0
14 Oct 2024
Label-Augmented Dataset Distillation
IEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024
Seoungyoon Kang
Youngsun Lim
Hyunjung Shim
DD
335
3
0
24 Sep 2024
Disentanglement with Factor Quantized Variational Autoencoders
Gulcin Baykal
M. Kandemir
Gözde B. Ünal
CoGe
DRL
389
2
0
23 Sep 2024
Understanding Visual Feature Reliance through the Lens of Complexity
Thomas Fel
Louis Bethune
Andrew Kyle Lampinen
Thomas Serre
Katherine Hermann
FAtt
CoGe
333
18
0
08 Jul 2024
Free-text Rationale Generation under Readability Level Control
Yi-Sheng Hsu
Nils Feldhus
Sherzod Hakimov
562
5
0
01 Jul 2024
Establishing Deep InfoMax as an effective self-supervised learning methodology in materials informatics
Michael Moran
Vladimir V. Gusev
M. Gaultois
Dmytro Antypov
M. Rosseinsky
AI4CE
255
1
0
30 Jun 2024
On Subjective Uncertainty Quantification and Calibration in Natural Language Generation
International Conference on Artificial Intelligence and Statistics (AISTATS), 2024
Ziyu Wang
Chris Holmes
UQLM
534
12
0
07 Jun 2024
Sexism Detection on a Data Diet
Web Science Conference (WebSci), 2024
Rabiraj Bandyopadhyay
Dennis Assenmacher
J. Alonso-Moral
Claudia Wagner
278
2
0
07 Jun 2024
GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost
International Conference on Learning Representations (ICLR), 2024
Xinyi Shang
Peng Sun
Tao Lin
452
10
0
23 May 2024
DispaRisk: Auditing Fairness Through Usable Information
Jonathan Vasquez
Carlotta Domeniconi
Huzefa Rangwala
377
0
0
20 May 2024
Dealing Doubt: Unveiling Threat Models in Gradient Inversion Attacks under Federated Learning, A Survey and Taxonomy
Yichuan Shi
Olivera Kotevska
Viktor Reshniak
Abhishek Singh
Ramesh Raskar
AAML
227
5
0
16 May 2024
Towards Task-Compatible Compressible Representations
Anderson de Andrade
Ivan V. Bajić
237
3
0
16 May 2024
Cauchy-Schwarz Divergence Information Bottleneck for Regression
Shujian Yu
Xi Yu
Sigurd Løkse
Robert Jenssen
José C. Príncipe
UQCV
327
13
0
27 Apr 2024
Modeling Low-Resource Health Coaching Dialogues via Neuro-Symbolic Goal Summarization and Text-Units-Text Generation
Yue Zhou
Barbara Di Eugenio
Brian Ziebart
Lisa Sharp
Bing Liu
Nikolaos Agadakos
285
5
0
16 Apr 2024
When Do We Not Need Larger Vision Models?
Baifeng Shi
Ziyang Wu
Maolin Mao
Xin Wang
Trevor Darrell
VLM
LRM
541
80
0
19 Mar 2024
RORA: Robust Free-Text Rationale Evaluation
Zhengping Jiang
Yining Lu
Hanjie Chen
Daniel Khashabi
Benjamin Van Durme
Anqi Liu
315
7
0
28 Feb 2024
On the Challenges and Opportunities in Generative AI
Laura Manduchi
Kushagra Pandey
Kushagra Pandey
Robert Bamler
Sina Daubener
...
Yixin Wang
F. Wenzel
Frank Wood
Stephan Mandt
Vincent Fortuin
959
41
0
28 Feb 2024
Privacy-Preserving Map-Free Exploration for Confirming the Absence of a Radioactive Source
Eric Lepowsky
David Snyder
Alexander Glaser
Anirudha Majumdar
244
0
0
27 Feb 2024
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study
Tianjie Ju
Weiwei Sun
Wei Du
Xinwei Yuan
Zhaochun Ren
Gongshen Liu
KELM
290
66
0
25 Feb 2024
PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers
Weizhe Lin
Jingbiao Mei
Jinghong Chen
Bill Byrne
VLM
AI4Ed
391
52
0
13 Feb 2024
NetInfoF Framework: Measuring and Exploiting Network Usable Information
Meng-Chieh Lee
Haiyang Yu
Jian Zhang
V. Ioannidis
Xiang Song
Soji Adeshina
Da Zheng
Christos Faloutsos
473
2
0
12 Feb 2024
Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
Shanshan Xu
Santosh T.Y.S.S
O. Ichim
Barbara Plank
Matthias Grabmair
406
8
0
11 Feb 2024
Arrows of Time for Large Language Models
Vassilis Papadopoulos
Jérémie Wenger
Clément Hongler
330
16
0
30 Jan 2024
TVE: Learning Meta-attribution for Transferable Vision Explainer
Guanchu Wang
Yu-Neng Chuang
Fan Yang
Mengnan Du
Chia-Yuan Chang
...
Zirui Liu
Zhaozhuo Xu
Kaixiong Zhou
Xuanting Cai
Helen Zhou
356
2
0
23 Dec 2023
Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language
Jan Drchal
Herbert Ullrich
Tomás Mlynár
Václav Moravec
HILM
405
5
0
15 Dec 2023
Understanding Probe Behaviors through Variational Bounds of Mutual Information
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Kwanghee Choi
Jee-weon Jung
Shinji Watanabe
SSL
450
10
0
15 Dec 2023
TaCo: Targeted Concept Removal in Output Embeddings for NLP via Information Theory and Explainability
Fanny Jourdan
Louis Bethune
Agustin Picard
Laurent Risser
Nicholas M. Asher
346
0
0
11 Dec 2023
1
2
3
Next
Page 1 of 3
