A Theory of Usable Information Under Computational Constraints

25 February 2020

Papers citing "A Theory of Usable Information Under Computational Constraints"

50 / 104 papers shown

Title
Aligning Multimodal Representations through an Information Bottleneck Antonio Almudévar José Miguel Hernández-Lobato Sameer Khurana R. Marxer Alfonso Ortega SSL 106 0 0 05 Jun 2025
How much do language models memorize? John X. Morris Chawin Sitawarin Chuan Guo Narine Kokhlikyan G. E. Suh Alexander M. Rush Kamalika Chaudhuri Saeed Mahloujifar KELM ELM 27 0 0 30 May 2025
Laplace Sample Information: Data Informativeness Through a Bayesian Lens Johannes Kaiser Kristian Schwethelm Daniel Rueckert Georgios Kaissis 52 0 0 21 May 2025
Evaluating Explanations: An Explanatory Virtues Framework for Mechanistic Interpretability -- The Strange Science Part I.ii Kola Ayonrinde Louis Jaburi XAI 147 1 0 02 May 2025
On the generalization of language models from in-context learning and finetuning: a controlled study Andrew Kyle Lampinen Arslan Chaudhry Stephanie Chan Cody Wild Diane Wan Alex Ku Jorg Bornschein Razvan Pascanu Murray Shanahan James L. McClelland 169 5 0 01 May 2025
Distilling semantically aware orders for autoregressive image generation Rishav Pramanik Antoine Poupon Juan A. Rodriguez Masih Aminbeidokhti David Vazquez Christopher Pal Zhaozheng Yin M. Pedersoli 78 0 0 23 Apr 2025
Exploiting Contextual Knowledge in LLMs through V-usable Information based Layer Enhancement Xiaowei Yuan Zhao Yang Ziyang Huang Yucheng Wang Siqi Fan Yiming Ju Jun Zhao Kang Liu 77 0 0 22 Apr 2025
Geometric Median Matching for Robust k-Subset Selection from Noisy Data Anish Acharya Sujay Sanghavi Alexandros G. Dimakis Inderjit S Dhillon AAML 181 0 0 01 Apr 2025
Fundamental Limits of Perfect Concept Erasure Somnath Basu Roy Chowdhury Avinava Dubey Ahmad Beirami Rahul Kidambi Nicholas Monath Amr Ahmed Snigdha Chaturvedi 107 1 0 25 Mar 2025
Statistical Deficiency for Task Inclusion Estimation Loïc Fosse Frédéric Béchet Benoit Favre Géraldine Damnati Gwénolé Lecorvé Maxime Darrin Philippe Formont Pablo Piantanida 528 0 0 07 Mar 2025
Geometric Median (GM) Matching for Robust Data Pruning Anish Acharya Inderjit S Dhillon Sujay Sanghavi AAML 139 0 0 20 Jan 2025
Understanding the Role of Equivariance in Self-supervised Learning Yifei Wang Kaiwen Hu Sharut Gupta Ziyu Ye Yisen Wang Stefanie Jegelka SSL 97 2 0 10 Nov 2024
Identifying Task Groupings for Multi-Task Learning Using Pointwise V-Usable Information Yingya Li Timothy A. Miller Steven Bethard G. Savova 75 2 0 16 Oct 2024
A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets Kyungeun Lee Wonjong Rhee 75 5 0 14 Oct 2024
Label-Augmented Dataset Distillation Seoungyoon Kang Youngsun Lim Hyunjung Shim DD 85 2 0 24 Sep 2024
Disentanglement with Factor Quantized Variational Autoencoders Gulcin Baykal M. Kandemir Gözde B. Ünal CoGe DRL 77 0 0 23 Sep 2024
Understanding Visual Feature Reliance through the Lens of Complexity Thomas Fel Louis Bethune Andrew Kyle Lampinen Thomas Serre Katherine Hermann FAtt CoGe 92 9 0 08 Jul 2024
Free-text Rationale Generation under Readability Level Control Yi-Sheng Hsu Nils Feldhus Sherzod Hakimov 112 2 0 01 Jul 2024
Establishing Deep InfoMax as an effective self-supervised learning methodology in materials informatics Michael Moran Vladimir V. Gusev M. Gaultois Dmytro Antypov M. Rosseinsky AI4CE 66 0 0 30 Jun 2024
On Subjective Uncertainty Quantification and Calibration in Natural Language Generation Ziyu Wang Chris Holmes UQLM 162 7 0 07 Jun 2024
Sexism Detection on a Data Diet Rabiraj Bandyopadhyay Dennis Assenmacher J. Alonso-Moral Claudia Wagner 69 0 0 07 Jun 2024
GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost Xinyi Shang Peng Sun Tao Lin 111 3 0 23 May 2024
DispaRisk: Auditing Fairness Through Usable Information Jonathan Vasquez Carlotta Domeniconi Huzefa Rangwala 61 0 0 20 May 2024
Dealing Doubt: Unveiling Threat Models in Gradient Inversion Attacks under Federated Learning, A Survey and Taxonomy Yichuan Shi Olivera Kotevska Viktor Reshniak Abhishek Singh Ramesh Raskar AAML 79 1 0 16 May 2024
Towards Task-Compatible Compressible Representations Anderson de Andrade Ivan V. Bajić 87 1 0 16 May 2024
Cauchy-Schwarz Divergence Information Bottleneck for Regression Shujian Yu Xi Yu Sigurd Løkse Robert Jenssen José C. Príncipe UQCV 80 5 0 27 Apr 2024
Modeling Low-Resource Health Coaching Dialogues via Neuro-Symbolic Goal Summarization and Text-Units-Text Generation Yue Zhou Barbara Di Eugenio Brian Ziebart Lisa Sharp Bing Liu Nikolaos Agadakos 59 3 0 16 Apr 2024
When Do We Not Need Larger Vision Models? Baifeng Shi Ziyang Wu Maolin Mao Xin Wang Trevor Darrell VLM LRM 119 49 0 19 Mar 2024
RORA: Robust Free-Text Rationale Evaluation Zhengping Jiang Yining Lu Hanjie Chen Daniel Khashabi Benjamin Van Durme Anqi Liu 90 3 0 28 Feb 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 284 22 0 28 Feb 2024
Privacy-Preserving Map-Free Exploration for Confirming the Absence of a Radioactive Source Eric Lepowsky David Snyder Alexander Glaser Anirudha Majumdar 90 0 0 27 Feb 2024
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study Tianjie Ju Weiwei Sun Wei Du Xinwei Yuan Zhaochun Ren Gongshen Liu KELM 68 33 0 25 Feb 2024
PreFLMR: Scaling Up Fine-Grained Late-Interaction Multi-modal Retrievers Weizhe Lin Jingbiao Mei Jinghong Chen Bill Byrne VLM AI4Ed 120 21 0 13 Feb 2024
NetInfoF Framework: Measuring and Exploiting Network Usable Information Meng-Chieh Lee Haiyang Yu Jian Zhang V. Ioannidis Xiang Song Soji Adeshina Da Zheng Christos Faloutsos 89 1 0 12 Feb 2024
Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification Shanshan Xu Santosh T.Y.S.S O. Ichim Barbara Plank Matthias Grabmair 95 4 0 11 Feb 2024
Arrows of Time for Large Language Models Vassilis Papadopoulos Jérémie Wenger Clément Hongler 74 10 0 30 Jan 2024
TVE: Learning Meta-attribution for Transferable Vision Explainer Guanchu Wang Yu-Neng Chuang Fan Yang Mengnan Du Chia-Yuan Chang ... Zirui Liu Zhaozhuo Xu Kaixiong Zhou Xuanting Cai Helen Zhou 111 1 0 23 Dec 2023
Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language Jan Drchal Herbert Ullrich Tomás Mlynár Václav Moravec HILM 96 3 0 15 Dec 2023
Understanding Probe Behaviors through Variational Bounds of Mutual Information Kwanghee Choi Jee-weon Jung Shinji Watanabe SSL 99 5 0 15 Dec 2023
On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm Peng Sun Bei Shi Daiwei Yu Tao Lin DD 100 51 0 06 Dec 2023
Measuring Adversarial Datasets Yuanchen Bai Raoyi Huang Vijay Viswanathan Tzu-Sheng Kuo Tongshuang Wu 83 1 0 06 Nov 2023
SoK: Memorisation in machine learning Dmitrii Usynin Moritz Knolle Georgios Kaissis 97 1 0 06 Nov 2023
People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detection Indira Sen Dennis Assenmacher Mattia Samory Isabelle Augenstein Wil M.P. van der Aalst Claudia Wagner 79 21 0 02 Nov 2023
Learning Fair Representations with High-Confidence Guarantees Yuhong Luo Austin Hoag Philip S Thomas FaML AI4TS 195 1 0 23 Oct 2023
Frozen Transformers in Language Models Are Effective Visual Encoder Layers Ziqi Pang Ziyang Xie Yunze Man Yu-Xiong Wang 144 27 0 19 Oct 2023
$Measuring Pointwise $\mathcal{V}$-Usable Information In-Context-ly$ Measuring Pointwise $\mathcal{V}$ -Usable Information In-Context-ly Sheng Lu Shan Chen Yingya Li Danielle Bitterman G. Savova Iryna Gurevych 47 0 0 18 Oct 2023
A State-Vector Framework for Dataset Effects E. Sahak Zining Zhu Frank Rudzicz 55 1 0 17 Oct 2023
Measuring Information in Text Explanations Zining Zhu Frank Rudzicz FAtt 66 0 0 06 Oct 2023
A Geometric Notion of Causal Probing Clément Guerner Anej Svete Tianyu Liu Alex Warstadt Ryan Cotterell LLMSV 100 17 0 27 Jul 2023
Operationalising Representation in Natural Language Processing J. Harding 121 13 0 14 Jun 2023