What's Hidden in a Randomly Weighted Neural Network?

29 November 2019

Papers citing "What's Hidden in a Randomly Weighted Neural Network?"

50 / 94 papers shown

Title
Privacy-Aware Lifelong Learning Ozan Özdenizci Elmar Rueckert Robert Legenstein CLL MU KELM 41 0 0 16 May 2025
Are Spatial-Temporal Graph Convolution Networks for Human Action Recognition Over-Parameterized? Jianyang Xie Yitian Zhao Y. Meng He Zhao Anh Nguyen Yalin Zheng 22 0 0 15 May 2025
Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning Sanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim Jeongyeon Nam Donghyun Kwak OffRL LRM 58 4 0 04 Apr 2025
PRIOT: Pruning-Based Integer-Only Transfer Learning for Embedded Systems Honoka Anada Sefutsu Ryu Masayuki Usui Tatsuya Kaneko Shinya Takamaeda-Yamazaki 60 1 0 21 Mar 2025
PRISM: Privacy-Preserving Improved Stochastic Masking for Federated Generative Models Kyeongkook Seo Dong-Jun Han Jaejun Yoo 47 0 0 11 Mar 2025
Playing the Lottery With Concave Regularizers for Sparse Trainable Neural Networks Giulia Fracastoro Sophie M. Fosson Andrea Migliorati G. Calafiore 47 1 0 19 Jan 2025
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA Sangmin Bae Adam Fisch Hrayr Harutyunyan Ziwei Ji Seungyeon Kim Tal Schuster KELM 84 5 0 28 Oct 2024
Mitigating Memorization In Language Models Mansi Sakarvadia Aswathy Ajith Arham Khan Nathaniel Hudson Caleb Geniesse Kyle Chard Yaoqing Yang Ian Foster Michael W. Mahoney KELM MU 58 1 0 03 Oct 2024
Self-Masking Networks for Unsupervised Adaptation Alfonso Taboada Warmerdam Mathilde Caron Yuki M. Asano 54 1 0 11 Sep 2024
Expressivity of Neural Networks with Random Weights and Learned Biases Ezekiel Williams Avery Hee-Woon Ryoo Thomas Jiralerspong Alexandre Payeur M. Perich Luca Mazzucato Guillaume Lajoie 43 2 0 01 Jul 2024
Learning System Dynamics without Forgetting Xikun Zhang Dongjin Song Yushan Jiang Yixin Chen Dacheng Tao AI4CE 42 2 0 30 Jun 2024
Survival of the Fittest Representation: A Case Study with Modular Addition Xiaoman Delores Ding Zifan Carl Guo Eric J. Michaud Ziming Liu Max Tegmark 52 3 0 27 May 2024
Learning a Sparse Representation of Barron Functions with the Inverse Scale Space Flow T. J. Heeringa Tim Roith Christoph Brune Martin Burger 36 0 0 05 Dec 2023
Pursing the Sparse Limitation of Spiking Deep Learning Structures Hao-Ran Cheng Jiahang Cao Erjia Xiao Mengshu Sun Le Yang Jize Zhang Xue Lin B. Kailkhura Kaidi Xu Renjing Xu 23 1 0 18 Nov 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 27 1 0 16 Nov 2023
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs Yuxin Zhang Lirui Zhao Mingbao Lin Yunyun Sun Yiwu Yao Xingjia Han Jared Tanner Shiwei Liu Rongrong Ji SyDa 45 40 0 13 Oct 2023
Communication-Efficient Federated Learning via Regularized Sparse Random Networks Mohamad Mestoukirdi Omid Esrafilian David Gesbert Qianrui Li N. Gresset FedML 35 0 0 19 Sep 2023
Mitigating Task Interference in Multi-Task Learning via Explicit Task Routing with Non-Learnable Primitives Chuntao Ding Zhichao Lu Shangguang Wang Ran Cheng Vishnu Boddeti MoMe 31 16 0 03 Aug 2023
Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability Jianing Zhu Hengzhuang Li Jiangchao Yao Tongliang Liu Jianliang Xu Bo Han OODD 48 12 0 06 Jun 2023
Biologically-Motivated Learning Model for Instructed Visual Processing R. Abel S. Ullman 30 0 0 04 Jun 2023
Robust Tickets Can Transfer Better: Drawing More Transferable Subnetworks in Transfer Learning Y. Fu Ye Yuan Shang Wu Jiayi Yuan Yingyan Lin OOD 69 3 0 24 Apr 2023
Visual DNA: Representing and Comparing Images using Distributions of Neuron Activations Benjamin Ramtoula Matthew Gadd Paul Newman D. Martini 33 10 0 20 Apr 2023
Looking Similar, Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning Nikhil Singh Chih-Wei Wu Iroro Orife Mahdi M. Kalayeh 37 2 0 12 Apr 2023
Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa Shreyas Saxena Abhay Gupta Sean Lie 41 3 0 21 Mar 2023
Neural Graph Revealers H. Shrivastava Urszula Chajewska BDL 36 6 0 27 Feb 2023
Considering Layerwise Importance in the Lottery Ticket Hypothesis Benjamin Vandersmissen José Oramas 37 1 0 22 Feb 2023
Learning a Consensus Sub-Network with Polarization Regularization and One Pass Training Xiaoying Zhi Varun Babbar P. Sun Fran Silavong Ruibo Shi Sean J. Moran Sean Moran 60 1 0 17 Feb 2023
Quantum Neuron Selection: Finding High Performing Subnetworks With Quantum Algorithms Tim Whitaker 33 1 0 12 Feb 2023
Quantum Ridgelet Transform: Winning Lottery Ticket of Neural Networks with Quantum Computation H. Yamasaki Sathyawageeswar Subramanian Satoshi Hayakawa Sho Sonoda MLT 33 4 0 27 Jan 2023
Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Pruning Huan Wang Can Qin Yue Bai Yun Fu 37 20 0 12 Jan 2023
Can We Find Strong Lottery Tickets in Generative Models? Sangyeop Yeo Yoojin Jang Jy-yong Sohn Dongyoon Han Jaejun Yoo 20 6 0 16 Dec 2022
You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Tickets Tianjin Huang Tianlong Chen Meng Fang Vlado Menkovski Jiaxu Zhao ... Yulong Pei Decebal Constantin Mocanu Zhangyang Wang Mykola Pechenizkiy Shiwei Liu GNN 52 14 0 28 Nov 2022
Cooperative data-driven modeling Aleksandr Dekhovich O. T. Turan Jiaxiang Yi Miguel A. Bessa CLL KELM AI4CE 24 5 0 23 Nov 2022
Exploiting the Partly Scratch-off Lottery Ticket for Quantization-Aware Training Mingliang Xu Gongrui Nan Yuxin Zhang Rongrong Ji Rongrong Ji MQ 23 3 0 12 Nov 2022
A Theoretical Study on Solving Continual Learning Gyuhak Kim Changnan Xiao Tatsuya Konishi Zixuan Ke Bin Liu CLL 27 71 0 04 Nov 2022
Compressing And Debiasing Vision-Language Pre-Trained Models for Visual Question Answering Q. Si Yuanxin Liu Zheng Lin Peng Fu Weiping Wang VLM 44 1 0 26 Oct 2022
Parameter-Efficient Masking Networks Yue Bai Huan Wang Xu Ma Yitian Zhang Zhiqiang Tao Yun Fu 31 10 0 13 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 56 68 0 08 Oct 2022
Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask? Mansheej Paul F. Chen Brett W. Larsen Jonathan Frankle Surya Ganguli Gintare Karolina Dziugaite UQCV 47 38 0 06 Oct 2022
Efficient Multi-Prize Lottery Tickets: Enhanced Accuracy, Training, and Inference Speed Hao-Ran Cheng Pu Zhao Yize Li Xue Lin James Diffenderfer R. Goldhahn B. Kailkhura MQ 36 0 0 26 Sep 2022
RIBAC: Towards Robust and Imperceptible Backdoor Attack against Compact DNN Huy Phan Cong Shi Yi Xie Tian-Di Zhang Zhuohang Li Tianming Zhao Jian-Dong Liu Yan Wang Ying-Cong Chen Bo Yuan AAML 35 6 0 22 Aug 2022
Demystifying Randomly Initialized Networks for Evaluating Generative Models Junghyuk Lee Jun-Hyuk Kim Jong-Seok Lee EGVM 27 0 0 19 Aug 2022
On the Robustness and Anomaly Detection of Sparse Neural Networks Morgane Ayle Bertrand Charpentier John Rachwan Daniel Zügner Simon Geisler Stephan Günnemann AAML 63 3 0 09 Jul 2022
Models Out of Line: A Fourier Lens on Distribution Shift Robustness Sara Fridovich-Keil Brian Bartoldson James Diffenderfer B. Kailkhura P. Bremer OOD 56 0 0 08 Jul 2022
A General Framework For Proving The Equivariant Strong Lottery Ticket Hypothesis Damien Ferbach Christos Tsirigotis Gauthier Gidel Avishek A. Bose 43 16 0 09 Jun 2022
DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks Y. Fu Haichuan Yang Jiayi Yuan Meng Li Cheng Wan Raghuraman Krishnamoorthi Vikas Chandra Yingyan Lin 41 19 0 02 Jun 2022
Interpolating Compressed Parameter Subspaces Siddhartha Datta N. Shadbolt 37 5 0 19 May 2022
Convolutional and Residual Networks Provably Contain Lottery Tickets R. Burkholz UQCV MLT 42 13 0 04 May 2022
Most Activation Functions Can Win the Lottery Without Excessive Depth R. Burkholz MLT 79 18 0 04 May 2022
Attentive Fine-Grained Structured Sparsity for Image Restoration Junghun Oh Heewon Kim Seungjun Nah Chee Hong Jonghyun Choi Kyoung Mu Lee 29 18 0 26 Apr 2022