PyHessian: Neural Networks Through the Lens of the Hessian

PyHessian: Neural Networks Through the Lens of the Hessian

16 December 2019

Michael W. Mahoney

Papers citing "PyHessian: Neural Networks Through the Lens of the Hessian"

16 / 66 papers shown

Title
Stochastic Weight Averaging Revisited Hao Guo Jiyong Jin B. Liu 20 29 0 03 Jan 2022
Towards Federated Learning on Time-Evolving Heterogeneous Data Yongxin Guo Tao R. Lin Xiaoying Tang FedML 14 30 0 25 Dec 2021
GOSH: Task Scheduling Using Deep Surrogate Models in Fog Computing Environments Shreshth Tuli G. Casale N. Jennings 24 21 0 16 Dec 2021
Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning Matías Mendieta Taojiannan Yang Pu Wang Minwoo Lee Zhengming Ding C. L. P. Chen FedML 17 158 0 28 Nov 2021
Impact of classification difficulty on the weight matrices spectra in Deep Learning and application to early-stopping Xuran Meng Jianfeng Yao 17 7 0 26 Nov 2021
Fishr: Invariant Gradient Variances for Out-of-Distribution Generalization Alexandre Ramé Corentin Dancette Matthieu Cord OOD 38 204 0 07 Sep 2021
Characterizing possible failure modes in physics-informed neural networks Aditi S. Krishnapriyan A. Gholami Shandian Zhe Robert M. Kirby Michael W. Mahoney PINN AI4CE 20 607 0 02 Sep 2021
Sparse Flows: Pruning Continuous-depth Models Lucas Liebenwein Ramin Hasani Alexander Amini Daniela Rus 18 16 0 24 Jun 2021
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 19 155 0 17 Jun 2021
Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms A. Camuto George Deligiannidis Murat A. Erdogdu Mert Gurbuzbalaban Umut cSimcsekli Lingjiong Zhu 23 29 0 09 Jun 2021
Sparse sketches with small inversion bias Michal Derezinski Zhenyu Liao Edgar Dobriban Michael W. Mahoney 15 21 0 21 Nov 2020
Learning explanations that are hard to vary Giambattista Parascandolo Alexander Neitz Antonio Orvieto Luigi Gresele Bernhard Schölkopf FAtt 13 178 0 01 Sep 2020
Lipschitz Recurrent Neural Networks N. Benjamin Erichson Omri Azencot A. Queiruga Liam Hodgkinson Michael W. Mahoney 19 107 0 22 Jun 2020
Generative Data Augmentation for Commonsense Reasoning Yiben Yang Chaitanya Malaviya Jared Fernandez Swabha Swayamdipta Ronan Le Bras Ji-ping Wang Chandra Bhagavatula Yejin Choi Doug Downey LRM 22 91 0 24 Apr 2020
HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networks Zhen Dong Z. Yao Yaohui Cai Daiyaan Arfeen A. Gholami Michael W. Mahoney Kurt Keutzer MQ 24 274 0 10 Nov 2019
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT Sheng Shen Zhen Dong Jiayu Ye Linjian Ma Z. Yao A. Gholami Michael W. Mahoney Kurt Keutzer MQ 225 575 0 12 Sep 2019