Visualizing the Loss Landscape of Neural Nets

28 December 2017

Hao Li

Papers citing "Visualizing the Loss Landscape of Neural Nets"

50 / 1,039 papers shown

Title
ETAGE: Enhanced Test Time Adaptation with Integrated Entropy and Gradient Norms for Robust Model Performance Afshar Shamsi Rejisa Becirovic A. Argha Ehsan Abbasnejad Hamid Alinejad-Rokny Arash Mohammadi TTA OOD 19 0 0 14 Sep 2024
Investigation of Hierarchical Spectral Vision Transformer Architecture for Classification of Hyperspectral Imagery Wei Liu Saurabh Prasad Melba M. Crawford 30 3 0 14 Sep 2024
Advancing Hybrid Defense for Byzantine Attacks in Federated Learning Kai Yue Richeng Jin Chau-Wai Wong H. Dai AAML 31 0 0 10 Sep 2024
Quantifying Emergence in Neural Networks: Insights from Pruning and Training Dynamics Faisal AlShinaifi Zeyad Almoaigel Johnny Jingze Li Abdulla Kuleib Gabriel A. Silva 29 0 0 03 Sep 2024
CLIBE: Detecting Dynamic Backdoors in Transformer-based NLP Models Rui Zeng Xi Chen Yuwen Pu Xuhong Zhang Tianyu Du Shouling Ji 41 2 0 02 Sep 2024
RevCD -- Reversed Conditional Diffusion for Generalized Zero-Shot Learning William Heyden H. Ullah M. S. Siddiqui Fadi Al-Machot DiffM 31 0 0 31 Aug 2024
Rethinking Backdoor Detection Evaluation for Language Models Jun Yan Wenjie Jacky Mo Xiang Ren Robin Jia ELM 40 1 0 31 Aug 2024
Model Parallel Training and Transfer Learning for Convolutional Neural Networks by Domain Decomposition A. Klawonn M. Lanser J. Weber OOD 21 1 0 26 Aug 2024
Geometrical structures of digital fluctuations in parameter space of neural networks trained with adaptive momentum optimization Igor V. Netay 31 0 0 22 Aug 2024
Weight Scope Alignment: A Frustratingly Easy Method for Model Merging Yichu Xu Xin-Chun Li Le Gan De-Chuan Zhan MoMe 40 0 0 22 Aug 2024
First line of defense: A robust first layer mitigates adversarial attacks Janani Suresh Nancy Nayak Sheetal Kalyani AAML 22 0 0 21 Aug 2024
MS $^3$ D: A RG Flow-Based Regularization for GAN Training with Limited Data Jian Wang Xin Lan Yuxin Tian Jiancheng Lv AI4CE 18 1 0 20 Aug 2024
Enhancing ASL Recognition with GCNs and Successive Residual Connections Ushnish Sarkar Archisman Chakraborti Tapas Samanta Sarbajit Pal Amitabha Das 14 1 0 18 Aug 2024
Vanilla Gradient Descent for Oblique Decision Trees Subrat Prasad Panda B. Genest Arvind Easwaran Ponnuthurai Nagaratnam Suganthan OffRL 13 1 0 17 Aug 2024
Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition Kenzo Clauw S. Stramaglia Daniele Marinazzo 50 3 0 16 Aug 2024
Audio Enhancement for Computer Audition -- An Iterative Training Paradigm Using Sample Importance M. Milling Shuo Liu Andreas Triantafyllopoulos Ilhan Aslan Björn W. Schuller 29 2 0 12 Aug 2024
Impacts of Darwinian Evolution on Pre-trained Deep Neural Networks Guodong Du Runhua Jiang Senqiao Yang HaoYang Li Wei Chen Keren Li S. Goh Ho-Kin Tang 31 3 0 10 Aug 2024
SuperEncoder: Towards Universal Neural Approximate Quantum State Preparation Yilun Zhao Bingmeng Wang Wenle Jiang Xiwei Pan Bing Li Yinhe Han Ying Wang 21 1 0 10 Aug 2024
On the Geometry of Deep Learning Randall Balestriero Ahmed Imtiaz Humayun Richard G. Baraniuk AI4CE 39 1 0 09 Aug 2024
Optimizing Cox Models with Stochastic Gradient Descent: Theoretical Foundations and Practical Guidances Lang Zeng Weijing Tang Zhao Ren Ying Ding 31 0 0 05 Aug 2024
Exploring Loss Landscapes through the Lens of Spin Glass Theory Hao Liao Wei Zhang Zhanyi Huang Zexiao Long Mingyang Zhou Xiaoqun Wu Rui Mao Chi Ho Yeung 51 2 0 30 Jul 2024
Competition-based Adaptive ReLU for Deep Neural Networks Junjia Chen Zhibin Pan 19 0 0 28 Jul 2024
Enhancing material property prediction with ensemble deep graph convolutional networks Chowdhury Mohammad Abid Rahman Ghadendra B. Bhandari Nasser M. Nasrabadi Aldo H. Romero P. Gyawali AI4CE 40 3 0 26 Jul 2024
Joint or Disjoint: Mixing Training Regimes for Early-Exit Models Bartłomiej Krzepkowski Monika Michaluk Franciszek Szarwacki Piotr Kubaty Jary Pomponi Tomasz Trzciñski Bartosz Wójcik Kamil Adamczewski 14 0 0 19 Jul 2024
Neural topology optimization: the good, the bad, and the ugly Suryanarayanan Manoj Sanu Alejandro M. Aragon Miguel A. Bessa 16 2 0 19 Jul 2024
Exploring End-to-end Differentiable Neural Charged Particle Tracking -- A Loss Landscape Perspective T. Kortus Ralf Keidel N.R. Gauger 48 0 0 18 Jul 2024
Learning secondary tool affordances of human partners using iCub robot's egocentric data Bosong Ding Erhan Öztop Giacomo Spigler M. Kirtay 25 0 0 16 Jul 2024
Exploring Quantization for Efficient Pre-Training of Transformer Language Models Kamran Chitsaz Quentin Fournier Gonccalo Mordido Sarath Chandar MQ 44 3 0 16 Jul 2024
Deep Learning Evidence for Global Optimality of Gerver's Sofa Kuangdai Leng Jia Bi Jaehoon Cha Samuel Pinilla Jeyan Thiyagalingam 15 0 0 15 Jul 2024
Boosting Adversarial Transferability for Skeleton-based Action Recognition via Exploring the Model Posterior Space Yunfeng Diao Baiqi Wu Ruixuan Zhang Xun Yang Meng Wang He Wang 29 0 0 11 Jul 2024
Highway Networks for Improved Surface Reconstruction: The Role of Residuals and Weight Updates A. Noorizadegan Y. C. Hon D. Young C. S. Chen 3DV 18 0 0 11 Jul 2024
Stable Weight Updating: A Key to Reliable PDE Solutions Using Deep Learning A. Noorizadegan R. Cavoretto D. Young C. S. Chen 19 7 0 10 Jul 2024
Stepping on the Edge: Curvature Aware Learning Rate Tuners Vincent Roulet Atish Agarwala Jean-Bastien Grill Grzegorz Swirszcz Mathieu Blondel Fabian Pedregosa 34 1 0 08 Jul 2024
Harmony in Diversity: Merging Neural Networks with Canonical Correlation Analysis Stefan Horoi Albert Manuel Orozco Camacho Eugene Belilovsky Guy Wolf FedML MoMe 27 9 0 07 Jul 2024
CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs Akshat Ramachandran Souvik Kundu Tushar Krishna MQ 32 8 0 07 Jul 2024
OvSW: Overcoming Silent Weights for Accurate Binary Neural Networks Jingyang Xiang Zuohui Chen Siqi Li Qing Wu Yong-Jin Liu 26 1 0 07 Jul 2024
Multimodal Classification via Modal-Aware Interactive Enhancement Qing-Yuan Jiang Zhouyang Chi Yang Yang 31 3 0 05 Jul 2024
Learning Non-Linear Invariants for Unsupervised Out-of-Distribution Detection Lars Doorenbos Raphael Sznitman Pablo Márquez-Neila 37 1 0 04 Jul 2024
Face Reconstruction Transfer Attack as Out-of-Distribution Generalization Yoon Gyo Jung Jaewoo Park Xingbo Dong Hojin Park Andrew Beng Jin Teoh Octavia Camps AAML 44 0 0 02 Jul 2024
Distributional Regression U-Nets for the Postprocessing of Precipitation Ensemble Forecasts Romain Pic Clément Dombry Philippe Naveau Maxime Taillardat 34 0 0 02 Jul 2024
Analytical Solution of a Three-layer Network with a Matrix Exponential Activation Function Kuo Gai Shihua Zhang FAtt 31 0 0 02 Jul 2024
Empirical Tests of Optimization Assumptions in Deep Learning Hoang Tran Qinzi Zhang Ashok Cutkosky 31 1 0 01 Jul 2024
Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning Nexhi Sula Abhinav Kumar Jie Hou Han Wang R. Tourani MU 23 0 0 01 Jul 2024
On the Trade-off between Flatness and Optimization in Distributed Learning Ying Cao Zhaoxian Wu Kun Yuan Ali H. Sayed 28 1 0 28 Jun 2024
RepNeXt: A Fast Multi-Scale CNN using Structural Reparameterization Mingshu Zhao Yi Luo Yong Ouyang 32 2 0 23 Jun 2024
A Review of Global Sensitivity Analysis Methods and a comparative case study on Digit Classification Zahra Sadeghi Stan Matwin 21 1 0 23 Jun 2024
Towards Exact Computation of Inductive Bias Akhilan Boopathy William Yue Jaedong Hwang Abhiram Iyer Ila Fiete 19 0 0 22 Jun 2024
DataFreeShield: Defending Adversarial Attacks without Training Data Hyeyoon Lee Kanghyun Choi Dain Kwon Sunjong Park Mayoore S. Jaiswal Noseong Park Jonghyun Choi Jinho Lee 28 0 0 21 Jun 2024
HLQ: Fast and Efficient Backpropagation via Hadamard Low-rank Quantization Seonggon Kim Eunhyeok Park 39 2 0 21 Jun 2024
Latent Space Translation via Inverse Relative Projection Valentino Maiorca Luca Moschella Marco Fumero Francesco Locatello Emanuele Rodolà 34 1 0 21 Jun 2024