Orthogonal Over-Parameterized Training

9 April 2020

Papers citing "Orthogonal Over-Parameterized Training"

20 / 20 papers shown

Title
Robustness of Nonlinear Representation Learning Simon Buchholz Bernhard Schölkopf OOD 114 3 0 19 Mar 2025
Spectral-factorized Positive-definite Curvature Learning for NN Training Wu Lin Felix Dangel Runa Eschenhagen Juhan Bae Richard E. Turner Roger B. Grosse 45 0 0 10 Feb 2025
Orthogonal Finetuning for Direct Preference Optimization Chenxu Yang Ruipeng Jia Naibin Gu Zheng-Shen Lin Siyuan Chen Chao Pang Weichong Yin Yu Sun Hua-Hong Wu Weiping Wang 27 0 0 23 Sep 2024
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation Xinyu Ma Xu Chu Zhibang Yang Yang Lin Xin Gao Junfeng Zhao 38 6 0 05 Apr 2024
Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap Weiyang Liu L. Yu Adrian Weller Bernhard Schölkopf 32 17 0 11 Mar 2023
Hyperspherical Quantization: Toward Smaller and More Accurate Models Dan Liu X. Chen Chen-li Ma Xue Liu MQ 20 3 0 24 Dec 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 48 12 0 11 Oct 2022
Utilizing Excess Resources in Training Neural Networks Amit Henig Raja Giryes 29 0 0 12 Jul 2022
Data-Efficient Learning via Minimizing Hyperspherical Energy Xiaofeng Cao Weiyang Liu Ivor W. Tsang 14 8 0 30 Jun 2022
Hyperspherical Consistency Regularization Cheng Tan Zhangyang Gao Lirong Wu Siyuan Li Stan Z. Li 25 24 0 02 Jun 2022
Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs Fanchen Bu D. Chang 17 6 0 12 May 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 34 32 0 10 Mar 2022
Towards Principled Disentanglement for Domain Generalization Hanlin Zhang Yi-Fan Zhang Weiyang Liu Adrian Weller Bernhard Schölkopf Eric P. Xing OOD 23 112 0 27 Nov 2021
Iterative Teaching by Label Synthesis Weiyang Liu Zhen Liu Hanchen Wang Liam Paull Bernhard Schölkopf Adrian Weller 35 16 0 27 Oct 2021
Provable Lifelong Learning of Representations Xinyuan Cao Weiyang Liu Santosh Vempala CLL 19 13 0 27 Oct 2021
SphereFace2: Binary Classification is All You Need for Deep Face Recognition Yandong Wen Weiyang Liu Adrian Weller Bhiksha Raj Rita Singh CVBM MQ 16 53 0 03 Aug 2021
Learning with Hyperspherical Uniformity Weiyang Liu Rongmei Lin Zhen Liu Li Xiong Bernhard Schölkopf Adrian Weller 26 35 0 02 Mar 2021
ShiftAddNet: A Hardware-Inspired Deep Network Haoran You Xiaohan Chen Yongan Zhang Chaojian Li Sicheng Li Zihao Liu Zhangyang Wang Yingyan Lin OOD MQ 68 76 0 24 Oct 2020
Angular Visual Hardness Beidi Chen Weiyang Liu Zhiding Yu Jan Kautz Anshumali Shrivastava Animesh Garg Anima Anandkumar AAML 35 51 0 04 Dec 2019
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 278 11,677 0 09 Mar 2017