ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2004.04690
  4. Cited By
Orthogonal Over-Parameterized Training
v1v2v3v4v5v6 (latest)

Orthogonal Over-Parameterized Training

Computer Vision and Pattern Recognition (CVPR), 2020
9 April 2020
Weiyang Liu
Rongmei Lin
Zhen Liu
James M. Rehg
Liam Paull
Li Xiong
Le Song
Adrian Weller
ArXiv (abs)PDFHTML

Papers citing "Orthogonal Over-Parameterized Training"

35 / 35 papers shown
Transferable Model-agnostic Vision-Language Model Adaptation for Efficient Weak-to-Strong Generalization
Transferable Model-agnostic Vision-Language Model Adaptation for Efficient Weak-to-Strong Generalization
Jihwan Park
Taehoon Song
S. Lee
M. Choi
Hyunwoo J. Kim
VLM
213
0
0
12 Aug 2025
PAID: Pairwise Angular-Invariant Decomposition for Continual Test-Time Adaptation
PAID: Pairwise Angular-Invariant Decomposition for Continual Test-Time Adaptation
Kunyu Wang
Xueyang Fu
Yunfei Bao
Chengjie Ge
Chengzhi Cao
Wei-dong Zhai
Zheng-jun Zha
383
0
0
03 Jun 2025
Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation
Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation
Fei Wu
Jia Hu
Geyong Min
Shiqiang Wang
428
0
0
16 May 2025
Spectral Architecture Search for Neural Network Models
Spectral Architecture Search for Neural Network Models
Gianluca Peri
Lorenzo Giambagli
Lorenzo Chicchi
Duccio Fanelli
279
1
0
01 Apr 2025
Robustness of Nonlinear Representation Learning
Robustness of Nonlinear Representation LearningInternational Conference on Machine Learning (ICML), 2025
Simon Buchholz
Bernhard Schölkopf
OOD
901
10
0
19 Mar 2025
Spectral-factorized Positive-definite Curvature Learning for NN Training
Spectral-factorized Positive-definite Curvature Learning for NN Training
Wu Lin
Felix Dangel
Runa Eschenhagen
Juhan Bae
Richard E. Turner
Roger B. Grosse
635
0
0
10 Feb 2025
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for
  Parameter-Efficient Fine-Tuning
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning
Yiming Shi
Jiwei Wei
Yujia Wu
Ran Ran
Chengwei Sun
Shiyuan He
Yang Yang
ALM
284
3
0
17 Oct 2024
Orthogonal Finetuning for Direct Preference Optimization
Orthogonal Finetuning for Direct Preference Optimization
Chenxu Yang
Ruipeng Jia
Naibin Gu
Zheng Lin
Siyuan Chen
Chao Pang
Weichong Yin
Yu Sun
Hua Wu
Weiping Wang
483
6
0
23 Sep 2024
Enhancing Robustness of Vision-Language Models through Orthogonality
  Learning and Cross-Regularization
Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Cross-Regularization
Jinlong Li
Zequn Jie
Elisa Ricci
Lin Ma
Andrii Zadaianchuk
VLM
376
1
0
11 Jul 2024
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
Xinyu Ma
Xu Chu
Zhibang Yang
Yang Lin
Xin Gao
Junfeng Zhao
427
20
0
05 Apr 2024
Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization
Parameter-Efficient Orthogonal Finetuning via Butterfly FactorizationInternational Conference on Learning Representations (ICLR), 2023
Weiyang Liu
Zeju Qiu
Yao Feng
Yuliang Xiu
Yuxuan Xue
...
Songyou Peng
Yandong Wen
Michael J. Black
Adrian Weller
Bernhard Schölkopf
512
104
0
10 Nov 2023
Pairwise Similarity Learning is SimPLE
Pairwise Similarity Learning is SimPLE
Yandong Wen
Weiyang Liu
Yao Feng
Bhiksha Raj
Rita Singh
Adrian Weller
Michael J. Black
Bernhard Schölkopf
333
9
0
13 Oct 2023
Controlling Text-to-Image Diffusion by Orthogonal Finetuning
Controlling Text-to-Image Diffusion by Orthogonal FinetuningNeural Information Processing Systems (NeurIPS), 2023
Zeju Qiu
Wei-yu Liu
Haiwen Feng
Yuxuan Xue
Yao Feng
Zhen Liu
Dan Zhang
Adrian Weller
Bernhard Schölkopf
DiffM
493
237
0
12 Jun 2023
Generalizing and Decoupling Neural Collapse via Hyperspherical
  Uniformity Gap
Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity GapInternational Conference on Learning Representations (ICLR), 2023
Weiyang Liu
L. Yu
Adrian Weller
Bernhard Schölkopf
320
23
0
11 Mar 2023
TANGOS: Regularizing Tabular Neural Networks through Gradient
  Orthogonalization and Specialization
TANGOS: Regularizing Tabular Neural Networks through Gradient Orthogonalization and SpecializationInternational Conference on Learning Representations (ICLR), 2023
Alan Jeffares
Tennison Liu
Jonathan Crabbé
F. Imrie
M. Schaar
CML
238
34
0
09 Mar 2023
Hyperspherical Quantization: Toward Smaller and More Accurate Models
Hyperspherical Quantization: Toward Smaller and More Accurate ModelsIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2022
Dan Liu
X. Chen
Chen Ma
Xue Liu
MQ
203
4
0
24 Dec 2022
Iterative Teaching by Data Hallucination
Iterative Teaching by Data HallucinationInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Zeju Qiu
Weiyang Liu
Tim Z. Xiao
Zhen Liu
Umang Bhatt
Yucen Luo
Adrian Weller
Bernhard Schölkopf
371
12
0
31 Oct 2022
Continual Learning by Modeling Intra-Class Variation
Continual Learning by Modeling Intra-Class Variation
L. Yu
Tianyang Hu
Lanqing Hong
Zhen Liu
Adrian Weller
Weiyang Liu
CLL
280
16
0
11 Oct 2022
Utilizing Excess Resources in Training Neural Networks
Utilizing Excess Resources in Training Neural NetworksInternational Conference on Information Photonics (ICIP), 2022
Amit Henig
Raja Giryes
172
0
0
12 Jul 2022
Data-Efficient Learning via Minimizing Hyperspherical Energy
Data-Efficient Learning via Minimizing Hyperspherical EnergyIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Xiaofeng Cao
Weiyang Liu
Ivor W. Tsang
283
16
0
30 Jun 2022
Hyperspherical Consistency Regularization
Hyperspherical Consistency RegularizationComputer Vision and Pattern Recognition (CVPR), 2022
Cheng Tan
Zhangyang Gao
Lirong Wu
Siyuan Li
Stan Z. Li
208
28
0
02 Jun 2022
Feedback Gradient Descent: Efficient and Stable Optimization with
  Orthogonality for DNNs
Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNsAAAI Conference on Artificial Intelligence (AAAI), 2022
Fanchen Bu
D. Chang
253
7
0
12 May 2022
projUNN: efficient method for training deep networks with unitary
  matrices
projUNN: efficient method for training deep networks with unitary matricesNeural Information Processing Systems (NeurIPS), 2022
B. Kiani
Randall Balestriero
Yann LeCun
S. Lloyd
461
38
0
10 Mar 2022
Differentiable Gaussianization Layers for Inverse Problems Regularized
  by Deep Generative Models
Differentiable Gaussianization Layers for Inverse Problems Regularized by Deep Generative Models
Dongzhuo Li
MedIm
408
2
0
07 Dec 2021
Towards Principled Disentanglement for Domain Generalization
Towards Principled Disentanglement for Domain GeneralizationComputer Vision and Pattern Recognition (CVPR), 2021
Hanlin Zhang
Yi-Fan Zhang
Weiyang Liu
Adrian Weller
Bernhard Schölkopf
Eric Xing
OOD
490
150
0
27 Nov 2021
Iterative Teaching by Label Synthesis
Iterative Teaching by Label Synthesis
Weiyang Liu
Zhen Liu
Hanchen Wang
Liam Paull
Bernhard Schölkopf
Adrian Weller
460
18
0
27 Oct 2021
Provable Lifelong Learning of Representations
Provable Lifelong Learning of Representations
Xinyuan Cao
Weiyang Liu
Santosh Vempala
CLL
348
18
0
27 Oct 2021
SphereFace Revived: Unifying Hyperspherical Face Recognition
SphereFace Revived: Unifying Hyperspherical Face Recognition
Weiyang Liu
Yandong Wen
Bhiksha Raj
Rita Singh
Adrian Weller
3DHCVBM
390
55
0
12 Sep 2021
SphereFace2: Binary Classification is All You Need for Deep Face
  Recognition
SphereFace2: Binary Classification is All You Need for Deep Face Recognition
Yandong Wen
Weiyang Liu
Adrian Weller
Bhiksha Raj
Rita Singh
CVBMMQ
344
67
0
03 Aug 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features
A Geometric Analysis of Neural Collapse with Unconstrained FeaturesNeural Information Processing Systems (NeurIPS), 2021
Zhihui Zhu
Tianyu Ding
Jinxin Zhou
Xiao Li
Chong You
Jeremias Sulam
Qing Qu
357
248
0
06 May 2021
Learning with Hyperspherical Uniformity
Learning with Hyperspherical UniformityInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2021
Weiyang Liu
Rongmei Lin
Zhen Liu
Li Xiong
Bernhard Schölkopf
Adrian Weller
381
48
0
02 Mar 2021
Learning by Turning: Neural Architecture Aware Optimisation
Learning by Turning: Neural Architecture Aware OptimisationInternational Conference on Machine Learning (ICML), 2021
Yang Liu
Jeremy Bernstein
M. Meister
Yisong Yue
ODL
448
31
0
14 Feb 2021
ShiftAddNet: A Hardware-Inspired Deep Network
ShiftAddNet: A Hardware-Inspired Deep NetworkNeural Information Processing Systems (NeurIPS), 2020
Haoran You
Xiaohan Chen
Yongan Zhang
Chaojian Li
Sicheng Li
Zihao Liu
Zinan Lin
Yingyan Lin
OODMQ
388
91
0
24 Oct 2020
Angular Visual Hardness
Angular Visual HardnessInternational Conference on Machine Learning (ICML), 2019
Beidi Chen
Weiyang Liu
Zhiding Yu
Jan Kautz
Anshumali Shrivastava
Animesh Garg
Anima Anandkumar
AAML
341
57
0
04 Dec 2019
Regularizing Neural Networks via Minimizing Hyperspherical Energy
Regularizing Neural Networks via Minimizing Hyperspherical EnergyComputer Vision and Pattern Recognition (CVPR), 2019
Rongmei Lin
Weiyang Liu
Zhen Liu
Chen Feng
Zhiding Yu
James M. Rehg
Li Xiong
Le Song
247
46
0
12 Jun 2019
1
Page 1 of 1