Factorizing Knowledge in Neural Networks

4 July 2022

Papers citing "Factorizing Knowledge in Neural Networks"

50 / 62 papers shown

Title
The Impact of Model Zoo Size and Composition on Weight Space Learning Damian Falk Konstantin Schurholt Damian Borth 29 0 0 14 Apr 2025
Scalable Model Merging with Progressive Layer-wise Distillation Jing Xu Jiazheng Li J. Zhang MoMe FedML 83 0 0 18 Feb 2025
Remix-DiT: Mixing Diffusion Transformers for Multi-Expert Denoising Gongfan Fang Xinyin Ma Xinchao Wang DiffM MoE 104 0 0 07 Dec 2024
Neural Metamorphosis Xingyi Yang Xinchao Wang 19 0 0 10 Oct 2024
LoRKD: Low-Rank Knowledge Decomposition for Medical Foundation Models Haolin Li Yuhang Zhou Ziheng Zhao Siyuan Du Jiangchao Yao Weidi Xie Ya Zhang Yanfeng Wang 29 1 0 29 Sep 2024
Breaking Neural Network Scaling Laws with Modularity Akhilan Boopathy Sunshine Jiang William Yue Jaedong Hwang Abhiram Iyer Ila Fiete OOD 31 1 0 09 Sep 2024
FactorLLM: Factorizing Knowledge via Mixture of Experts for Large Language Models Zhongyu Zhao Menghang Dong Rongyu Zhang Wenzhao Zheng Yunpeng Zhang Huanrui Yang Dalong Du Kurt Keutzer Shanghang Zhang 46 0 0 15 Aug 2024
Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Models Baao Xie Qiuyu Chen Yunnan Wang Zequn Zhang Xin Jin Wenjun Zeng OffRL 23 2 0 26 Jul 2024
Encapsulating Knowledge in One Prompt Qi Li Runpeng Yu Xinchao Wang VLM KELM 41 3 0 16 Jul 2024
Neural Lineage Runpeng Yu Xinchao Wang 21 4 0 17 Jun 2024
StyDeSty: Min-Max Stylization and Destylization for Single Domain Generalization Songhua Liu Xin Jin Xingyi Yang Jingwen Ye Xinchao Wang OOD 22 1 0 01 Jun 2024
Low-Rank Knowledge Decomposition for Medical Foundation Models Yuhang Zhou Haolin Li Siyuan Du Jiangchao Yao Ya-Qin Zhang Yanfeng Wang 21 3 0 26 Apr 2024
ReGenNet: Towards Human Action-Reaction Synthesis Liang Xu Yizhou Zhou Yichao Yan Xin Jin Wenhan Zhu Fengyun Rao Xiaokang Yang Wenjun Zeng 17 15 0 18 Mar 2024
Training-Free Pretrained Model Merging Zhenxing Xu Ke Yuan Huiqiong Wang Yong Wang Mingli Song Jie Song MoMe 19 15 0 04 Mar 2024
Inter-X: Towards Versatile Human-Human Interaction Analysis Liang Xu Xintao Lv Yichao Yan Xin Jin Shuwen Wu ... Fengyun Rao Xingdong Sheng Yunhui Liu Wenjun Zeng Xiaokang Yang 24 25 0 26 Dec 2023
Generator Born from Classifier Runpeng Yu Xinchao Wang 14 4 0 05 Dec 2023
Disentangled Latent Spaces Facilitate Data-Driven Auxiliary Learning Geri Skenderi Luigi Capogrosso Andrea Toaiari Matteo Denitto Franco Fummi Simone Melzi Marco Cristani OOD 19 0 0 13 Oct 2023
Factorized Tensor Networks for Multi-Task and Multi-Domain Learning Yash Garg Nebiyou Yismaw Rakib Hyder Ashley Prater-Bennette M. Salman Asif 16 0 0 09 Oct 2023
GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph Xin Li Dongze Lian Zhihe Lu Jiawang Bai Zhibo Chen Xinchao Wang VLM 19 58 0 24 Sep 2023
Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks Zeyang Song Jibin Wu Malu Zhang Mike Zheng Shou Haizhou Li 29 4 0 18 Sep 2023
Priority-Centric Human Motion Generation in Discrete Latent Space Hanyang Kong Kehong Gong Dongze Lian Michael Bi Mi Xinchao Wang DiffM 12 49 0 28 Aug 2023
SG-Former: Self-guided Transformer with Evolving Token Reallocation Sucheng Ren Xingyi Yang Songhua Liu Xinchao Wang ViT 17 39 0 23 Aug 2023
Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Experts Wenyan Cong Hanxue Liang Peihao Wang Zhiwen Fan Tianlong Chen M. Varma Yi Wang Zhangyang Wang MoE 17 21 0 22 Aug 2023
Diffusion Model as Representation Learner Xingyi Yang Xinchao Wang DiffM 22 52 0 21 Aug 2023
Robust Mixture-of-Expert Training for Convolutional Neural Networks Yihua Zhang Ruisi Cai Tianlong Chen Guanhua Zhang Huan Zhang Pin-Yu Chen Shiyu Chang Zhangyang Wang Sijia Liu MoE AAML OOD 17 16 0 19 Aug 2023
Towards Personalized Federated Learning via Heterogeneous Model Reassembly Jiaqi Wang Xingyi Yang Suhan Cui Liwei Che Lingjuan Lyu Dongkuan Xu Fenglong Ma FedML 11 19 0 16 Aug 2023
Decomposition Ascribed Synergistic Learning for Unified Image Restoration Jinghao Zhang Fengmei Zhao 21 1 0 01 Aug 2023
When Multi-Task Learning Meets Partial Supervision: A Computer Vision Review Maxime Fontana Michael W. Spratling Miaojing Shi 23 5 0 25 Jul 2023
High-Quality Automatic Voice Over with Accurate Alignment: Supervision through Self-Supervised Discrete Speech Units Junchen Lu Berrak Sisman Mingyang Zhang Haizhou Li 11 4 0 29 Jun 2023
Distribution Shift Inversion for Out-of-Distribution Prediction Runpeng Yu Songhua Liu Xingyi Yang Xinchao Wang OODD 13 18 0 14 Jun 2023
AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Risks Alexander Tornede Difan Deng Theresa Eimer Joseph Giovanelli Aditya Mohan ... Sarah Segel Daphne Theodorakopoulos Tanja Tornede Henning Wachsmuth Marius Lindauer 17 22 0 13 Jun 2023
Improving Expressivity of GNNs with Subgraph-specific Factor Embedded Normalization Kaixuan Chen Shunyu Liu Tongtian Zhu Tongya Zheng Haofei Zhang Zunlei Feng Jingwen Ye Mingli Song 26 14 0 31 May 2023
Target Active Speaker Detection with Audio-visual Cues Yiding Jiang Ruijie Tao Zexu Pan Haizhou Li 13 16 0 22 May 2023
LLM-Pruner: On the Structural Pruning of Large Language Models Xinyin Ma Gongfan Fang Xinchao Wang 23 355 0 19 May 2023
Structural Pruning for Diffusion Models Gongfan Fang Xinyin Ma Xinchao Wang 17 62 0 18 May 2023
Deep Graph Reprogramming Yongcheng Jing Chongbin Yuan Li Ju Yiding Yang Xinchao Wang Dacheng Tao 75 35 0 28 Apr 2023
Master: Meta Style Transformer for Controllable Zero-Shot and Few-Shot Artistic Style Transfer Hao Tang Songhua Liu Tianwei Lin Shaoli Huang Fu Li Dongliang He Xinchao Wang 17 5 0 24 Apr 2023
Segment Anything in Non-Euclidean Domains: Challenges and Opportunities Yongcheng Jing Xinchao Wang Dacheng Tao 22 21 0 23 Apr 2023
HM-ViT: Hetero-modal Vehicle-to-Vehicle Cooperative perception with vision transformer Hao Xiang Runsheng Xu Jiaqi Ma 19 50 0 20 Apr 2023
Propheter: Prophetic Teacher Guided Long-Tailed Distribution Learning Wenxiang Xu Lin Chen Linyun Zhou Jie Lei Lechao Cheng Zunlei Feng Min-Gyoo Song 15 1 0 09 Apr 2023
Generalization Matters: Loss Minima Flattening via Parameter Hybridization for Efficient Online Knowledge Distillation Tianli Zhang Mengqi Xue Jiangtao Zhang Haofei Zhang Yu Wang Lechao Cheng Jie Song Mingli Song 12 5 0 26 Mar 2023
EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoning Chenxin Xu R. Tan Yuhong Tan Siheng Chen Yu Wang Xinchao Wang Yanfeng Wang 19 96 0 20 Mar 2023
Partial Network Cloning Jingwen Ye Songhua Liu Xinchao Wang CLL 19 14 0 19 Mar 2023
Grounding 3D Object Affordance from 2D Interactions in Images Yuhang Yang Wei Zhai Hongcheng Luo Yang Cao Jiebo Luo Zhengjun Zha 16 31 0 18 Mar 2023
Schema Inference for Interpretable Image Classification Haofei Zhang Mengqi Xue Xiaokang Liu Kaixuan Chen Jie Song Mingli Song OCL 26 3 0 12 Mar 2023
DepGraph: Towards Any Structural Pruning Gongfan Fang Xinyin Ma Mingli Song Michael Bi Mi Xinchao Wang GNN 79 245 0 30 Jan 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models Sucheng Ren Fangyun Wei Zheng-Wei Zhang Han Hu 14 34 0 03 Jan 2023
Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networks Qihan Huang Mengqi Xue Wenqi Huang Haofei Zhang Jie Song Yongcheng Jing Mingli Song AAML 16 25 0 12 Dec 2022
Diffusion Probabilistic Model Made Slim Xingyi Yang Daquan Zhou Jiashi Feng Xinchao Wang DiffM 23 64 0 27 Nov 2022
Contrastive Identity-Aware Learning for Multi-Agent Value Decomposition Shunyu Liu Yihe Zhou Jie Song Tongya Zheng Kaixuan Chen Tongtian Zhu Zunlei Feng Mingli Song 14 15 0 23 Nov 2022