Title
SlotLifter: Slot-guided Feature Lifting for Learning Object-centric Radiance Fields Yu Liu Baoxiong Jia Yixin Chen Siyuan Huang OCL 31 4 0 13 Aug 2024
QADQN: Quantum Attention Deep Q-Network for Financial Market Prediction Siddhant Dutta Nouhaila Innan Alberto Marchisio Sadok Ben Yahia Muhammad Shafique AIFin 36 5 0 06 Aug 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 72 1 0 30 Jul 2024
FedPartWhole: Federated domain generalization via consistent part-whole hierarchies Ahmed Radwan Mohamed S. Shehata FedML 27 0 0 20 Jul 2024
Questionable practices in machine learning Gavin Leech Juan J. Vazquez Misha Yagudin Niclas Kupper Laurence Aitchison 42 3 0 17 Jul 2024
Deconstructing What Makes a Good Optimizer for Language Models Rosie Zhao Depen Morwani David Brandfonbrener Nikhil Vyas Sham Kakade 42 17 0 10 Jul 2024
Latent Space Imaging Matheus Souza Yidan Zheng Kaizhang Kang Yogeshwar Nath Mishra Qiang Fu Wolfgang Heidrich 48 0 0 09 Jul 2024
Can Learned Optimization Make Reinforcement Learning Less Difficult? Alexander David Goldie Chris Xiaoxuan Lu Matthew Jackson Shimon Whiteson Jakob N. Foerster 40 3 0 09 Jul 2024
FastCLIP: A Suite of Optimization Techniques to Accelerate CLIP Training with Limited Resources Xiyuan Wei Fanjiang Ye Ori Yonay Xingyu Chen Baixi Sun Dingwen Tao Tianbao Yang VLM CLIP 46 2 0 01 Jul 2024
Semantic-guided Adversarial Diffusion Model for Self-supervised Shadow Removal Ziqi Zeng Chen Zhao Weiling Cai Chenyu Dong DiffM 36 4 0 01 Jul 2024
A Deep Generative Framework for Joint Households and Individuals Population Synthesis Xiao Qian Utkarsh Gangwal Shangjia Dong Rachel Davidson 39 1 0 30 Jun 2024
BADM: Batch ADMM for Deep Learning Ouya Wang Shenglong Zhou Geoffrey Ye Li ODL 37 1 0 30 Jun 2024
Adam-mini: Use Fewer Learning Rates To Gain More Yushun Zhang Congliang Chen Ziniu Li Tian Ding Chenwei Wu Yinyu Ye Zhi-Quan Luo Ruoyu Sun 34 33 0 24 Jun 2024
UNICAD: A Unified Approach for Attack Detection, Noise Reduction and Novel Class Identification Alvaro Lopez Pellicer Kittipos Giatgong Yi Li N. Suri Plamen Angelov AAML 18 3 0 24 Jun 2024
The Implicit Bias of Adam on Separable Data Chenyang Zhang Difan Zou Yuan Cao AI4CE 35 7 0 15 Jun 2024
Grad-Instructor: Universal Backpropagation with Explainable Evaluation Neural Networks for Meta-learning and AutoML Ryohei Ino UQCV 18 0 0 15 Jun 2024
H-Fac: Memory-Efficient Optimization with Factorized Hamiltonian Descent Son Nguyen Lizhang Chen Bo Liu Qiang Liu 20 3 0 14 Jun 2024
Improving Consistency Models with Generator-Augmented Flows Thibaut Issenhuth Sangchul Lee Jean-Yves Franceschi Jean-Yves Franceschi Chansoo Kim Alain Rakotomamonjy 22 0 0 13 Jun 2024
Discovering Preference Optimization Algorithms with and for Large Language Models Chris Xiaoxuan Lu Samuel Holt Claudio Fanconi Alex J. Chan Jakob Foerster M. Schaar R. T. Lange OffRL 32 14 0 12 Jun 2024
Does your data spark joy? Performance gains from domain upsampling at the end of training Cody Blakeney Mansheej Paul Brett W. Larsen Sean Owen Jonathan Frankle 21 19 0 05 Jun 2024
Position: A Call to Action for a Human-Centered AutoML Paradigm Marius Lindauer Florian Karl A. Klier Julia Moosbauer Alexander Tornede Andreas Mueller Frank Hutter Matthias Feurer Bernd Bischl 36 6 0 05 Jun 2024
Astral: training physics-informed neural networks with error majorants V. Fanaskov Tianchi Yu Alexander Rudikov Ivan V. Oseledets 33 1 0 04 Jun 2024
Improving Text Generation on Images with Synthetic Captions Jun Young Koh Sang Hyun Park Joy Song DiffM 46 2 0 01 Jun 2024
Improving Generalization and Convergence by Enhancing Implicit Regularization Mingze Wang Haotian He Jinbo Wang Zilin Wang Guanhua Huang Feiyu Xiong Zhiyu Li E. Weinan Lei Wu 37 6 0 31 May 2024
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models Zachary Ankner Cody Blakeney Kartik K. Sreenivasan Max Marion Matthew L. Leavitt Mansheej Paul 35 23 0 30 May 2024
Stress-Testing Capability Elicitation With Password-Locked Models Ryan Greenblatt Fabien Roger Dmitrii Krasheninnikov David M. Krueger 30 13 0 29 May 2024
AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien Martins Gomes Yanlei Zhang Eugene Belilovsky Guy Wolf Mahdi S. Hosseini ODL 74 2 0 26 May 2024
Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling Shuaipeng Li Penghao Zhao Hailin Zhang Xingwu Sun Hao Wu ... Zheng Fang Jinbao Xue Yangyu Tao Bin Cui Di Wang 14 6 0 23 May 2024
How to set AdamW's weight decay as you scale model and dataset size Xi Wang Laurence Aitchison 38 9 0 22 May 2024
Self-supervised vision-langage alignment of deep learning representations for bone X-rays analysis A. Englebert Anne-Sophie Collin O. Cornu Christophe De Vleeschouwer 27 1 0 14 May 2024
Learned feature representations are biased by complexity, learning order, position, and more Andrew Kyle Lampinen Stephanie C. Y. Chan Katherine Hermann AI4CE FaML SSL OOD 32 6 0 09 May 2024
Multi-Level Feature Fusion Network for Lightweight Stereo Image Super-Resolution Yunxiang Li Wenbin Zou Qiaomu Wei Feng Huang Jing Wu 32 1 0 09 May 2024
Towards Stability of Parameter-free Optimization Yijiang Pang Shuyang Yu Hoang Bao Jiayu Zhou 29 1 0 07 May 2024
Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimization S. Reifenstein T. Leleu Yoshihisa Yamamoto 35 1 0 02 May 2024
Expanding the Horizon: Enabling Hybrid Quantum Transfer Learning for Long-Tailed Chest X-Ray Classification Skylar Chan Pranav Kulkarni P. Yi Vishwa S. Parekh 26 0 0 30 Apr 2024
CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data Sachin Mehta Maxwell Horton Fartash Faghri Mohammad Hossein Sekhavat Mahyar Najibi Mehrdad Farajtabar Oncel Tuzel Mohammad Rastegari VLM CLIP 36 6 0 24 Apr 2024
Masked Autoencoders for Microscopy are Scalable Learners of Cellular Biology Oren Z. Kraus Kian Kenyon-Dean Saber Saberian Maryam Fallah Peter McLean ... Chi Vicky Cheng Kristen Morse Maureen Makes Ben Mabey Berton A. Earnshaw 32 26 0 16 Apr 2024
Monte Carlo Search Algorithms Discovering Monte Carlo Tree Search Exploration Terms Tristan Cazenave 24 0 0 14 Apr 2024
Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data Kai Luan Chenghao Shi Neng Wang Yuwei Cheng Huimin Lu Xieyuanli Chen 24 5 0 09 Apr 2024
$Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization$ Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization Shuo Xie Zhiyuan Li OffRL 27 12 0 05 Apr 2024
Improving Bird's Eye View Semantic Segmentation by Task Decomposition Tianhao Zhao Yongcan Chen Yu-Huan Wu Tianyang Liu Bo Du ... Shi Qiu Hongda Yang Guozhen Li Yi Yang Yutian Lin 41 6 0 02 Apr 2024
Communication Efficient Distributed Training with Distributed Lion Bo Liu Lemeng Wu Lizhang Chen Kaizhao Liang Jiaxu Zhu Chen Liang Raghuraman Krishnamoorthi Qiang Liu 32 6 0 30 Mar 2024
SEVEN: Pruning Transformer Model by Reserving Sentinels Jinying Xiao Ping Li Jie Nie Zhe Tang 31 3 0 19 Mar 2024
Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal Yijun Yang Hongtao Wu Angelica I. Aviles-Rivero Yulun Zhang Jing Qin Lei Zhu 29 8 0 12 Mar 2024
Pretrained Visual Uncertainties Michael Kirchhof Mark Collier Seong Joon Oh Enkelejda Kasneci UQCV 392 8 1 26 Feb 2024
Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operators Benedikt Alkin Andreas Fürst Simon Schmid Lukas Gruber Markus Holzleitner Johannes Brandstetter PINN AI4CE 40 8 0 19 Feb 2024
FedLion: Faster Adaptive Federated Optimization with Fewer Communication Zhiwei Tang Tsung-Hui Chang 29 5 0 15 Feb 2024
Efficient Stagewise Pretraining via Progressive Subnetworks Abhishek Panigrahi Nikunj Saunshi Kaifeng Lyu Sobhan Miryoosefi Sashank J. Reddi Satyen Kale Sanjiv Kumar 30 5 0 08 Feb 2024
Let Your Graph Do the Talking: Encoding Structured Data for LLMs Bryan Perozzi Bahare Fatemi Dustin Zelle Anton Tsitsulin Mehran Kazemi Rami Al-Rfou Jonathan J. Halcrow GNN 30 55 0 08 Feb 2024
Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective Wu Lin Felix Dangel Runa Eschenhagen Juhan Bae Richard E. Turner Alireza Makhzani ODL 46 12 0 05 Feb 2024