JFB: Jacobian-Free Backpropagation for Implicit Networks

23 March 2021

Stanley Osher

Papers citing "JFB: Jacobian-Free Backpropagation for Implicit Networks"

50 / 52 papers shown

Title
You Only Look One Step: Accelerating Backpropagation in Diffusion Sampling with Gradient Shortcuts Hongkun Dou Zeyu Li Xingyu Jiang H. Li Lijun Yang Wen Yao Yue Deng DiffM 30 0 0 12 May 2025
Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models Vineet Shenoy Suhas Lohit Hassan Mansour Rama Chellappa Tim K. Marks 39 0 0 21 Mar 2025
Fixed-Point RNNs: From Diagonal to Dense in a Few Iterations Sajad Movahedi Felix Sarnthein Nicola Muca Cirone Antonio Orvieto 46 2 0 13 Mar 2025
TomoSelfDEQ: Self-Supervised Deep Equilibrium Learning for Sparse-Angle CT Reconstruction T. Bubba Matteo Santacesaria Andrea Sebastiani OOD 33 0 0 28 Feb 2025
PRDP: Progressively Refined Differentiable Physics Kanishk Bhatia Felix Koehler Nils Thuerey AI4CE 54 0 0 26 Feb 2025
A Generalization Bound for a Family of Implicit Networks Samy Wu Fung Benjamin Berkels 33 0 0 28 Jan 2025
The Differentiable Feasibility Pump M. Cacciola Alexandre Forel A. Frangioni Andrea Lodi 24 0 0 05 Nov 2024
Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective Haixiang Sun Ye Shi 23 0 0 30 Oct 2024
Accelerating AI Performance using Anderson Extrapolation on GPUs Saleem Al Dajani David Keyes 18 0 0 25 Oct 2024
Differentiation Through Black-Box Quadratic Programming Solvers Connor W. Magoon Fengyu Yang Noam Aigerman Shahar Z. Kovalsky 20 0 0 08 Oct 2024
On Logical Extrapolation for Mazes with Recurrent and Implicit Networks Brandon Knutson Amandin Chyba Rabeendran Michael I. Ivanitskiy Jordan Pettyjohn Cecilia G. Diniz Behn Samy Wu Fung Daniel McKenzie LRM 29 2 0 03 Oct 2024
Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modeling Jinghan Li Zhicheng Sun Fei Li 77 1 0 02 Oct 2024
Constructing artificial life and materials scientists with accelerated AI using Deep AndersoNN Saleem Al Dajani David Keyes AI4CE 24 0 0 29 Jul 2024
The Extrapolation Power of Implicit Models Juliette Decugis Alicia Y. Tsai Max Emerling Ashwin Ganesh L. Ghaoui 21 0 0 19 Jul 2024
From Variance to Veracity: Unbundling and Mitigating Gradient Variance in Differentiable Bundle Adjustment Layers Swaminathan Gurumurthy Karnik Ram Bingqing Chen Zachary Manchester Zico Kolter 32 1 0 12 Jun 2024
Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks Matan Goren Eran Treister 30 0 0 27 May 2024
Deep Equilibrium Models are Almost Equivalent to Not-so-deep Explicit Models for High-dimensional Gaussian Mixtures Zenan Ling Longbo Li Zhanbo Feng Yixuan Zhang Feng Zhou Robert C. Qiu Zhenyu Liao 30 4 0 05 Feb 2024
Training Implicit Networks for Image Deblurring using Jacobian-Free Backpropagation Linghai Liu Shuaicheng Tong Lisa Zhao 8 1 0 03 Feb 2024
Fixed Point Diffusion Models Xingjian Bai Luke Melas-Kyriazi 13 3 0 16 Jan 2024
IDKM: Memory Efficient Neural Network Quantization via Implicit, Differentiable k-Means Sean Jaffe Ambuj K. Singh Francesco Bullo MQ 15 0 0 12 Dec 2023
Deep Equilibrium Based Neural Operators for Steady-State PDEs Tanya Marwah Ashwini Pokle J. Zico Kolter Zachary Chase Lipton Jianfeng Lu Andrej Risteski 20 7 0 30 Nov 2023
Making Scalable Meta Learning Practical Sang Keun Choe Sanket Vaibhav Mehta Hwijeen Ahn W. Neiswanger Pengtao Xie Emma Strubell Eric P. Xing 37 14 0 09 Oct 2023
Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks Ryuji Saiin Tomoya Shirakawa Sota Yoshihara Yoshihide Sawada Hiroyuki Kusumoto 20 1 0 04 Oct 2023
Federated Deep Equilibrium Learning: A Compact Shared Representation for Edge Communication Efficiency Long Tan Le Tuan Dung Nguyen Tung-Anh Nguyen Choong Seon Hong Nguyen H. Tran FedML 17 0 0 27 Sep 2023
Deep Equilibrium Object Detection Shuai Wang Yao Teng Limin Wang 26 5 0 18 Aug 2023
A Survey of Contextual Optimization Methods for Decision Making under Uncertainty Utsav Sadana A. Chenreddy Erick Delage Alexandre Forel Emma Frejinger Thibaut Vidal AI4CE 32 80 0 17 Jun 2023
Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamics Zonghan Yang Peng Li Tianyu Pang Yang Liu AAML 19 3 0 02 Jun 2023
Test like you Train in Implicit Deep Learning Zaccharie Ramzi Pierre Ablin Gabriel Peyré Thomas Moreau 24 3 0 24 May 2023
Efficient Training of Deep Equilibrium Models Bac Nguyen Cong Lukas Mauch 11 0 0 23 Apr 2023
Model-corrected learned primal-dual models for fast limited-view photoacoustic tomography A. Hauptmann Jenni Poimala MedIm 24 5 0 04 Apr 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li J. Yu Boyi Liu Zhaoran Wang Y. Nie 12 6 0 20 Feb 2023
Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis Zhu Wang Sourav Medya Sathya Ravi VLM 17 0 0 11 Feb 2023
Learning to Solve Integer Linear Programs with Davis-Yin Splitting Daniel McKenzie Samy Wu Fung Howard Heaton 27 4 0 31 Jan 2023
Unlocking Slot Attention by Changing Optimal Transport Costs Yan Zhang David W. Zhang Simon Lacoste-Julien Gertjan J. Burghouts Cees G. M. Snoek OCL 24 11 0 30 Jan 2023
Towards Vision Transformer Unrolling Fixed-Point Algorithm: a Case Study on Image Restoration Peng Qiao Sidun Liu Tao Sun Ke Yang Y. Dou ViT 18 1 0 29 Jan 2023
Lightweight and Flexible Deep Equilibrium Learning for CSI Feedback in FDD Massive MIMO Yifan Ma Wentao Yu Xianghao Yu Jun Zhang Shenghui Song Khaled B. Letaief 10 2 0 28 Nov 2022
A Neural-Network-Based Convex Regularizer for Inverse Problems Alexis Goujon Sebastian Neumayer Pakshal Bohra Stanislas Ducotterd M. Unser 11 26 0 22 Nov 2022
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 32 59 0 09 Oct 2022
Self-Supervised Deep Equilibrium Models for Inverse Problems with Theoretical Guarantees Weijie Gan Chunwei Ying Parna Eshraghi Tongyao Wang C. Eldeniz Yuyang Hu Jiaming Liu Yasheng Chen H. An Ulugbek S. Kamilov 19 4 0 07 Oct 2022
Alternating Differentiation for Optimization Layers Haixiang Sun Ye Shi Jingya Wang H. Tuan H. Vincent Poor Dacheng Tao ODL 29 14 0 03 Oct 2022
Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-training Risheng Liu Xuan Liu Shangzhi Zeng Jin Zhang Yixuan Zhang 22 6 0 16 Jun 2022
Learned reconstruction methods with convergence guarantees Subhadip Mukherjee A. Hauptmann Ozan Oktem Marcelo Pereyra Carola-Bibiane Schönlieb 17 50 0 11 Jun 2022
Online Deep Equilibrium Learning for Regularization by Denoising Jiaming Liu Xiaojian Xu Weijie Gan S. Shoushtari Ulugbek S. Kamilov 18 26 0 25 May 2022
Explainable AI via Learning to Optimize Howard Heaton Samy Wu Fung 13 14 0 29 Apr 2022
Representation Recycling for Streaming Video Analysis Can Ufuk Ertenli R. G. Cinbis Emre Akbas 8 1 0 28 Apr 2022
Continuous Deep Equilibrium Models: Training Neural ODEs faster by integrating them to Infinity Avik Pal Alan Edelman Chris Rackauckas 6 6 0 28 Jan 2022
AdaViT: Adaptive Tokens for Efficient Vision Transformer Hongxu Yin Arash Vahdat J. Álvarez Arun Mallya Jan Kautz Pavlo Molchanov ViT 14 229 0 14 Dec 2021
Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation Yan Zhang David W. Zhang Simon Lacoste-Julien Gertjan J. Burghouts Cees G. M. Snoek BDL 30 20 0 23 Nov 2021
Is Attention Better Than Matrix Decomposition? Zhengyang Geng Meng-Hao Guo Hongxu Chen Xia Li Ke Wei Zhouchen Lin 48 134 0 09 Sep 2021
Operator Splitting for Learning to Predict Equilibria in Convex Games Daniel McKenzie Howard Heaton Qiuwei Li Samy Wu Fung Stanley Osher Wotao Yin 14 0 0 02 Jun 2021