Sobolev Training for Neural Networks

15 June 2017

Wojciech M. Czarnecki

Papers citing "Sobolev Training for Neural Networks"

44 / 44 papers shown

Title
Sensitivity-Constrained Fourier Neural Operators for Forward and Inverse Problems in Parametric Differential Equations Abdolmehdi Behroozi Chaopeng Shen and Daniel Kifer AI4CE 20 0 0 13 May 2025
Learning and Transferring Physical Models through Derivatives Alessandro Trenta Andrea Cossu Davide Bacciu AI4CE 34 0 0 02 May 2025
Reliable and Efficient Inverse Analysis using Physics-Informed Neural Networks with Distance Functions and Adaptive Weight Tuning Shota Deguchi Mitsuteru Asai PINN AI4CE 81 0 0 25 Apr 2025
EquiNO: A Physics-Informed Neural Operator for Multiscale Simulations Hamidreza Eivazi Jendrik-Alexander Tröger Stefan H. A. Wittek Stefan Hartmann Andreas Rausch AI4CE 41 0 0 27 Mar 2025
Gradient Networks Shreyas Chaudhari Srinivasa Pranav J. M. F. Moura 50 0 0 28 Jan 2025
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 38 2 0 02 Oct 2024
JacNet: Learning Functions with Structured Jacobians Jonathan Lorraine Safwan Hossain 40 6 0 23 Aug 2024
Distilling System 2 into System 1 Ping Yu Jing Xu Jason Weston Ilia Kulikov OffRL LRM 47 56 0 08 Jul 2024
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models Josip Jukić Jan Snajder 29 0 0 31 Mar 2024
Grappa -- A Machine Learned Molecular Mechanics Force Field Leif Seute Eric Hartmann Jan Stühmer Frauke Gräter 27 3 0 25 Mar 2024
Physics-Informed Diffusion Models Jan-Hendrik Bastek WaiChing Sun D. Kochmann DiffM AI4CE 47 10 0 21 Mar 2024
Towards Sobolev Pruning Neil Kichler Sher Afghan U. Naumann 13 0 0 06 Dec 2023
Indirect Gradient Matching for Adversarial Robust Distillation Hongsin Lee Seungju Cho Changick Kim AAML FedML 48 2 0 06 Dec 2023
Nearly Optimal VC-Dimension and Pseudo-Dimension Bounds for Deep Neural Network Derivatives Yahong Yang Haizhao Yang Yang Xiang 19 19 0 15 May 2023
Learning with Explanation Constraints Rattana Pukdee Dylan Sam J. Zico Kolter Maria-Florina Balcan Pradeep Ravikumar FAtt 29 6 0 25 Mar 2023
Fourier Sensitivity and Regularization of Computer Vision Models K. Krishnamachari See-Kiong Ng Chuan-Sheng Foo OOD 20 2 0 31 Jan 2023
Continuous Spatiotemporal Transformers Antonio H. O. Fonseca E. Zappala J. O. Caro David van Dijk 18 7 0 31 Jan 2023
Smooth Mathematical Function from Compact Neural Networks I. K. Hong 21 0 0 31 Dec 2022
CACTO: Continuous Actor-Critic with Trajectory Optimization -- Towards global optimality Gianluigi Grandesso Elisa Alboni G. P. R. Papini Patrick M. Wensing Andrea Del Prete 8 15 0 12 Nov 2022
Derivative-Informed Neural Operator: An Efficient Framework for High-Dimensional Parametric Derivative Learning Thomas O'Leary-Roseberry Peng Chen Umberto Villa Omar Ghattas AI4CE 24 39 0 21 Jun 2022
Standalone Neural ODEs with Sensitivity Analysis Rym Jaroudi Lukáš Malý Gabriel Eilertsen B. Johansson Jonas Unger George Baravdish 21 0 0 27 May 2022
Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient Descent Yiping Lu Jose H. Blanchet Lexing Ying 30 7 0 15 May 2022
Automated differential equation solver based on the parametric approximation optimization A. Hvatov Tatiana Tikhonova 8 4 0 11 May 2022
Generalized Knowledge Distillation via Relationship Matching Han-Jia Ye Su Lu De-Chuan Zhan FedML 22 20 0 04 May 2022
Physics-informed neural networks for modeling rate- and temperature-dependent plasticity Rajat Arora P. Kakkar Biswadip Dey Amit Chakraborty PINN AI4CE 36 19 0 20 Jan 2022
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image Yuki M. Asano Aaqib Saeed 24 7 0 01 Dec 2021
Input Convex Gradient Networks Jack Richter-Powell Jonathan Lorraine Brandon Amos 10 15 0 23 Nov 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 34 36 0 27 Oct 2021
Multi-Objective Loss Balancing for Physics-Informed Deep Learning Rafael Bischof M. Kraus PINN AI4CE 20 92 0 19 Oct 2021
Prune Your Model Before Distill It Jinhyuk Park Albert No VLM 38 27 0 30 Sep 2021
Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networks S. Maddu D. Sturm Christian L. Müller I. Sbalzarini AI4CE 13 80 0 02 Jul 2021
Sobolev training of thermodynamic-informed neural networks for smoothed elasto-plasticity models with level set hardening Nikolaos N. Vlassis WaiChing Sun AI4CE 14 2 0 15 Oct 2020
Explicit Regularisation in Gaussian Noise Injections A. Camuto M. Willetts Umut Simsekli Stephen J. Roberts Chris Holmes 8 55 0 14 Jul 2020
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay Iacopo Poli Franccois Boniface Florent Krzakala 25 62 0 23 Jun 2020
Understanding and Improving Knowledge Distillation Jiaxi Tang Rakesh Shivanna Zhe Zhao Dong Lin Anima Singh Ed H. Chi Sagar Jain 6 129 0 10 Feb 2020
Deep Semantic Segmentation of Natural and Medical Images: A Review Saeid Asgari Taghanaki Kumar Abhishek Joseph Paul Cohen Julien Cohen-Adad Ghassan Hamarneh SSeg VLM 31 666 0 16 Oct 2019
Distilled Siamese Networks for Visual Tracking Jianbing Shen Yuanpei Liu Xingping Dong Xiankai Lu F. Khan S. Hoi 11 101 0 24 Jul 2019
Principled Training of Neural Networks with Direct Feedback Alignment Julien Launay Iacopo Poli Florent Krzakala 11 35 0 11 Jun 2019
Efficient Entropy for Policy Gradient with Multidimensional Action Space Yiming Zhang Q. Vuong Kenny Song Xiao-Yue Gong Keith Ross 17 16 0 02 Jun 2018
Born Again Neural Networks Tommaso Furlanello Zachary Chase Lipton Michael Tschannen Laurent Itti Anima Anandkumar 8 1,020 0 12 May 2018
Local Critic Training of Deep Neural Networks Hojung Lee Jong-Seok Lee 15 8 0 03 May 2018
Gradient Regularization Improves Accuracy of Discriminative Models D. Varga Adrián Csiszárik Zsolt Zombori 16 53 0 28 Dec 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 20 9,583 0 25 Oct 2017
DarkRank: Accelerating Deep Metric Learning via Cross Sample Similarities Transfer Yuntao Chen Naiyan Wang Zhaoxiang Zhang FedML 39 217 0 05 Jul 2017