Faster Convergence for Transformer Fine-tuning with Line Search Methods

27 March 2024

Barbara Hammer

Papers citing "Faster Convergence for Transformer Fine-tuning with Line Search Methods"

2 / 2 papers shown

Title
No learning rates needed: Introducing SALSA -- Stable Armijo Line Search Adaptation Philip Kenneweg Tristan Kenneweg Fabian Fumagalli Barbara Hammer ODL 178 0 0 30 Jul 2024
Improving Line Search Methods for Large Scale Neural Network Training Philip Kenneweg Tristan Kenneweg Barbara Hammer ODL 176 3 0 27 Mar 2024