Hyperparameter Optimization for Large Language Model Instruction-Tuning

Hyperparameter Optimization for Large Language Model Instruction-Tuning

1 December 2023

Sacha Benarroch-Lelong

Papers citing "Hyperparameter Optimization for Large Language Model Instruction-Tuning"

10 / 10 papers shown

Title
Autonomous Radiotherapy Treatment Planning Using DOLA: A Privacy-Preserving, LLM-Based Optimization Agent Humza Nusrat Bing Luo Ryan Hall Joshua Kim H. Bagher-Ebadian Anthony Doemer B. Movsas Kundan Thind AI4CE 34 0 0 21 Mar 2025
Faster, Cheaper, Better: Multi-Objective Hyperparameter Optimization for LLM and RAG Systems Matthew Barker Andrew Bell Evan Thomas James Carr Thomas Andrews Umang Bhatt 80 1 0 25 Feb 2025
Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation Ayan Sengupta Vaibhav Seth Arinjay Pathak Natraj Raman Sriram Gopalakrishnan Tanmoy Chakraborty BDL 21 2 0 07 Nov 2024
An investigation on the use of Large Language Models for hyperparameter tuning in Evolutionary Algorithms Leonardo Lucio Custode Fabio Caraffini Anil Yaman Giovanni Iacca 35 2 0 05 Aug 2024
ABC Align: Large Language Model Alignment for Safety & Accuracy Gareth Seneque Lap-Hang Ho Peter W. Glynn Yinyu Ye Jeffrey Molendijk 31 1 0 01 Aug 2024
Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications Alon Halfon Shai Gretz Ofir Arviv Artem Spector Orith Toledo-Ronen Yoav Katz L. Ein-Dor Michal Shmueli-Scheuer Noam Slonim 27 2 0 25 Jul 2024
FunBO: Discovering Acquisition Functions for Bayesian Optimization with FunSearch Virginia Aglietti Ira Ktena Jessica Schrouff Eleni Sgouritsa Francisco J. R. Ruiz Alan Malek Alexis Bellot Silvia Chiappa 27 2 0 07 Jun 2024
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,881 0 04 Mar 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 205 1,654 0 15 Oct 2021
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 236 804 0 14 Oct 2021