AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Risks

13 June 2023

Daphne Theodorakopoulos

Papers citing "AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Risks"

37 / 37 papers shown

Title
AgentRxiv: Towards Collaborative Autonomous Research Samuel Schmidgall Michael Moor 56 3 0 23 Mar 2025
MLGym: A New Framework and Benchmark for Advancing AI Research Agents Deepak Nathani Lovish Madaan Nicholas Roberts Nikolay Bashlykov Ajay Menon ... Tatiana Shavrina Jakob Foerster Yoram Bachrach William Yang Wang Roberta Raileanu LLMAG 78 7 0 21 Feb 2025
Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data Zhiqiang Tang Zihan Zhong Tong He Gerald Friedland 73 0 0 19 Dec 2024
A Review on Generative AI Models for Synthetic Medical Text, Time Series, and Longitudinal Data Mohammad Loni Fatemeh Poursalim Mehdi Asadi Arash Gharehbaghi SyDa 68 0 0 19 Nov 2024
Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey Yang Gu Hengyu You Jian Cao Muran Yu Haoran Fan Shiyou Qian LM&MA AI4CE 42 3 0 11 Nov 2024
Position: A Call to Action for a Human-Centered AutoML Paradigm Marius Lindauer Florian Karl A. Klier Julia Moosbauer Alexander Tornede Andreas Mueller Frank Hutter Matthias Feurer Bernd Bischl 31 5 0 05 Jun 2024
Large Language Models Synergize with Automated Machine Learning Jinglue Xu Jialong Li Zhen Liu Nagar Anthel Venkatesh Suryanarayanan Guoyuan Zhou Jia Guo Hitoshi Iba Kenji Tei 33 4 0 06 May 2024
Data augmentation with automated machine learning: approaches and performance comparison with classical data augmentation methods A. Mumuni F. Mumuni 53 4 0 13 Mar 2024
Large Language Models to Enhance Bayesian Optimization Tennison Liu Nicolás Astorga Nabeel Seedat M. Schaar 58 44 0 06 Feb 2024
Large Language Model Agent for Hyper-Parameter Optimization Siyi Liu Chen Gao Yong Li 37 18 0 02 Feb 2024
Security and Privacy Challenges of Large Language Models: A Survey B. Das M. H. Amini Yanzhao Wu PILM ELM 17 98 0 30 Jan 2024
LLM4PLC: Harnessing Large Language Models for Verifiable Programming of PLCs in Industrial Control Systems Mohamad Fakih Rahul Dharmaji Yasamin Moghaddas Gustavo Quiros Araya O. Ogundare Mohammad Abdullah Al Faruque 11 15 0 08 Jan 2024
Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems Xupeng Miao Gabriele Oliaro Zhihao Zhang Xinhao Cheng Hongyi Jin Tianqi Chen Zhihao Jia 53 75 0 23 Dec 2023
Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representation Xingyu Wu Yan Zhong Jibin Wu Bingbing Jiang Kay Chen Tan 25 5 0 22 Nov 2023
QualEval: Qualitative Evaluation for Model Improvement Vishvak Murahari A. Deshpande Peter Clark Tanmay Rajpurohit Ashish Sabharwal Karthik Narasimhan A. Kalyan 19 4 0 06 Nov 2023
Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks Po-Nien Kung Fan Yin Di Wu Kai-Wei Chang Nanyun Peng 65 39 0 01 Nov 2023
Unleashing the Power of Graph Learning through LLM-based Autonomous Agents Lanning Wei Zhiqiang He Huan Zhao Quanming Yao LLMAG 20 1 0 08 Sep 2023
Sparks of Large Audio Models: A Survey and Outlook S. Latif Moazzam Shoukat Fahad Shamshad Muhammad Usama Yi Ren ... Wenwu Wang Xulong Zhang Roberto Togneri Erik Cambria Björn W. Schuller LM&MA AuLLM 27 36 0 24 Aug 2023
AutoGluon-TimeSeries: AutoML for Probabilistic Time Series Forecasting Oleksandr Shchur Caner Turkmen Nick Erickson Huibin Shen Alexander Shirkov Tony Hu Bernie Wang BDL AI4TS 18 23 0 10 Aug 2023
AutoML-GPT: Automatic Machine Learning with GPT Shujian Zhang Chengyue Gong Lemeng Wu Xingchao Liu Mi Zhou LLMAG 52 59 0 04 May 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes Lokesh Nagalapatti Chun-Liang Li Chih-Kuan Yeh Hootan Nakhost Yasuhisa Fujii Alexander Ratner Ranjay Krishna Chen-Yu Lee Tomas Pfister ALM 204 498 0 03 May 2023
Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation Patrick Fernandes Aman Madaan Emmy Liu António Farinhas Pedro Henrique Martins ... José G. C. de Souza Shuyan Zhou Tongshuang Wu Graham Neubig André F. T. Martins ALM 113 56 0 01 May 2023
Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML Hilde J. P. Weerts Florian Pfisterer Matthias Feurer Katharina Eggensperger Eddie Bergman Noor H. Awad Joaquin Vanschoren Mykola Pechenizkiy B. Bischl Frank Hutter FaML 31 17 0 15 Mar 2023
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey Sachin Kumar Vidhisha Balachandran Lucille Njoo Antonios Anastasopoulos Yulia Tsvetkov ELM 61 84 0 14 Oct 2022
Improving alignment of dialogue agents via targeted human judgements Amelia Glaese Nat McAleese Maja Trkebacz John Aslanides Vlad Firoiu ... John F. J. Mellor Demis Hassabis Koray Kavukcuoglu Lisa Anne Hendricks G. Irving ALM AAML 225 495 0 28 Sep 2022
Explaining Hyperparameter Optimization via Partial Dependence Plots Julia Moosbauer J. Herbinger Giuseppe Casalicchio Marius Lindauer Bernd Bischl 36 56 0 08 Nov 2021
A comprehensive review of Binary Neural Network Chunyu Yuan S. Agaian MQ 37 94 0 11 Oct 2021
SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization Marius Lindauer Katharina Eggensperger Matthias Feurer André Biedenkapp Difan Deng C. Benjamins Tim Ruhopf René Sass Frank Hutter 83 323 0 20 Sep 2021
Primer: Searching for Efficient Transformers for Language Modeling David R. So Wojciech Mañke Hanxiao Liu Zihang Dai Noam M. Shazeer Quoc V. Le VLM 83 149 0 17 Sep 2021
Hyperparameter Optimization: Foundations, Algorithms, Best Practices and Open Challenges B. Bischl Martin Binder Michel Lang Tobias Pielok Jakob Richter ... Theresa Ullmann Marc Becker A. Boulesteix Difan Deng Marius Lindauer 77 443 0 13 Jul 2021
Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP Timo Schick Sahana Udupa Hinrich Schütze 257 374 0 28 Feb 2021
AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data Nick Erickson Jonas W. Mueller Alexander Shirkov Hang Zhang Pedro Larroy Mu Li Alex Smola LMTD 84 576 0 13 Mar 2020
Provably Efficient Online Hyperparameter Optimization with Population-Based Bandits Jack Parker-Holder Vu Nguyen Stephen J. Roberts OffRL 62 82 0 06 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 223 4,424 0 23 Jan 2020
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,791 0 17 Sep 2019
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT Sheng Shen Zhen Dong Jiayu Ye Linjian Ma Z. Yao A. Gholami Michael W. Mahoney Kurt Keutzer MQ 217 571 0 12 Sep 2019
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 112 404 0 06 Mar 2017