A System for Massively Parallel Hyperparameter Tuning

13 October 2018

Benjamin Recht

Papers citing "A System for Massively Parallel Hyperparameter Tuning"

50 / 53 papers shown

Title
Learning and Transferring Physical Models through Derivatives Alessandro Trenta Andrea Cossu Davide Bacciu AI4CE 36 0 0 02 May 2025
HyperController: A Hyperparameter Controller for Fast and Stable Training of Reinforcement Learning Neural Networks J. Gornet Yiannis Kantaros Bruno Sinopoli 117 0 0 27 Apr 2025
A Model Zoo on Phase Transitions in Neural Networks Konstantin Schurholt Léo Meynent Yefan Zhou Haiquan Lu Yaoqing Yang Damian Borth 68 0 0 25 Apr 2025
Challenging reaction prediction models to generalize to novel chemistry John Bradshaw Anji Zhang Babak Mahjour David E. Graff Marwin H. S. Segler Connor W. Coley 40 1 0 11 Jan 2025
Specialized Foundation Models Struggle to Beat Supervised Baselines Zongzhe Xu Ritvik Gupta Wenduo Cheng Alexander Shen Junhong Shen Ameet Talwalkar M. Khodak AI4CE 48 6 0 05 Nov 2024
MoRe Fine-Tuning with 10x Fewer Parameters Wenxuan Tan Nicholas Roberts Tzu-Heng Huang Jitian Zhao John Cooper Samuel Guo Chengyu Duan Frederic Sala 29 0 0 30 Aug 2024
Harvesting Textual and Structured Data from the HAL Publication Repository Francis Kulumba Wissam Antoun Guillaume Vimont Laurent Romary 32 2 0 30 Jul 2024
Data Augmentation Policy Search for Long-Term Forecasting Liran Nochumsohn Omri Azencot AI4TS TPM 46 3 0 01 May 2024
Efficient Deterministic Renewable Energy Forecasting Guided by Multiple-Location Weather Data C. Symeonidis N. Nikolaidis 30 0 0 26 Apr 2024
In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization Herilalaina Rakotoarison Steven Adriaensen Neeratyoy Mallik Samir Garibov Eddie Bergman Frank Hutter AI4CE 32 9 0 25 Apr 2024
Tune without Validation: Searching for Learning Rate and Weight Decay on Training Sets Lorenzo Brigato S. Mougiakakou 34 0 0 08 Mar 2024
Transfer Learning of Semantic Segmentation Methods for Identifying Buried Archaeological Structures on LiDAR Data Gregory Sech Paolo Soleni Wouter B. Verschoof-van der Vaart vZiga Kokalj Arianna Traviglia M. Fiorucci 17 1 0 07 Jul 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 33 1 0 12 Jun 2023
Clover: Toward Sustainable AI with Carbon-Aware Machine Learning Inference Service Baolin Li S. Samsi V. Gadepally Devesh Tiwari 25 27 0 19 Apr 2023
CUDA: Curriculum of Data Augmentation for Long-Tailed Recognition Sumyeong Ahn Jongwoo Ko Se-Young Yun 31 30 0 10 Feb 2023
Deep learning enhanced noise spectroscopy of a spin qubit environment Stefano Martina S. Hernández-Gómez S. Gherardini Filippo Caruso N. Fabbri 14 8 0 12 Jan 2023
Rooms with Text: A Dataset for Overlaying Text Detection Oleg Smirnov Aditya Tewari 21 0 0 21 Nov 2022
Multi-step Planning for Automated Hyperparameter Optimization with OptFormer Lucio Dery A. Friesen Nando de Freitas MarcÁurelio Ranzato Yutian Chen 34 0 0 10 Oct 2022
Improving Multi-fidelity Optimization with a Recurring Learning Rate for Hyperparameter Tuning HyunJae Lee Gihyeon Lee Junh-Nam Kim Sungjun Cho Dohyun Kim Donggeun Yoo 26 3 0 26 Sep 2022
Tiered Pruning for Efficient Differentialble Inference-Aware Neural Architecture Search Slawomir Kierat Mateusz Sieniawski Denys Fridman Chendi Yu Szymon Migacz Pawel M. Morkisz A. Fit-Florea 3DPC 19 0 0 23 Sep 2022
T3VIP: Transformation-based 3D Video Prediction Iman Nematollahi Erick Rosete-Beas Seyed Mahdi B. Azad Raghunandan Rajan Frank Hutter Wolfram Burgard VGen 55 1 0 19 Sep 2022
Efficient Methods for Natural Language Processing: A Survey Marcos Vinícius Treviso Ji-Ung Lee Tianchu Ji Betty van Aken Qingqing Cao ... Emma Strubell Niranjan Balasubramanian Leon Derczynski Iryna Gurevych Roy Schwartz 28 109 0 31 Aug 2022
ACE: Adaptive Constraint-aware Early Stopping in Hyperparameter Optimization Yi-Wei Chen Chi Wang A. Saied Rui Zhuang 11 2 0 04 Aug 2022
Stable Invariant Models via Koopman Spectra Takuya Konishi Yoshinobu Kawahara 20 3 0 15 Jul 2022
Multi-Objective Hyperparameter Optimization in Machine Learning -- An Overview Florian Karl Tobias Pielok Julia Moosbauer Florian Pfisterer Stefan Coors ... Jakob Richter Michel Lang Eduardo C. Garrido-Merchán Juergen Branke B. Bischl AI4CE 26 56 0 15 Jun 2022
FuncPipe: A Pipelined Serverless Framework for Fast and Cost-efficient Training of Deep Learning Models Yunzhuo Liu Bo Jiang Tian Guo Zimeng Huang Wen-ping Ma Xinbing Wang Chenghu Zhou 19 9 0 28 Apr 2022
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer Greg Yang J. E. Hu Igor Babuschkin Szymon Sidor Xiaodong Liu David Farhi Nick Ryder J. Pachocki Weizhu Chen Jianfeng Gao 26 148 0 07 Mar 2022
Machine Learning for Particle Flow Reconstruction at CMS J. Pata Javier Mauricio Duarte Farouk Mokhtar Eric Wulff J. Yoo J. Vlimant M. Pierini M. Girone 39 24 0 01 Mar 2022
Combined Pruning for Nested Cross-Validation to Accelerate Automated Hyperparameter Optimization for Embedded Feature Selection in High-Dimensional Data with Very Small Sample Sizes Sigrun May Sven Hartmann F. Klawonn 9 1 0 01 Feb 2022
Performance Analysis of Electrical Machines Using a Hybrid Data- and Physics-Driven Model Vivek Parekh D. Flore S. Schöps AI4CE 27 6 0 24 Jan 2022
Self-attention Presents Low-dimensional Knowledge Graph Embeddings for Link Prediction Peyman Baghershahi Reshad Hosseini H. Moradi 26 52 0 20 Dec 2021
Advances in Neural Rendering A. Tewari Justus Thies B. Mildenhall P. Srinivasan E. Tretschk ... S. Fanello J. Zhu Gordon Wetzstein Michael Zollhoefer D. B. Goldman 3DH AI4CE 48 444 0 10 Nov 2021
Automated Hyperparameter Optimization Challenge at CIKM 2021 AnalyticCup Huaijun Jiang Yu Shen Yang Li 14 4 0 31 Oct 2021
Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation Ross M. Clarke E. T. Oldewage José Miguel Hernández-Lobato 26 9 0 20 Oct 2021
Hydra: A System for Large Multi-Model Deep Learning Kabir Nagrecha Arun Kumar MoE AI4CE 38 5 0 16 Oct 2021
A Strong Baseline for the VIPriors Data-Efficient Image Classification Challenge Björn Barz Lorenzo Brigato Luca Iocchi Joachim Denzler VLM 22 2 0 28 Sep 2021
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO Katharina Eggensperger Philip Muller Neeratyoy Mallik Matthias Feurer René Sass Aaron Klein Noor H. Awad Marius Lindauer Frank Hutter 46 100 0 14 Sep 2021
Tune It or Don't Use It: Benchmarking Data-Efficient Image Classification Lorenzo Brigato Björn Barz Luca Iocchi Joachim Denzler 30 16 0 30 Aug 2021
RetroGAN: A Cyclic Post-Specialization System for Improving Out-of-Knowledge and Rare Word Representations Pedro Colon-Hernandez Yida Xin H. Lieberman Catherine Havasi C. Breazeal Peter Chin GAN KELM 16 2 0 30 Aug 2021
WikiChurches: A Fine-Grained Dataset of Architectural Styles with Real-World Challenges Björn Barz Joachim Denzler 36 7 0 16 Aug 2021
HyperJump: Accelerating HyperBand via Risk Modelling Pedro Mendes Maria Casimiro Paolo Romano David Garlan 18 7 0 05 Aug 2021
The Benchmark Lottery Mostafa Dehghani Yi Tay A. Gritsenko Zhe Zhao N. Houlsby Fernando Diaz Donald Metzler Oriol Vinyals 39 89 0 14 Jul 2021
A Neural Edge-Editing Approach for Document-Level Relation Graph Extraction Kohei Makino Makoto Miwa Yutaka Sasaki KELM 24 7 0 18 Jun 2021
COLD: Concurrent Loads Disaggregator for Non-Intrusive Load Monitoring I. Kamyshev Dmitrii Kriukov E. Gryazina Elena Gryazina Henni Ouerdane 19 8 0 04 Jun 2021
Non-Autoregressive vs Autoregressive Neural Networks for System Identification Daniel Weber C. Gühmann 19 7 0 05 May 2021
Bag of Baselines for Multi-objective Joint Neural Architecture Search and Hyperparameter Optimization Julia Guerrero-Viu Sven Hauns Sergio Izquierdo Guilherme Miotto Simon Schrodi André Biedenkapp T. Elsken Difan Deng Marius Lindauer Frank Hutter AI4CE 17 25 0 03 May 2021
RIANN -- A Robust Neural Network Outperforms Attitude Estimation Filters Daniel Weber C. Gühmann Thomas Seel 12 35 0 15 Apr 2021
An Asymptotically Optimal Multi-Armed Bandit Algorithm and Hyperparameter Optimization Yimin Huang Yujun Li Hanrong Ye Zhenguo Li Zhihua Zhang 22 7 0 11 Jul 2020
GAMA: a General Automated Machine learning Assistant Pieter Gijsbers Joaquin Vanschoren 28 27 0 09 Jul 2020
Sherpa: Robust Hyperparameter Optimization for Machine Learning L. Hertel Julian Collado Peter Sadowski J. Ott Pierre Baldi 86 103 0 08 May 2020