AutoML-Zero: Evolving Machine Learning Algorithms From Scratch

6 March 2020

Papers citing "AutoML-Zero: Evolving Machine Learning Algorithms From Scratch"

50 / 118 papers shown

Title
From Understanding to Excelling: Template-Free Algorithm Design through Structural-Functional Co-Evolution Zhe Zhao Haibin Wen P. Wang Ye Wei Zaixi Zhang ... Fei Liu Bo An Hui Xiong Yang Wang Qingfu Zhang 55 0 0 13 Mar 2025
Online Meta-learning for AutoML in Real-time (OnMAR) Mia Gerber Anna Sergeevna Bosman J. D. Villiers OffRL 34 0 0 27 Feb 2025
Lightweight Design and Optimization methods for DCNNs: Progress and Futures Hanhua Long Wenbin Bi Jian Sun 75 0 0 22 Dec 2024
Predicting from Strings: Language Model Embeddings for Bayesian Optimization Tung Nguyen Qiuyi Zhang Bangding Yang Chansoo Lee J. Bornschein Yingjie Miao Sagi Perel Yutian Chen Xingyou Song BDL 26 3 0 14 Oct 2024
LPZero: Language Model Zero-cost Proxy Search from Zero Peijie Dong Lujun Li Xiang Liu Zhenheng Tang Xuebo Liu Qiang Wang Xiaowen Chu 101 2 0 07 Oct 2024
Position: A Call to Action for a Human-Centered AutoML Paradigm Marius Lindauer Florian Karl A. Klier Julia Moosbauer Alexander Tornede Andreas Mueller Frank Hutter Matthias Feurer Bernd Bischl 36 6 0 05 Jun 2024
Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for Large Language Models Peijie Dong Lujun Li Zhenheng Tang Xiang Liu Xinglin Pan Qiang-qiang Wang Xiaowen Chu 58 23 0 05 Jun 2024
Evolutionary Computation for the Design and Enrichment of General-Purpose Artificial Intelligence Systems: Survey and Prospects Javier Poyatos Javier Del Ser Salvador Garcia H. Ishibuchi Daniel Molina I. Triguero Bing Xue Xin Yao Francisco Herrera 38 1 0 03 Jun 2024
einspace: Searching for Neural Architectures from Fundamental Operations Linus Ericsson Miguel Espinosa Chenhongyi Yang Antreas Antoniou Amos Storkey Shay B. Cohen Steven G. McDonagh Elliot J. Crowley 38 1 0 31 May 2024
Position: Leverage Foundational Models for Black-Box Optimization Xingyou Song Yingtao Tian Robert Tjarko Lange Chansoo Lee Yujin Tang Yutian Chen 38 5 0 06 May 2024
Large Language Models Synergize with Automated Machine Learning Jinglue Xu Jialong Li Zhen Liu Nagar Anthel Venkatesh Suryanarayanan Guoyuan Zhou Jia Guo Hitoshi Iba Kenji Tei 38 4 0 06 May 2024
Next Generation Loss Function for Image Classification S. Akhmedova Nils Körber VLM 19 2 0 19 Apr 2024
Fast and Efficient Local Search for Genetic Programming Based Loss Function Learning Christian Raymond Qi Chen Bing Xue Mengjie Zhang 27 2 0 01 Mar 2024
Program-Based Strategy Induction for Reinforcement Learning Carlos G. Correa Thomas L. Griffiths Nathaniel D. Daw 27 1 0 26 Feb 2024
Neuron-centric Hebbian Learning Andrea Ferigo Elia Cunegatti Giovanni Iacca 29 0 0 16 Feb 2024
Guided Evolution with Binary Discriminators for ML Program Search John D. Co-Reyes Yingjie Miao George Tucker Aleksandra Faust Esteban Real 31 0 0 08 Feb 2024
tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs) Junhua Zeng Chao Li Zhun Sun Qibin Zhao Guoxu Zhou 32 4 0 04 Feb 2024
ParZC: Parametric Zero-Cost Proxies for Efficient NAS Peijie Dong Lujun Li Xinglin Pan Zimian Wei Xiang Liu Qiang-qiang Wang Xiaowen Chu 50 3 0 03 Feb 2024
L-AutoDA: Leveraging Large Language Models for Automated Decision-based Adversarial Attacks Ping Guo Fei Liu Xi Lin Qingchuan Zhao Qingfu Zhang 20 0 0 27 Jan 2024
MADA: Meta-Adaptive Optimizers through hyper-gradient Descent Kaan Ozkara Can Karakus Parameswaran Raman Mingyi Hong Shoham Sabach B. Kveton V. Cevher 19 2 0 17 Jan 2024
Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery Zimian Wei Lujun Li Peijie Dong Zheng Hui Anggeng Li Menglong Lu H. Pan Zhiliang Tian Dongsheng Li ViT 37 16 0 14 Dec 2023
AutoNumerics-Zero: Automated Discovery of State-of-the-Art Mathematical Functions Esteban Real Yao Chen Mirko Rossini Connal de Souza Manav Garg Akhil Verghese Moritz Firsching Quoc V. Le E. D. Cubuk David H. Park 11 1 0 13 Dec 2023
Ever Evolving Evaluator (EV3): Towards Flexible and Reliable Meta-Optimization for Knowledge Distillation Li Ding M. Zoghi Guy Tennenholtz Maryam Karimzadehgan 16 0 0 29 Oct 2023
GEVO-ML: Optimizing Machine Learning Code with Evolutionary Computation Jhe-Yu Liou Stephanie Forrest Carole-Jean Wu VLM 11 0 0 16 Oct 2023
Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts Lizhang Chen Bo Liu Kaizhao Liang Qian Liu ODL 19 15 0 09 Oct 2023
Distributed Evolution Strategies with Multi-Level Learning for Large-Scale Black-Box Optimization Qiqi Duan Chang Shao Guochen Zhou Minghan Zhang Qi Zhao Yuhui Shi 21 0 0 09 Oct 2023
Grassroots Operator Search for Model Edge Adaptation Hadjer Benmeziane K. E. Maghraoui Hamza Ouarnoughi Smail Niar 17 0 0 20 Sep 2023
Efficient and Explainable Graph Neural Architecture Search via Monte-Carlo Tree Search Yuya Sasaki 25 0 0 30 Aug 2023
FedPop: Federated Population-based Hyperparameter Tuning Haokun Chen Denis Krompass Jindong Gu Volker Tresp FedML 30 0 0 16 Aug 2023
Discovering Adaptable Symbolic Algorithms from Scratch Stephen Kelly Daniel S. Park Xingyou Song Mitchell McIntire Pranav Nashikkar ... W. Banzhaf Kalyanmoy Deb Vishnu Naresh Boddeti Jie Tan Esteban Real 12 3 0 31 Jul 2023
General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Societal Implications and Responsible Governance I. Triguero Daniel Molina Javier Poyatos Javier Del Ser Francisco Herrera AI4TS AI4MH 26 5 0 26 Jul 2023
EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization Peijie Dong Lujun Li Zimian Wei Xin-Yi Niu Zhiliang Tian H. Pan MQ 40 28 0 20 Jul 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 33 1 0 12 Jun 2023
Learning-Based Automatic Synthesis of Software Code and Configuration Shantanu Mandal 17 0 0 25 May 2023
Clustering Indices based Automatic Classification Model Selection Sudarsun Santhiappan N. Shravan B. Ravindran 17 0 0 23 May 2023
Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl M. Cranmer 41 39 0 02 May 2023
Discovering Graph Generation Algorithms Mihai Babiac Karolis Martinkus Roger Wattenhofer 24 1 0 25 Apr 2023
Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detection B. Demirel Orhun Bugra Baran R. G. Cinbis 32 10 0 24 Apr 2023
Symbolic Synthesis of Neural Networks Eli Whitehouse 19 0 0 06 Mar 2023
EvoPrompting: Language Models for Code-Level Neural Architecture Search Angelica Chen David Dohan David R. So VLM LRM 13 83 0 28 Feb 2023
Multiobjective Evolutionary Pruning of Deep Neural Networks with Transfer Learning for improving their Performance and Robustness Javier Poyatos Daniel Molina Aitor Martínez Javier Del Ser Francisco Herrera 30 10 0 20 Feb 2023
Symbolic Discovery of Optimization Algorithms Xiangning Chen Chen Liang Da Huang Esteban Real Kaiyuan Wang ... Xuanyi Dong Thang Luong Cho-Jui Hsieh Yifeng Lu Quoc V. Le 50 350 0 13 Feb 2023
Cross-Modal Fine-Tuning: Align then Refine Junhong Shen Liam Li Lucio Dery Corey Staten M. Khodak Graham Neubig Ameet Talwalkar 31 35 0 11 Feb 2023
Unified Functional Hashing in Automatic Machine Learning Ryan Gillard S. Jonany Yingjie Miao Michael Munn Connal de Souza Jonathan Dungay Chen Liang David R. So Quoc V. Le Esteban Real 16 2 0 10 Feb 2023
Neural Architecture Search: Insights from 1000 Papers Colin White Mahmoud Safari R. Sukthanker Binxin Ru T. Elsken Arber Zela Debadeepta Dey Frank Hutter 3DV AI4CE 32 128 0 20 Jan 2023
Optimistic Meta-Gradients Sebastian Flennerhag Tom Zahavy Brendan O'Donoghue Hado van Hasselt András Gyorgy Satinder Singh 29 3 0 09 Jan 2023
Symbolic Visual Reinforcement Learning: A Scalable Framework with Object-Level Abstraction and Differentiable Expression Search Wenqing Zheng S. Sharan Zhiwen Fan Kevin Wang Yihan Xi Zhangyang Wang 53 9 0 30 Dec 2022
General-Purpose In-Context Learning by Meta-Learning Transformers Louis Kirsch James Harrison Jascha Narain Sohl-Dickstein Luke Metz 29 72 0 08 Dec 2022
VeLO: Training Versatile Learned Optimizers by Scaling Up Luke Metz James Harrison C. Freeman Amil Merchant Lucas Beyer ... Naman Agrawal Ben Poole Igor Mordatch Adam Roberts Jascha Narain Sohl-Dickstein 21 60 0 17 Nov 2022
Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars Simon Schrodi Daniel Stoll Binxin Ru R. Sukthanker Thomas Brox Frank Hutter 35 4 0 03 Nov 2022