ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1709.07417
  4. Cited By
Neural Optimizer Search with Reinforcement Learning
v1v2 (latest)

Neural Optimizer Search with Reinforcement Learning

21 September 2017
Irwan Bello
Barret Zoph
Vijay Vasudevan
Quoc V. Le
    ODL
ArXiv (abs)PDFHTML

Papers citing "Neural Optimizer Search with Reinforcement Learning"

50 / 163 papers shown
T-AutoML: Automated Machine Learning for Lesion Segmentation using
  Transformers in 3D Medical Imaging
T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical ImagingIEEE International Conference on Computer Vision (ICCV), 2021
Dong Yang
Andriy Myronenko
Xiaosong Wang
Ziyue Xu
H. Roth
Daguang Xu
ViTMedIm3DV
166
27
0
15 Nov 2021
Evolving Transferable Neural Pruning Functions
Evolving Transferable Neural Pruning FunctionsAnnual Conference on Genetic and Evolutionary Computation (GECCO), 2021
Yuchen Liu
S. Kung
D. Wentzlaff
163
1
0
21 Oct 2021
Model-Agnostic Meta-Attack: Towards Reliable Evaluation of Adversarial
  Robustness
Model-Agnostic Meta-Attack: Towards Reliable Evaluation of Adversarial Robustness
Xiao Yang
Yinpeng Dong
Wenzhao Xiang
Tianyu Pang
Hang Su
Jun Zhu
AAML
126
4
0
13 Oct 2021
Auto-DSP: Learning to Optimize Acoustic Echo Cancellers
Auto-DSP: Learning to Optimize Acoustic Echo CancellersIEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), 2021
Jonah Casebeer
Nicholas J. Bryan
Paris Smaragdis
171
11
0
08 Oct 2021
G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and
  Efficiency
G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and Efficiency
Yongan Zhang
Haoran You
Yonggan Fu
Tong Geng
Ang Li
Yingyan Lin
GNN
173
32
0
18 Sep 2021
Single-DARTS: Towards Stable Architecture Search
Single-DARTS: Towards Stable Architecture Search
Pengfei Hou
Ying Jin
Yukang Chen
155
8
0
18 Aug 2021
BN-NAS: Neural Architecture Search with Batch Normalization
BN-NAS: Neural Architecture Search with Batch Normalization
Boyu Chen
Peixia Li
Baopu Li
Chen Lin
Chuming Li
Ming Sun
Junjie Yan
Wanli Ouyang
193
35
0
16 Aug 2021
Piecewise Linear Units Improve Deep Neural Networks
Piecewise Linear Units Improve Deep Neural Networks
Jordan Inturrisi
Suiyang Khoo
Abbas Kouzani
Riccardo M. Pagliarella
206
4
0
02 Aug 2021
Improving exploration in policy gradient search: Application to symbolic
  optimization
Improving exploration in policy gradient search: Application to symbolic optimization
Mikel Landajuela
Brenden K. Petersen
S. K. Kim
Claudio Santiago
Ruben Glatt
T. Nathan Mundhenk
Jacob F. Pettit
Daniel Faissol
225
18
0
19 Jul 2021
GLiT: Neural Architecture Search for Global and Local Image Transformer
GLiT: Neural Architecture Search for Global and Local Image Transformer
Boyu Chen
Peixia Li
Chuming Li
Baopu Li
Mengwei He
Chen Lin
Ming Sun
Junjie Yan
Wanli Ouyang
ViT
343
97
0
07 Jul 2021
How to Train Your MAML to Excel in Few-Shot Classification
How to Train Your MAML to Excel in Few-Shot ClassificationInternational Conference on Learning Representations (ICLR), 2021
Han-Jia Ye
Wei-Lun Chao
260
57
0
30 Jun 2021
To Raise or Not To Raise: The Autonomous Learning Rate Question
To Raise or Not To Raise: The Autonomous Learning Rate Question
Xiaomeng Dong
Tao Tan
Michael Potter
Yun-Chan Tsai
Gaurav Kumar
V. R. Saripalli
Theodore Trafalis
OOD
111
3
0
16 Jun 2021
Relational Graph Neural Network Design via Progressive Neural
  Architecture Search
Relational Graph Neural Network Design via Progressive Neural Architecture Search
Ailing Zeng
Minhao Liu
Zhiwei Liu
Ruiyuan Gao
Jing Qin
Qiang Xu
223
0
0
30 May 2021
MetricOpt: Learning to Optimize Black-Box Evaluation Metrics
MetricOpt: Learning to Optimize Black-Box Evaluation MetricsComputer Vision and Pattern Recognition (CVPR), 2021
Chen Huang
Shuangfei Zhai
Pengsheng Guo
J. Susskind
215
14
0
21 Apr 2021
Learning specialized activation functions with the Piecewise Linear Unit
Learning specialized activation functions with the Piecewise Linear UnitIEEE International Conference on Computer Vision (ICCV), 2021
Yucong Zhou
Zezhou Zhu
Zhaobai Zhong
149
17
0
08 Apr 2021
Learning to Optimize: A Primer and A Benchmark
Learning to Optimize: A Primer and A BenchmarkJournal of machine learning research (JMLR), 2021
Tianlong Chen
Xiaohan Chen
Wuyang Chen
Howard Heaton
Jialin Liu
Zinan Lin
W. Yin
580
299
0
23 Mar 2021
Evolving parametrized Loss for Image Classification Learning on Small Datasets
Zhaoyang Hai
Xiabi Liu
69
0
0
15 Mar 2021
Differentiable Neural Architecture Learning for Efficient Neural Network
  Design
Differentiable Neural Architecture Learning for Efficient Neural Network Design
Qingbei Guo
Xiaojun Wu
J. Kittler
Zhiquan Feng
103
2
0
03 Mar 2021
Acceleration via Fractal Learning Rate Schedules
Acceleration via Fractal Learning Rate SchedulesInternational Conference on Machine Learning (ICML), 2021
Naman Agarwal
Surbhi Goel
Cyril Zhang
188
19
0
01 Mar 2021
A Novel Framework for Neural Architecture Search in the Hill Climbing
  Domain
A Novel Framework for Neural Architecture Search in the Hill Climbing DomainInternational Conference on Artificial Intelligence and Knowledge Engineering (AIKE), 2019
Mudit Verma
Pradyumn Sinha
Karan Goyal
Apoorva Verma
Seba Susan
171
8
0
22 Feb 2021
Training Learned Optimizers with Randomly Initialized Learned Optimizers
Training Learned Optimizers with Randomly Initialized Learned Optimizers
Luke Metz
C. Freeman
Niru Maheswaranathan
Jascha Narain Sohl-Dickstein
170
14
0
14 Jan 2021
Evolving Reinforcement Learning Algorithms
Evolving Reinforcement Learning AlgorithmsInternational Conference on Learning Representations (ICLR), 2021
John D. Co-Reyes
Yingjie Miao
Daiyi Peng
Esteban Real
Sergey Levine
Quoc V. Le
Honglak Lee
Aleksandra Faust
469
76
0
08 Jan 2021
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks
AutoDropout: Learning Dropout Patterns to Regularize Deep NetworksAAAI Conference on Artificial Intelligence (AAAI), 2021
Hieu H. Pham
Quoc V. Le
215
61
0
05 Jan 2021
Single-level Optimization For Differential Architecture Search
Single-level Optimization For Differential Architecture Search
Pengfei Hou
Ying Jin
190
2
0
15 Dec 2020
Are We Ready For Learned Cardinality Estimation?
Are We Ready For Learned Cardinality Estimation?Proceedings of the VLDB Endowment (PVLDB), 2020
Xiaoying Wang
Changbo Qu
Weiyuan Wu
Jiannan Wang
Qingqing Zhou
351
142
0
12 Dec 2020
Skin disease diagnosis with deep learning: a review
Skin disease diagnosis with deep learning: a review
Hongfeng Li
Yini Pan
Jie Zhao
Li Zhang
276
127
0
11 Nov 2020
Reverse engineering learned optimizers reveals known and novel
  mechanisms
Reverse engineering learned optimizers reveals known and novel mechanisms
Niru Maheswaranathan
David Sussillo
Luke Metz
Ruoxi Sun
Jascha Narain Sohl-Dickstein
330
26
0
04 Nov 2020
Auto-Panoptic: Cooperative Multi-Component Architecture Search for
  Panoptic Segmentation
Auto-Panoptic: Cooperative Multi-Component Architecture Search for Panoptic SegmentationNeural Information Processing Systems (NeurIPS), 2020
Yangxin Wu
Gengwei Zhang
Hang Xu
Xiaodan Liang
Liang Lin
175
21
0
30 Oct 2020
Training Stronger Baselines for Learning to Optimize
Training Stronger Baselines for Learning to OptimizeNeural Information Processing Systems (NeurIPS), 2020
Tianlong Chen
Weiyi Zhang
Jingyang Zhou
Shiyu Chang
Sijia Liu
Lisa Amini
Zinan Lin
OffRL
202
56
0
18 Oct 2020
Auto-STGCN: Autonomous Spatial-Temporal Graph Convolutional Network
  Search Based on Reinforcement Learning and Existing Research Results
Auto-STGCN: Autonomous Spatial-Temporal Graph Convolutional Network Search Based on Reinforcement Learning and Existing Research Results
Chunnan Wang
Kaixin Zhang
Hongzhi Wang
Bozhou Chen
GNNAI4TS
144
32
0
15 Oct 2020
AE-Netv2: Optimization of Image Fusion Efficiency and Network
  Architecture
AE-Netv2: Optimization of Image Fusion Efficiency and Network Architecture
Aiqing Fang
Xinbo Zhao
Jiaqi Yang
Beibei Qin
Yanning Zhang
155
0
0
05 Oct 2020
Tasks, stability, architecture, and compute: Training more effective
  learned optimizers, and using them to train themselves
Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselves
Luke Metz
Niru Maheswaranathan
C. Freeman
Ben Poole
Jascha Narain Sohl-Dickstein
289
69
0
23 Sep 2020
Review: Deep Learning in Electron Microscopy
Review: Deep Learning in Electron Microscopy
Jeffrey M. Ede
912
90
0
17 Sep 2020
On the Orthogonality of Knowledge Distillation with Other Techniques:
  From an Ensemble Perspective
On the Orthogonality of Knowledge Distillation with Other Techniques: From an Ensemble Perspective
Seonguk Park
Kiyoon Yoo
Nojun Kwak
FedML
213
3
0
09 Sep 2020
Adversarially Robust Neural Architectures
Adversarially Robust Neural ArchitecturesIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020
Minjing Dong
Yanxi Li
Yunhe Wang
Chang Xu
AAMLOOD
268
51
0
02 Sep 2020
Weight-Sharing Neural Architecture Search: A Battle to Shrink the
  Optimization Gap
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap
Lingxi Xie
Xin Chen
Kaifeng Bi
Longhui Wei
Yuhui Xu
...
Lanfei Wang
Anxiang Xiao
Jianlong Chang
Xiaopeng Zhang
Qi Tian
ViT
388
117
0
04 Aug 2020
Descending through a Crowded Valley - Benchmarking Deep Learning
  Optimizers
Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers
Robin M. Schmidt
Frank Schneider
Philipp Hennig
ODL
793
186
0
03 Jul 2020
Guarantees for Tuning the Step Size using a Learning-to-Learn Approach
Guarantees for Tuning the Step Size using a Learning-to-Learn Approach
Xiang Wang
Shuai Yuan
Chenwei Wu
Rong Ge
285
16
0
30 Jun 2020
Gradient-only line searches to automatically determine learning rates
  for a variety of stochastic training algorithms
Gradient-only line searches to automatically determine learning rates for a variety of stochastic training algorithms
D. Kafka
D. Wilke
ODL
117
0
0
29 Jun 2020
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep
  Neural Networks
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep Neural NetworksComputer Vision and Pattern Recognition (CVPR), 2020
Eugene Lee
Chen-Yi Lee
110
15
0
23 Jun 2020
Actor-Critic Reinforcement Learning for Control with Stability Guarantee
Actor-Critic Reinforcement Learning for Control with Stability GuaranteeIEEE Robotics and Automation Letters (RA-L), 2020
Minghao Han
Lixian Zhang
Jun Wang
Wei Pan
299
143
0
29 Apr 2020
Meta-Learning in Neural Networks: A Survey
Meta-Learning in Neural Networks: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020
Timothy M. Hospedales
Antreas Antoniou
P. Micaelli
Amos Storkey
OOD
753
2,389
0
11 Apr 2020
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level
  Reformulation
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level ReformulationComputer Vision and Pattern Recognition (CVPR), 2020
Chaoyang He
Haishan Ye
Li Shen
Tong Zhang
146
137
0
27 Mar 2020
ARDA: Automatic Relational Data Augmentation for Machine Learning
ARDA: Automatic Relational Data Augmentation for Machine LearningProceedings of the VLDB Endowment (PVLDB), 2020
Nadiia Chepurko
Ryan Marcus
Emanuel Zgraggen
Raul Castro Fernandez
Tim Kraska
David R Karger
122
15
0
21 Mar 2020
Hyper-Parameter Optimization: A Review of Algorithms and Applications
Hyper-Parameter Optimization: A Review of Algorithms and Applications
Tong Yu
Hong Zhu
AAML
240
630
0
12 Mar 2020
Meta-learning curiosity algorithms
Meta-learning curiosity algorithmsInternational Conference on Learning Representations (ICLR), 2020
Ferran Alet
Martin Schneider
Tomas Lozano-Perez
L. Kaelbling
240
67
0
11 Mar 2020
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch
AutoML-Zero: Evolving Machine Learning Algorithms From ScratchInternational Conference on Machine Learning (ICML), 2020
Esteban Real
Chen Liang
David R. So
Quoc V. Le
272
251
0
06 Mar 2020
ADWPNAS: Architecture-Driven Weight Prediction for Neural Architecture
  Search
ADWPNAS: Architecture-Driven Weight Prediction for Neural Architecture Search
Xu Zhang
Chenjun Zhou
Bo Gu
190
1
0
03 Mar 2020
Using a thousand optimization tasks to learn hyperparameter search
  strategies
Using a thousand optimization tasks to learn hyperparameter search strategies
Luke Metz
Niru Maheswaranathan
Ruoxi Sun
C. Freeman
Ben Poole
Jascha Narain Sohl-Dickstein
312
50
0
27 Feb 2020
Disentangling Adaptive Gradient Methods from Learning Rates
Disentangling Adaptive Gradient Methods from Learning Rates
Naman Agarwal
Rohan Anil
Elad Hazan
Tomer Koren
Cyril Zhang
256
41
0
26 Feb 2020
Previous
1234
Next