A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic

10 July 2020

Papers citing "A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic"

50 / 99 papers shown

Title
A Two-Timescale Primal-Dual Framework for Reinforcement Learning via Online Dual Variable Guidance Axel Friedrich Wolter Tobias Sutter OffRL 37 0 0 07 May 2025
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 127 0 0 04 May 2025
Learning Heterogeneous Performance-Fairness Trade-offs in Federated Learning Rongguang Ye Ming Tang FedML 48 0 0 30 Apr 2025
On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 56 0 0 05 Mar 2025
qNBO: quasi-Newton Meets Bilevel Optimization Sheng Fang Yong Liu Wei-Ting Yao Chengming Yu Jin Zhang 90 0 0 03 Feb 2025
ADAGE: A generic two-layer framework for adaptive agent based modelling Benjamin Patrick Evans Sihan Zeng Sumitra Ganesh Leo Ardon 56 0 0 17 Jan 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 44 3 0 31 Dec 2024
Online Poisoning Attack Against Reinforcement Learning under Black-box Environments Jianhui Li Bokang Zhang Junfeng Wu AAML OffRL OnRL 90 1 0 01 Dec 2024
Exploring the Generalization Capabilities of AID-based Bi-level Optimization C. L. Philip Chen Li Shen Zhiqiang Xu W. Liu Zhi-Quan Luo Peilin Zhao 68 1 0 25 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 36 0 0 25 Oct 2024
Meta Stackelberg Game: Robust Federated Learning against Adaptive and Mixed Poisoning Attacks Tao Li Henger Li Yunian Pan Tianyi Xu Zizhan Zheng Quanyan Zhu FedML 26 5 0 22 Oct 2024
A Communication and Computation Efficient Fully First-order Method for Decentralized Bilevel Optimization Min Wen Chengchang Liu Ahmed Abdelmoniem Yipeng Zhou Yuedong Xu 29 0 0 18 Oct 2024
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 31 1 0 17 Oct 2024
Two-Timescale Linear Stochastic Approximation: Constant Stepsizes Go a Long Way Jeongyeol Kwon Luke Dotson Yudong Chen Qiaomin Xie 28 1 0 16 Oct 2024
Towards Differentiable Multilevel Optimization: A Gradient-Based Approach Yuntian Gu Xuzheng Chen 14 0 0 15 Oct 2024
Bayesian Experimental Design via Contrastive Diffusions Jacopo Iollo Christophe Heinkelé Pierre Alliez Florence Forbes 28 0 0 15 Oct 2024
Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator Siyuan Xu Minghui Zhu OffRL 28 1 0 13 Oct 2024
Attention layers provably solve single-location regression P. Marion Raphael Berthier Gérard Biau Claire Boyer 131 2 0 02 Oct 2024
Differentially Private Bilevel Optimization Guy Kornowski 134 0 0 29 Sep 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 41 2 0 28 Sep 2024
Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Models Tianqi Chen Shujian Zhang Mingyuan Zhou DiffM 81 3 0 17 Sep 2024
Heavy-Ball Momentum Accelerated Actor-Critic With Function Approximation Yanjie Dong Haijun Zhang Gang Wang Shisheng Cui Xiping Hu 35 1 0 13 Aug 2024
GFlowNet Training by Policy Gradients Puhua Niu Shili Wu Mingzhou Fan Xiaoning Qian 88 3 0 12 Aug 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 72 5 0 18 Jun 2024
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity Yan Yang Bin Gao Ya-xiang Yuan 38 2 0 30 May 2024
Riemannian Bilevel Optimization Sanchayan Dutta Xiang Cheng S. Sra 36 0 0 22 May 2024
Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning Sihan Zeng Thinh T. Doan 54 5 0 15 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization Chris Junchi Li 54 0 0 01 May 2024
Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation Mingyuan Zhou Huangjie Zheng Zhendong Wang Mingzhang Yin Hai Huang DiffM 49 49 0 05 Apr 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 36 2 0 04 Apr 2024
Functional Bilevel Optimization for Machine Learning Ieva Petrulionyte Julien Mairal Michael Arbel 48 2 0 29 Mar 2024
Regularized DeepIV with Model Selection Zihao Li Hui Lan Vasilis Syrgkanis Mengdi Wang Masatoshi Uehara 36 2 0 07 Mar 2024
Implicit Diffusion: Efficient Optimization through Stochastic Sampling Pierre Marion Anna Korba Peter Bartlett Mathieu Blondel Valentin De Bortoli Arnaud Doucet Felipe Llinares-López Courtney Paquette Quentin Berthet 76 11 0 08 Feb 2024
A Framework for Bilevel Optimization on Riemannian Manifolds Andi Han Bamdev Mishra Pratik Jawanpuria Akiko Takeda 18 4 0 06 Feb 2024
Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation Sobihan Surendran Antoine Godichon-Baggioni Adeline Fermanian Sylvain Le Corff 37 1 0 05 Feb 2024
Regularized Q-Learning with Linear Function Approximation Jiachen Xi Alfredo Garcia P. Momcilovic 27 2 0 26 Jan 2024
Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity Thinh T. Doan 30 7 0 23 Jan 2024
Accelerating Distributed Stochastic Optimization via Self-Repellent Random Walks Jie Hu Vishwaraj Doshi Do Young Eun 47 2 0 18 Jan 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 25 7 0 17 Jan 2024
Central Limit Theorem for Two-Timescale Stochastic Approximation with Markovian Noise: Theory and Applications Jie Hu Vishwaraj Doshi Do Young Eun 30 4 0 17 Jan 2024
A Single-Loop Algorithm for Decentralized Bilevel Optimization Youran Dong Shiqian Ma Junfeng Yang Chao Yin 31 7 0 15 Nov 2023
Contextual Stochastic Bilevel Optimization Yifan Hu Jie Wang Yao Xie Andreas Krause Daniel Kuhn 32 11 0 27 Oct 2023
Federated Multi-Level Optimization over Decentralized Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang AI4CE 28 0 0 10 Oct 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation Jeongyeol Kwon Dohyun Kwon Steve Wright Robert D. Nowak 26 25 0 04 Sep 2023
An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning Mohammad Salehi Subhadip Mukherjee Lindon Roberts Matthias Joachim Ehrhardt 24 5 0 19 Aug 2023
Non-Convex Bilevel Optimization with Time-Varying Objective Functions Sen-Fon Lin Daouda Sow Kaiyi Ji Yitao Liang Ness B. Shroff 36 2 0 07 Aug 2023
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 38 25 0 01 Aug 2023
Stochastic Nested Compositional Bi-level Optimization for Robust Feature Learning Xuxing Chen Krishnakumar Balasubramanian Saeed Ghadimi 17 1 0 11 Jul 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J. Zhang 84 2 0 26 Jun 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions Xuxing Chen Tesi Xiao Krishnakumar Balasubramanian 27 24 0 21 Jun 2023