Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1810.01963
Cited By
v1
v2
v3
v4 (latest)
Learning Scheduling Algorithms for Data Processing Clusters
3 October 2018
Hongzi Mao
Malte Schwarzkopf
S. Venkatakrishnan
Zili Meng
Mohammad Alizadeh
OffRL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Learning Scheduling Algorithms for Data Processing Clusters"
50 / 165 papers shown
FERN: Leveraging Graph Attention Networks for Failure Evaluation and Robust Network Design
IEEE/ACM Transactions on Networking (TON), 2023
Chenyi Liu
Vaneet Aggarwal
Tian-Shing Lan
Nan Geng
Yuan Yang
Mingwei Xu
Qing Li
GNN
228
8
0
30 May 2023
GiPH: Generalizable Placement Learning for Adaptive Heterogeneous Computing
Conference on Machine Learning and Systems (MLSys), 2023
Yi Hu
Chao Zhang
Edward Andert
Harshul Singh
Aviral Shrivastava
James Laudon
Yan-Quan Zhou
Bob Iannucci
Carlee Joe-Wong
156
2
0
23 May 2023
Scheduling Multi-Server Jobs with Sublinear Regrets via Online Learning
IEEE Transactions on Services Computing (IEEE TSC), 2023
Hailiang Zhao
Shuiguang Deng
Zhengzhe Xiang
Xueqiang Yan
Yuxiang Cai
Schahram Dustdar
Albert Y. Zomaya
251
4
0
11 May 2023
Collaborative Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud Network
IEEE/ACM Transactions on Networking (TON), 2023
Shihao Shen
Yiwen Han
Xiaofei Wang
Maroun Touma
Victor C. M. Leung
210
13
0
10 May 2023
RESPECT: Reinforcement Learning based Edge Scheduling on Pipelined Coral Edge TPUs
Design Automation Conference (DAC), 2023
Jiaqi Yin
Yingjie Li
Daniel Robinson
Cunxi Yu
165
12
0
10 Apr 2023
AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges
Qian Cheng
Doyen Sahoo
Amrita Saha
Wenjing Yang
Chenghao Liu
Gerald Woo
Manpreet Singh
Silvio Saverese
Guosheng Lin
365
36
0
10 Apr 2023
Dependent Task Offloading in Edge Computing Using GNN and Deep Reinforcement Learning
IEEE Internet of Things Journal (IEEE IoT J.), 2023
Zequn Cao
Xiaoheng Deng
108
23
0
30 Mar 2023
Generating Dispatching Rules for the Interrupting Swap-Allowed Blocking Job Shop Problem Using Graph Neural Network and Reinforcement Learning
Journal of manufacturing science and engineering (JMSE), 2023
Vivian Wen Hui Wong
Sang Hun Kim
Junyoung Park
Jinkyoo Park
K. Law
145
2
0
05 Feb 2023
Online Reinforcement Learning in Non-Stationary Context-Driven Environments
International Conference on Learning Representations (ICLR), 2023
Pouya Hamadanian
Arash Nasr-Esfahany
Malte Schwarzkopf
Siddartha Sen
MohammadIman Alizadeh
CLL
OffRL
453
2
0
04 Feb 2023
Scheduling Inference Workloads on Distributed Edge Clusters with Reinforcement Learning
Gabriele Castellano
J. Nieto
Jordi Luque
Ferran Diego
Carlos Segura
Diego Perino
Flavio Esposito
Fulvio Risso
Aravindh Raman
101
0
0
31 Jan 2023
Robust Scheduling with GFlowNets
International Conference on Learning Representations (ICLR), 2023
David W. Zhang
Corrado Rainone
M. Peschl
Roberto Bondesan
398
63
0
17 Jan 2023
Autothrottle: A Practical Bi-Level Approach to Resource Management for SLO-Targeted Microservices
Symposium on Networked Systems Design and Implementation (NSDI), 2022
Zibo Wang
Pinghe Li
C. Liang
Feng Wu
Francis Y. Yan
178
21
0
23 Dec 2022
Robust Path Selection in Software-defined WANs using Deep Reinforcement Learning
Shahrooz Pouryousef
Lixin Gao
Don Towsley
110
1
0
21 Dec 2022
Learned-Database Systems Security
R. Schuster
Jinyi Zhou
Thorsten Eisenhofer
Paul Grubbs
Nicolas Papernot
AAML
398
2
0
20 Dec 2022
Acela: Predictable Datacenter-level Maintenance Job Scheduling
Yi Ding
Aijia Gao
Thibaud Ryden
Kaushik Mitra
Sukumar Kalmanje
Yanai S. Golany
Michael Carbin
Henry Hoffmann
140
1
0
10 Dec 2022
Launchpad: Learning to Schedule Using Offline and Online RL Methods
Job Scheduling Strategies for Parallel Processing (JSSPP), 2022
V. Venkataswamy
J. E. Grigsby
A. Grimshaw
Yanjun Qi
OffRL
OnRL
154
2
0
01 Dec 2022
Multi-Job Intelligent Scheduling with Cross-Device Federated Learning
IEEE Transactions on Parallel and Distributed Systems (TPDS), 2022
Ji Liu
Juncheng Jia
Beichen Ma
Chen Zhou
Jingbo Zhou
Yang Zhou
H. Dai
Dejing Dou
FedML
255
38
0
24 Nov 2022
A Survey on Influence Maximization: From an ML-Based Combinatorial Optimization
ACM Transactions on Knowledge Discovery from Data (TKDD), 2022
Yandi Li
Haobo Gao
Yunxuan Gao
Jianxiong Guo
Weili Wu
293
64
0
06 Nov 2022
AdaChain: A Learned Adaptive Blockchain
Proceedings of the VLDB Endowment (PVLDB), 2022
Chenyuan Wu
Bhavana Mehta
Mohammad Javad Amiri
Ryan Marcus
B. T. Loo
219
17
0
03 Nov 2022
Atlas: Automate Online Service Configuration in Network Slicing
Conference on Emerging Network Experiment and Technology (CoNEXT), 2022
Qiang Liu
Nakjung Choi
Tao Han
155
16
0
30 Oct 2022
Network Aware Compute and Memory Allocation in Optically Composable Data Centres with Deep Reinforcement Learning and Graph Neural Networks
Journal of Optical Communications and Networking (JOCN), 2022
Zacharaya Shabka
G. Zervas
GNN
112
5
0
26 Oct 2022
Multi-level Explanation of Deep Reinforcement Learning-based Scheduling
Shaojun Zhang
Chen Wang
Albert Zomaya
OffRL
87
1
0
18 Sep 2022
Workflow-based Fast Data-driven Predictive Control with Disturbance Observer in Cloud-edge Collaborative Architecture
IEEE Transactions on Automation Science and Engineering (T-ASE), 2022
Runze Gao
Qiwen Li
Li Dai
Yufeng Zhan
Yuanqing Xia
103
10
0
16 Sep 2022
Deep Reinforcement Learning for System-on-Chip: Myths and Realities
IEEE Access (IEEE Access), 2022
Tegg Taekyong Sung
Bo Ryu
83
3
0
29 Jul 2022
Hindsight Learning for MDPs with Exogenous Inputs
International Conference on Machine Learning (ICML), 2022
Sean R. Sinclair
Felipe Vieira Frujeri
Ching-An Cheng
Luke Marshall
Hugo Barbalho
Jingling Li
Jennifer Neville
Ishai Menache
Adith Swaminathan
217
29
0
13 Jul 2022
Learning to generalize Dispatching rules on the Job Shop Scheduling
Zangir Iklassov
Dmitrii Medvedev
Rubén Solozabal
Martin Takáč
150
8
0
09 Jun 2022
Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game
Neural Information Processing Systems (NeurIPS), 2022
Zhiyuan Yao
Zihan Ding
OffRL
275
2
0
03 Jun 2022
Off-Beat Multi-Agent Reinforcement Learning
Adaptive Agents and Multi-Agent Systems (AAMAS), 2022
Wei Qiu
Weixun Wang
Rongpin Wang
Bo An
Yujing Hu
S. Obraztsova
Zinovi Rabinovich
Jianye Hao
Yingfeng Chen
Changjie Fan
OffRL
182
2
0
27 May 2022
COIN: Communication-Aware In-Memory Acceleration for Graph Convolutional Networks
IEEE Journal on Emerging and Selected Topics in Circuits and Systems (JESTCAS), 2022
Sumit K. Mandal
Gokul Krishnan
A. Alper Goksoy
Gopikrishnan R. Nair
Yu Cao
Ümit Y. Ogras
GNN
206
13
0
15 May 2022
Reinforcement Learning for Location-Aware Scheduling
S. Stavroulakis
B. Sengupta
76
0
0
07 Mar 2022
Hierarchically Structured Scheduling and Execution of Tasks in a Multi-Agent Environment
Portuguese Conference on Artificial Intelligence (EPIA), 2022
Diogo S. Carvalho
B. Sengupta
136
2
0
06 Mar 2022
Reinforcement Learning in Practice: Opportunities and Challenges
Yuxi Li
OffRL
280
23
0
23 Feb 2022
GADGET: Online Resource Optimization for Scheduling Ring-All-Reduce Learning Jobs
IEEE Conference on Computer Communications (INFOCOM), 2022
Menglu Yu
Ye Tian
Bo Ji
Chuan Wu
Hridesh Rajan
Jia-Wei Liu
80
30
0
02 Feb 2022
Multi-Agent Reinforcement Learning for Network Load Balancing in Data Center
International Conference on Information and Knowledge Management (CIKM), 2022
Zhiyuan Yao
Zihan Ding
T. Clausen
180
8
0
27 Jan 2022
Demystifying Reinforcement Learning in Time-Varying Systems
Pouya Hamadanian
Malte Schwarzkopf
Siddartha Sen
MohammadIman Alizadeh
314
2
0
14 Jan 2022
A Simulation Platform for Multi-tenant Machine Learning Services on Thousands of GPUs
R. Liang
Bingsheng He
Shengen Yan
Yang Liu
75
1
0
10 Jan 2022
Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction
Proceedings of the VLDB Endowment (PVLDB), 2022
Benjamin Hilprecht
Carsten Binnig
AI4TS
140
77
0
03 Jan 2022
Fast Subspace Identification Method Based on Containerised Cloud Workflow Processing System
IEEE Transactions on Automation Science and Engineering (T-ASE), 2021
Runze Gao
Yuanqing Xia
Guan Wang
Liwen Yang
Yufeng Zhan
109
3
0
29 Dec 2021
A General Framework for Evaluating Robustness of Combinatorial Optimization Solvers on Graphs
Han Lu
Zenan Li
Runzhong Wang
Qibing Ren
Junchi Yan
Yunbo Wang
AAML
171
0
0
28 Dec 2021
Large-scale Machine Learning Cluster Scheduling via Multi-agent Graph Reinforcement Learning
IEEE Transactions on Network and Service Management (TNSM), 2021
Xiaoyang Zhao
Chuan Wu
131
32
0
26 Dec 2021
An Efficient Combinatorial Optimization Model Using Learning-to-Rank Distillation
AAAI Conference on Artificial Intelligence (AAAI), 2021
Honguk Woo
Hyunsung Lee
Sangwook Cho
218
7
0
24 Dec 2021
A Scalable Deep Reinforcement Learning Model for Online Scheduling Coflows of Multi-Stage Jobs for High Performance Computing
Xin Wang
Hong Shen
GNN
103
1
0
21 Dec 2021
Learning for Robust Combinatorial Optimization: Algorithm and Application
IEEE Conference on Computer Communications (INFOCOM), 2021
Zhihui Shao
Jianyi Yang
Cong Shen
Shaolei Ren
206
6
0
20 Dec 2021
Analyzing a Caching Model
Leon Sixt
Emmy Liu
Marie Pellat
James Wexler
Milad Hashemi Been Kim
Been Kim
Martin Maas
88
1
0
13 Dec 2021
Efficient Device Scheduling with Multi-Job Federated Learning
Chen Zhou
Ji Liu
Juncheng Jia
Jingbo Zhou
Yang Zhou
H. Dai
Dejing Dou
FedML
243
53
0
11 Dec 2021
OnSlicing: Online End-to-End Network Slicing with Reinforcement Learning
Conference on Emerging Network Experiment and Technology (CoNEXT), 2021
Qiang Liu
Nakjung Choi
Tao Han
OffRL
109
41
0
02 Nov 2021
Reinforced Workload Distribution Fairness
Zhiyuan Yao
Zihan Ding
T. Clausen
68
7
0
29 Oct 2021
Towards Intelligent Load Balancing in Data Centers
Zhiyuan Yao
Yoann Desmouceaux
M. Townsley
T. Clausen
103
4
0
27 Oct 2021
GCNScheduler: Scheduling Distributed Computing Applications using Graph Convolutional Networks
Mehrdad Kiamari
Bhaskar Krishnamachari
GNN
122
12
0
22 Oct 2021
A Learning-based Approach Towards Automated Tuning of SSD Configurations
Daixuan Li
Jian Huang
64
4
0
17 Oct 2021
Previous
1
2
3
4
Next
