Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1810.01963
Cited By
v1
v2
v3
v4 (latest)
Learning Scheduling Algorithms for Data Processing Clusters
3 October 2018
Hongzi Mao
Malte Schwarzkopf
S. Venkatakrishnan
Zili Meng
Mohammad Alizadeh
OffRL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Learning Scheduling Algorithms for Data Processing Clusters"
50 / 165 papers shown
Efficient Chromosome Parallelization for Precision Medicine Genomic Workflows
D. M. Montserrat
Ray Verma
Míriam Barrabés
Francisco M. de la Vega
C. Bustamante
A. Ioannidis
68
0
0
20 Nov 2025
Mixture-of-Schedulers: An Adaptive Scheduling Agent as a Learned Router for Expert Policies
Xinbo Wang
Shian Jia
Ziyang Huang
Jing Cao
Mingli Song
45
0
0
07 Nov 2025
Glia: A Human-Inspired AI for Automated Systems Design and Optimization
Pouya Hamadanian
Pantea Karimi
Arash Nasr-Esfahany
Kimia Noorbakhsh
Joseph Chandler
Ali ParandehGheibi
M. Alizadeh
H. Balakrishnan
AI4CE
247
3
0
31 Oct 2025
Crucible: Quantifying the Potential of Control Algorithms through LLM Agents
Lianchen Jia
Chaoyang Li
Qian Houde
Tianchi Huang
Jiangchuan Liu
Lifeng Sun
108
0
0
21 Oct 2025
Prior-Aligned Meta-RL: Thompson Sampling with Learned Priors and Guarantees in Finite-Horizon MDPs
Runlin Zhou
Chixiang Chen
Elynn Chen
OffRL
126
8
0
06 Oct 2025
Towards Carbon-Aware Container Orchestration: Predicting Workload Energy Consumption with Federated Learning
Zainab Saad
Jialin Yang
Henry Leung
Steve H. Drew
101
2
0
04 Oct 2025
Enhancing Cluster Scheduling in HPC: A Continuous Transfer Learning for Real-Time Optimization
IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPS), 2025
Leszek Sliwko
Jolanta Mizera-Pietraszko
52
0
0
22 Sep 2025
Towards Agentic OS: An LLM Agent Framework for Linux Schedulers
Yusheng Zheng
Yanpeng Hu
Wei Zhang
Andi Quinn
LLMAG
194
0
0
01 Sep 2025
FlowletFormer: Network Behavioral Semantic Aware Pre-training Model for Traffic Classification
Liming Liu
Ruoyu Li
Qing Li
Meijia Hou
Yong Jiang
Mingwei Xu
161
0
0
27 Aug 2025
Towards VM Rescheduling Optimization Through Deep Reinforcement Learning
European Conference on Computer Systems (EuroSys), 2025
Xianzhong Ding
Yunkai Zhang
Binbin Chen
Donghao Ying
Tieying Zhang
Jianjun Chen
Lei Zhang
Alberto Cerpa
Wan Du
VLM
273
4
0
23 May 2025
Decentralized Distributed Proximal Policy Optimization (DD-PPO) for High Performance Computing Scheduling on Multi-User Systems
Matthew Sgambati
Aleksandar Vakanski
Matthew Anderson
155
0
0
06 May 2025
BQSched: A Non-intrusive Scheduler for Batch Concurrent Queries via Reinforcement Learning
IEEE International Conference on Data Engineering (ICDE), 2025
Chenhao Xu
Chunyu Chen
Jinglin Peng
Jiannan Wang
Jun Gao
OffRL
AI4TS
225
0
0
27 Apr 2025
Is Intelligence the Right Direction in New OS Scheduling for Multiple Resources in Cloud Environments?
Xinglei Dou
Lei Liu
Limin Xiao
VLM
160
0
0
21 Apr 2025
Transforming Future Data Center Operations and Management via Physical AI
Zhiwei Cao
Minghao Li
Feng Lin
Qiang Fu
Jimin Jia
Yonggang Wen
Jianxiong Yin
AI4CE
202
3
0
07 Apr 2025
Scalable Reinforcement Learning for Virtual Machine Scheduling
Junjie Sheng
JieHao Wu
Haochuan Cui
Yiqiu Hu
Wenli Zhou
Lei Zhu
Qian Peng
Wenhao Li
Xiangfeng Wang
OffRL
140
0
0
01 Mar 2025
Improving the Efficiency of a Deep Reinforcement Learning-Based Power Management System for HPC Clusters Using Curriculum Learning
Thomas Budiarjo
Santana Yuda Pradata
Kadek Gemilang Santiyuda
Muhammad Alfian Amrizal
Reza Pulungan
Hiroyuki Takizawa
287
2
0
27 Feb 2025
Orchestrating Joint Offloading and Scheduling for Low-Latency Edge SLAM
IEEE Transactions on Mobile Computing (IEEE TMC), 2025
Yao Zhang
Yuyi Mao
Hui Wang
Zhiwen Yu
Song Guo
Jun Zhang
Liang Wang
B. Guo
245
1
0
23 Feb 2025
Specification Generation for Neural Networks in Systems
Isha Chaudhary
Shuyi Lin
Cheng Tan
Gagandeep Singh
331
0
0
04 Dec 2024
P-MOSS: Learned Scheduling For Indexes Over NUMA Servers Using Low-Level Hardware Statistics
Yeasir Rayhan
Walid G. Aref
120
0
0
05 Nov 2024
Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs
Ferdi Kossmann
Bruce Fontaine
Daya Khudia
Michael Cafarella
Samuel Madden
620
6
0
23 Oct 2024
AutoSpec: Automated Generation of Neural Network Specifications
Shuowei Jin
Francis Y. Yan
Cheng Tan
Anuj Kalia
Xenofon Foukas
Z. Morley Mao
250
0
0
17 Sep 2024
Learning Joint Models of Prediction and Optimization
European Conference on Artificial Intelligence (ECAI), 2024
James Kotary
Vincenzo Di Vito
Jacob Cristopher
Pascal Van Hentenryck
Ferdinando Fioretto
154
4
0
07 Sep 2024
Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks
Scientia Sinica Informationis (SSI), 2024
Runzhong Wang
Yang Li
Junchi Yan
Xiaokang Yang
AI4CE
255
1
0
06 Sep 2024
BFTBrain: Adaptive BFT Consensus with Reinforcement Learning
Symposium on Networked Systems Design and Implementation (NSDI), 2024
Chenyuan Wu
Haoyun Qin
Mohammad Javad Amiri
B. T. Loo
Dahlia Malkhi
Ryan Marcus
206
3
0
12 Aug 2024
Data-Locality-Aware Task Assignment and Scheduling for Distributed Job Executions
Hailiang Zhao
Xueyan Tang
Peng Chen
Yuxiang Cai
Shuiguang Deng
223
4
0
11 Jul 2024
Robust Generalization of Graph Neural Networks for Carrier Scheduling
Daniel F. Perez-Ramirez
Carlos Pérez-Penichet
N. Tsiftes
Dejan Kostic
Magnus Boman
Thiemo Voigt
187
0
0
11 Jul 2024
Performance of NPG in Countable State-Space Average-Cost RL
Yashaswini Murthy
Isaac Grosof
S. T. Maguluri
R. Srikant
OffRL
216
1
0
30 May 2024
Learning Interpretable Scheduling Algorithms for Data Processing Clusters
Zhibo Hu
Chen Wang
Helen Paik
Paik
Yanfeng Shu
Liming Zhu
OffRL
208
0
0
29 May 2024
Self-Guiding Exploration for Combinatorial Problems
Zangir Iklassov
Yali Du
Farkhad Akimov
Martin Takáč
LRM
116
15
0
28 May 2024
Q-adaptive: A Multi-Agent Reinforcement Learning Based Routing on Dragonfly Network
Yao Kang
Xin Wang
Z. Lan
208
21
0
24 Mar 2024
Interpretable Modeling of Deep Reinforcement Learning Driven Scheduling
Boyang Li
Zhiling Lan
M. Papka
OffRL
169
1
0
24 Mar 2024
Algorithmic Complexity Attacks on Dynamic Learned Indexes
Rui Yang
Evgenios M. Kornaropoulos
Yue Cheng
AAML
184
9
0
19 Mar 2024
COSTREAM: Learned Cost Models for Operator Placement in Edge-Cloud Environments
IEEE International Conference on Data Engineering (ICDE), 2024
Roman Heinrich
Carsten Binnig
Harald Kornmayer
Manisha Luthra
80
9
0
13 Mar 2024
Towards Fair and Efficient Learning-based Congestion Control
Xudong Liao
Han Tian
Chaoliang Zeng
Xinchen Wan
Kai Chen
134
19
0
04 Mar 2024
NetLLM: Adapting Large Language Models for Networking
Duo Wu
Xianda Wang
Yaqi Qiao
Zhi Wang
Junchen Jiang
Shuguang Cui
Fangxin Wang
339
118
0
04 Feb 2024
Efficient Reinforcement Learning for Routing Jobs in Heterogeneous Queueing Systems
Neharika Jali
Guannan Qu
Weina Wang
Gauri Joshi
232
7
0
02 Feb 2024
Towards providing reliable job completion time predictions using PCS
Abdullah Bin Faisal
Noah Martin
Hafiz Mohsin Bashir
Swaminathan Lamelas
Fahad R. Dogar
213
0
0
18 Jan 2024
Deep Back-Filling: a Split Window Technique for Deep Online Cluster Job Scheduling
Lingfei Wang
Aaron Harwood
Maria A. Rodriguez
75
4
0
18 Jan 2024
A HPC Co-Scheduler with Reinforcement Learning
Abel Souza
K. Pelckmans
Johan Tordsson
89
11
0
18 Jan 2024
An Improved Scheduling with Advantage Actor-Critic for Storm Workloads
Gaoqiang Dong
Jia Wang
Mingjing Wang
Tingting Su
45
2
0
07 Dec 2023
Online Influence Maximization: Concept and Algorithm
Jianxiong Guo
161
0
0
30 Nov 2023
Predict-Then-Optimize by Proxy: Learning Joint Models of Prediction and Optimization
James Kotary
Vincenzo Di Vito
Jacob K Christopher
Pascal Van Hentenryck
Ferdinando Fioretto
205
5
0
22 Nov 2023
Tree Search in DAG Space with Model-based Reinforcement Learning for Causal Discovery
Victor-Alexandru Darvariu
Stephen Hailes
Mirco Musolesi
CML
334
3
0
20 Oct 2023
Lifting the Fog of Uncertainties: Dynamic Resource Orchestration for the Containerized Cloud
ACM Symposium on Cloud Computing (SoCC), 2023
Yuqiu Zhang
Tongkun Zhang
Gengrui Zhang
Hans-Arno Jacobsen
215
6
0
29 Sep 2023
DOMAIN: MilDly COnservative Model-BAsed OfflINe Reinforcement Learning
Xiao-Yin Liu
Xiao-Hu Zhou
Mei-Jiang Gui
Shiqi Liu
Zhen-Qiu Feng
Hao Li
Mei-Jiang Gui
Tian-Yu Xiang
De-Xing Huang
Zeng-Guang Hou
OffRL
OOD
520
7
0
16 Sep 2023
Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learning
IEEE transactions on computers (IEEE Trans. Comput.), 2023
Binqi Sun
Mirco Theile
Z. Qin
Daniele Bernardini
Debayan Roy
Andrea Bastoni
Marco Caccamo
151
12
0
28 Aug 2023
Accelerating Exact Combinatorial Optimization via RL-based Initialization -- A Case Study in Scheduling
Jiaqi Yin
Cunxi Yu
100
4
0
19 Aug 2023
A3D: Adaptive, Accurate, and Autonomous Navigation for Edge-Assisted Drones
IEEE/ACM Transactions on Networking (TON), 2023
Liekang Zeng
Haowei Chen
Daipeng Feng
Xiaoxi Zhang
Xu Chen
153
17
0
19 Jul 2023
Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Guihong Li
Duc-Tuong Hoang
Kartikeya Bhardwaj
Ming Lin
Zinan Lin
R. Marculescu
393
39
0
05 Jul 2023
Mirage: Towards Low-interruption Services on Batch GPU Clusters with Reinforcement Learning
International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2023
Qi-Dong Ding
Pengfei Zheng
Shreyas Kudari
Shivaram Venkataraman
Zhao-jie Zhang
VLM
OffRL
164
5
0
25 Jun 2023
1
2
3
4
Next