4.7 Article

Performance and Cost-Efficient Spark Job Scheduling Based on Deep Reinforcement Learning in Cloud Computing Environments

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Automation & Control Systems

Biobjective Task Scheduling for Distributed Green Data Centers

Haitao Yuan et al.

Summary: The research aims to maximize profit and minimize task loss for DGDCs by jointly determining the task split among multiple ISPs. A new method utilizing the SBDE algorithm is proposed to solve a multiobjective optimization problem, achieving lower task loss and larger profit than existing algorithms. Future work should focus on real-time green energy prediction and integrating it with task scheduling for greener data centers.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2021)

Article Computer Science, Information Systems

An energy-aware scheduling algorithm for big data applications in Spark

Hongjian Li et al.

CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS (2020)

Article Automation & Control Systems

Path planning for intelligent robots based on deep Q-learning with experience replay and heuristic knowledge

Lan Jiang et al.

IEEE-CAA JOURNAL OF AUTOMATICA SINICA (2020)

Article Automation & Control Systems

Fine-Grained Resource Provisioning and Task Scheduling for Heterogeneous Applications in Distributed Green Clouds

Haitao Yuan et al.

IEEE-CAA JOURNAL OF AUTOMATICA SINICA (2020)

Article Automation & Control Systems

Scheduling Semiconductor Testing Facility by Using Cuckoo Search Algorithm With Reinforcement Learning and Surrogate Modeling

ZhengCai Cao et al.

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING (2019)

Article Computer Science, Artificial Intelligence

Explore Deep Neural Network and Reinforcement Learning to Large-scale Tasks Processing in Big Data

Chunyi Wu et al.

INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE (2019)

Article Computer Science, Information Systems

A Novel Task Provisioning Approach Fusing Reinforcement Learning for Big Data

Yongyi Cheng et al.

IEEE ACCESS (2019)

Proceedings Paper Computer Science, Information Systems

Deep Smart Scheduling: A Deep Learning Approach for Automated Big Data Scheduling over the Cloud

Gaith Rjoub et al.

2019 7TH INTERNATIONAL CONFERENCE ON FUTURE INTERNET OF THINGS AND CLOUD (FICLOUD 2019) (2019)

Article Computer Science, Information Systems

Energy and Delay Tradeoff for Application Offloading in Mobile Cloud Computing

Xiumin Wang et al.

IEEE SYSTEMS JOURNAL (2017)

Article Multidisciplinary Sciences

Mastering the game of Go without human knowledge

David Silver et al.

NATURE (2017)

Proceedings Paper Computer Science, Theory & Methods

A Framework for Efficient Energy Scheduling of Spark Workloads

Stathis Maroulis et al.

2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2017) (2017)

Proceedings Paper Computer Science, Hardware & Architecture

Justice: A Deadline-aware, Fair-share Resource Allocator for Implementing Multi-analytics

Stratos Dimopoulos et al.

2017 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER) (2017)

Article Computer Science, Hardware & Architecture

Apache Spark: A Unified Engine for Big Data Processing

Matei Zaharia et al.

COMMUNICATIONS OF THE ACM (2016)

Proceedings Paper Computer Science, Theory & Methods

OptEx: A Deadline-Aware Cost Optimization Model for Spark

Subhajit Sidhanta et al.

2016 16TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID) (2016)

Article Multidisciplinary Sciences

Human-level control through deep reinforcement learning

Volodymyr Mnih et al.

NATURE (2015)

Article Computer Science, Software Engineering

Quasar: Resource-Efficient and QoS-Aware Cluster Management

Christina Delimitrou et al.

ACM SIGPLAN NOTICES (2014)

Article Computer Science, Information Systems

A cost-benefit analysis of using cloud computing to extend the capacity of clusters

Marcos Dias de Assuncao et al.

CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS (2010)