期刊
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING
卷 184, 期 -, 页码 -出版社
ACADEMIC PRESS INC ELSEVIER SCIENCE
DOI: 10.1016/j.jpdc.2023.104796
关键词
Heterogeneous GPU clusters; GPU utilization; Graph convolution network; Hierarchical spatial
This study proposes a Multi-Scenarios Adaptive Hierarchical Spatial Graph Convolution Network (MSHGN) model for accurately predicting GPU utilization rates in heterogeneous GPU clusters. By constructing multiple scenarios' undirected graphs and using Graph Convolution Neural (GCN) to capture spatial dependency relationships, the MSHGN model achieves superior accuracy and robustness in predicting resource utilization on a real-world Alibaba dataset.
Accurately predicting GPU utilization is crucial for effectively managing heterogeneous GPU clusters, yet existing prediction methods are tailored to homogeneous clusters or ignore the unique characteristics of heterogeneous ones. To address this problem, we propose the Multi-Scenarios Adaptive Hierarchical Spatial Graph Convolution Network (MSHGN) model. This model leverages the hierarchical relationships among users, tasks, and machines to construct multiple scenarios' undirected graphs and uses Graph Convolution Neural (GCN) to capture the spatial dependency relationships between the computational resources consumed during execution. The MSHGN model accurately predicts the future GPU utilization rates of each machine in a heterogeneous GPU cluster, achieving an RMSE of only 0.0101, an MAE of 0.0072, and an MAPE of 0.0641. We evaluate the MSHGN model on a real-world Alibaba dataset collected from a heterogeneous GPU cluster and find that it achieves superior accuracy and robustness in predicting resource utilization, outperforming other baseline models.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据