期刊
TEM JOURNAL-TECHNOLOGY EDUCATION MANAGEMENT INFORMATICS
卷 10, 期 2, 页码 806-814出版社
ASSOC INFORMATION COMMUNICATION TECHNOLOGY EDUCATION & SCIENCE
DOI: 10.18421/TEM102-38
关键词
HDFS; Distributed file systems; Distributed and parallel computing; Hadoop cluster
In the era of big data, the use of distributed systems like Hadoop is becoming increasingly important. This research aims to experimentally explore the factors influencing the performance of HDFS read/write operations.
In the age of big data, the amount of data that people generate and use on a daily basis has far exceeded the storage and processing capabilities of a single computer system. That motivates the use of distributed big data storage and processing system such as Hadoop. It provides a reliable, horizontally-scalable, fault-tolerant and efficient service, based on the Hadoop Distributed File System (HDFS) and MapReduce. The purpose of this research is to experimentally determine whether (and to what extent) the network communication speed, the file replication factor, the files' sizes and their number, and the location of the HDFS client influence the performance of the HDFS read/write operations.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据