Journal
IEEE TRANSACTIONS ON BIG DATA
Volume 8, Issue 1, Pages 85-98Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TBDATA.2017.2758791
Keywords
Cloud storage; peer-to-peer storage system; data availability; data durability; volunteered cloud; desktop grid
Funding
- French Agence Nationale de la Recherche through the Clouds@home grant [ANR-09-JCJC-0056-01]
- French Agence Nationale de la Recherche through the MapReduce grant [ANR-10-SEGI-001]
- INRIA ARC BitDew
- National Natural Science Foundation of China [61602169, 61300129, 61572186]
- Hunan Provincial Natural Science Foundation of China [2015JJ3071, 2017JJ2101]
- Scientific Research Fund of Hunan Provincial Education Department [16K030, 16C0643, 15K043, 12C0121]
- CNRS
- RENATER
Ask authors/readers for more resources
This paper proposes a hybrid storage framework called WukaStore, which integrates stable and volatile storage to offer scalable, configurable, and reliable big data storage service. By configuring different storage strategies, WukaStore can meet user requirements and provide cost-effective storage solutions.
In this paper, we propose a hybrid storage framework WukaStore, which offers a scalable, configurable and reliable big data storage service by integrating stable storage (such as Cloud storage or durable storage utilities) and volatile storage (such as idle storage harnessed from desktop PCs over the Internet). By configuring different storage strategies, WukaStore delivers cost-effective storage service to satisfy users' requirements. We present trace-driven simulations to study the impact of different strategies and how to ensure high availability and durability in WukaStore. We present the prototype implementation of WukaStore based on BitDew, an open source middleware for Big Data management. We conduct performance evaluations to validate the effectiveness of WukaStore, through the deployment of WukaStore in the French Grid'5000 experimental platform. In particular, we also present a case study where WukaStore is deployed in a hybrid environment taking advantage of storage provided by Amazon S3, Dropbox and a local Desktop Grid at the same time. Our evaluation results show that WukaStore provides users with an alternative method to store their big data on hybrid volunteered cloud and desktop systems and to decrease the cost of data storage, while providing great data access performance, scalability as well as reliability.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available