Journal
BIG DATA RESEARCH
Volume 8, Issue -, Pages 50-56Publisher
ELSEVIER
DOI: 10.1016/j.bdr.2017.01.005
Keywords
Big-data; Deep-learning; Prototyping; GPGPU; Cluster; Parallel programming
Categories
Funding
- Portuguese National Foundation for Science and Technology (FCT) [SFRH/BD/84448/2012]
- Fundação para a Ciência e a Tecnologia [SFRH/BD/84448/2012] Funding Source: FCT
Ask authors/readers for more resources
Big Data concerns with large-volume complex growing data. Given the fast development of data storage and network, organizations are collecting large ever-growing datasets that can have useful information. In order to extract information from these datasets within useful time, it is important to use distributed and parallel algorithms. One common usage of big data is machine learning, in which collected data is used to predict future behavior. Deep-Learning using Artificial Neural Networks is one of the popular methods for extracting information from complex datasets. Deep-learning is capable of more creating complex models than traditional probabilistic machine learning techniques. This work presents a step-by-step guide on how to prototype a Deep-Learning application that executes both on GPU and CPU clusters. Python and Redis are the core supporting tools of this guide. This tutorial will allow the reader to understand the basics of building a distributed high performance GPU application in a few hours. Since we do not depend on any deep-learning application or framework-we use low-level building blocks-this tutorial can be adjusted for any other parallel algorithm the reader might want to prototype on Big Data. Finally, we will discuss how to move from a prototype to a fully blown production application. (C) 2017 Elsevier Inc. All rights reserved.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available