期刊
GIGASCIENCE
卷 7, 期 1, 页码 -出版社
OXFORD UNIV PRESS
DOI: 10.1093/gigascience/gix120
关键词
high-throughput sequencing; quality control; preprocessing; MapReduce
资金
- Collaborative Innovation Center of High Performance Computing
- Science and Technology Bureau of Fujian Province, China [2013YZ0002-2]
- Natural Science and Health Foundation of Fujian Province, China [2015J01397]
Quality control (QC) and preprocessing are essential steps for sequencing data analysis to ensure the accuracy of results. However, existing tools cannot provide a satisfying solution with integrated comprehensive functions, proper architectures, and highly scalable acceleration. In this article, we demonstrate SOAPnuke as a tool with abundant functions for a QC-Preprocess-QC workflow and MapReduce acceleration framework. Four modules with different preprocessing functions are designed for processing datasets from genomic, small RNA, Digital Gene Expression, and metagenomic experiments, respectively. As a workflow-like tool, SOAPnuke centralizes processing functions into 1 executable and predefines their order to avoid the necessity of reformatting different files when switching tools. Furthermore, the MapReduce framework enables large scalability to distribute all the processing works to an entire compute cluster. We conducted a benchmarking where SOAPnuke and other tools are used to preprocess a similar to 30x NA12878 dataset published by GIAB. The standalone operation of SOAPnuke struck a balance between resource occupancy and performance. When accelerated on 16 working nodes with MapReduce, SOAPnuke achieved similar to 5.7 times the fastest speed of other tools.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据