机构:[1]BGI-Shenzhen, Shenzhen 518083[2]Geneplus-Beijing, Beijing 102206[3]Department of Oncology, Fujian Medical University Union Hospital, Fuzhou 350001[4]Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou 350014[5]Department of Stem Cell Research Institute, Fujian Medical University Stem Cell Research Institute, Fuzhou 350000[6]Collaborative Innovation Center of High Performance Computing, National University of Defense Technology, Changsha 410073[7]Intel China Ltd., Shanghai 200336[8]Guangdong Provincial Hospital of Chinese Medicine, Guangzhou 510120广东省中医院[9]Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong[10]James D. Watson Institute of Genome Sciences, Hangzhou 310058, China
Quality control (QC) and preprocessing are essential steps for sequencing data analysis to ensure the accuracy of results. However, existing tools cannot provide a satisfying solution with integrated comprehensive functions, proper architectures, and highly scalable acceleration. In this article, we demonstrate SOAPnuke as a tool with abundant functions for a "QC-Preprocess-QC" workflow and MapReduce acceleration framework. Four modules with different preprocessing functions are designed for processing datasets from genomic, small RNA, Digital Gene Expression, and metagenomic experiments, respectively. As a workflow-like tool, SOAPnuke centralizes processing functions into 1 executable and predefines their order to avoid the necessity of reformatting different files when switching tools. Furthermore, the MapReduce framework enables large scalability to distribute all the processing works to an entire compute cluster. We conducted a benchmarking where SOAPnuke and other tools are used to preprocess a similar to 30x NA12878 dataset published by GIAB. The standalone operation of SOAPnuke struck a balance between resource occupancy and performance. When accelerated on 16 working nodes with MapReduce, SOAPnuke achieved similar to 5.7 times the fastest speed of other tools.
基金:
Collaborative Innovation Center of High Performance Computing; Science and Technology Bureau of Fujian Province, China [2013YZ0002-2]; Natural Science and Health Foundation of Fujian Province, China [2015J01397]
通讯机构:[1]BGI-Shenzhen, Shenzhen 518083[3]Department of Oncology, Fujian Medical University Union Hospital, Fuzhou 350001[4]Fujian Key Laboratory of Translational Cancer Medicine, Fuzhou 350014[5]Department of Stem Cell Research Institute, Fujian Medical University Stem Cell Research Institute, Fuzhou 350000[6]Collaborative Innovation Center of High Performance Computing, National University of Defense Technology, Changsha 410073
推荐引用方式(GB/T 7714):
Chen Yuxin,Chen Yongsheng,Shi Chunmei,et al.SOAPnuke: a MapReduce acceleration-supported software for integrated quality control and preprocessing of high-throughput sequencing data[J].GIGASCIENCE.2017,7(1):doi:10.1093/gigascience/gix120.
APA:
Chen, Yuxin,Chen, Yongsheng,Shi, Chunmei,Huang, Zhibo,Zhang, Yong...&Chen, Qiang.(2017).SOAPnuke: a MapReduce acceleration-supported software for integrated quality control and preprocessing of high-throughput sequencing data.GIGASCIENCE,7,(1)
MLA:
Chen, Yuxin,et al."SOAPnuke: a MapReduce acceleration-supported software for integrated quality control and preprocessing of high-throughput sequencing data".GIGASCIENCE 7..1(2017)