Nucleic Acids Research, 2003, Vol. 31, No. 11 2963-2974
© 2003 Oxford University Press
Efficient clustering of large EST data sets on parallel computers
Department of Computer Science, Iowa State University, Ames, IA 50011, USA, 1 Department of Electrical and Computer Engineering, Iowa State University, Ames, IA 50011, USA and 2 Department of Zoology and Genetics and Department of Statistics, Iowa State University, Ames, IA 50011, USA
*To whom correspondence should be addressed. Tel: +1 515 294 3539; Fax: +1 515 294 8432; Email: aluru{at}iastate.edu
The authors wish it to be known that, in their opinion, the first two authors should be regarded as joint First Authors
Clustering expressed sequence tags (ESTs) is a powerful strategy for gene identification, gene expression studies and identifying important genetic variations such as single nucleotide polymorphisms. To enable fast clustering of large-scale EST data, we developed PaCE (for Parallel Clustering of ESTs), a software program for EST clustering on parallel computers. In this paper, we report on the design and development of PaCE and its evaluation using Arabidopsis ESTs. The novel features of our approach include: (i) design of memory efficient algorithms to reduce the memory required to linear in the size of the input, (ii) a combination of algorithmic techniques to reduce the computational work without sacrificing the quality of clustering, and (iii) use of parallel processing to reduce run-time and facilitate clustering of larger data sets. Using a combination of these techniques, we report the clustering of 168 200 Arabidopsis ESTs in 15 min on an IBM xSeries cluster with 30 dual-processor nodes. We also clustered 327 632 rat ESTs in 47 min and 420 694 Triticum aestivum ESTs in 3 h and 15 min. We demonstrate the quality of our software using benchmark Arabidopsis EST data, and by comparing it with CAP3, a software widely used for EST assembly. Our software allows clustering of much larger EST data sets than is possible with current software. Because of its speed, it also facilitates multiple runs with different parameters, providing biologists a tool to better analyze EST sequence data. Using PaCE, we clustered EST data from 23 plant species and the results are available at the PlantGDB website.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
M. Jain, J. Shrager, E. H. Harris, R. Halbrook, A. R. Grossman, C. Hauser, and O. Vallon EST assembly supported by a draft genome sequence: an analysis of the Chlamydomonas reinhardtii transcriptome Nucleic Acids Res., April 1, 2007; (2007) gkm081v2. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. J. Emrich, L. Li, T.-J. Wen, M. D. Yandeau-Nelson, Y. Fu, L. Guo, H.-H. Chou, S. Aluru, D. A. Ashlock, and P. S. Schnable Nearly Identical Paralogs: Implications for Maize (Zea mays L.) Genome Evolution Genetics, January 1, 2007; 175(1): 429 - 439. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Malde, K. Schneeberger, E. Coward, and I. Jonassen RBR: library-less repeat detection for ESTs Bioinformatics, September 15, 2006; 22(18): 2232 - 2236. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Udall, J. M. Swanson, K. Haller, R. A. Rapp, M. E. Sparks, J. Hatfield, Y. Yu, Y. Wu, C. Dowd, A. B. Arpat, et al. A global assembly of cotton ESTs Genome Res., March 1, 2006; 16(3): 441 - 450. [Abstract] [Full Text] [PDF] |
||||
![]() |
X. Huang, S.-P. Yang, A. T. Chinwalla, L. W. Hillier, P. Minx, E. R. Mardis, and R. K. Wilson Application of a superword array in genome assembly Nucleic Acids Res., January 5, 2006; 34(1): 201 - 205. [Abstract] [Full Text] [PDF] |
||||
![]() |
Q. Dong, C. J. Lawrence, S. D. Schlueter, M. D. Wilkerson, S. Kurtz, C. Lushbough, and V. Brendel Comparative Plant Genomics Resources at PlantGDB Plant Physiology, October 1, 2005; 139(2): 610 - 618. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Fu, S. J. Emrich, L. Guo, T.-J. Wen, D. A. Ashlock, S. Aluru, and P. S. Schnable Quality assessment of maize assembled genomic islands (MAGIs) and large-scale experimental verification of predicted genes PNAS, August 23, 2005; 102(34): 12282 - 12287. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Ayele, B. J. Haas, N. Kumar, H. Wu, Y. Xiao, S. Van Aken, T. R. Utterback, J. R. Wortman, O. R. White, and C. D. Town Whole genome shotgun sequencing of Brassica oleracea and its application to gene discovery and annotation in Arabidopsis Genome Res., April 1, 2005; 15(4): 487 - 495. [Abstract] [Full Text] [PDF] |
||||
![]() |
Q. Dong, S. D. Schlueter, and V. Brendel PlantGDB, plant genome database and analysis tools Nucleic Acids Res., January 1, 2004; 32(90001): D354 - 359. [Abstract] [Full Text] [PDF] |
||||





