bioRxiv · 10.1101/205328
Scaling read aligners to hundreds of threads on general-purpose processors
Abstract
General-purpose processors can now contain many dozens of processor cores and support hundreds of simultaneous threads of execution. To make best use of these threads, genomics software must contend with new and subtle computer architecture issues. We discuss some of these and propose methods for improving thread scaling in tools that analyze each read independently, such as read aligners. We implement these methods in new versions of Bowtie, Bowtie 2 and HISAT. We greatly improve thread scaling in many scenarios, including on the recent Intel Xeon Phi architecture. We also highlight how bottlenecks are exacerbated by variable-record-length file formats like FASTQ and suggest changes that enable superior scaling.
Source connections
Explore related subjects
Keep this discovery
Langmead, B., Wilks, C., Antonescu, V., Charles, R.. 2017-10-24. Scaling read aligners to hundreds of threads on general-purpose processors. https://doi.org/10.1101/205328
Cite the original work for its findings. Save a collection to share your selection of sources.