FMtree: A fast locating algorithm of FM-indexes for genomic data

TL;DR

FMtree is a novel quadtree-based locating algorithm that significantly accelerates pattern occurrence retrieval in FM-indexes for genomic data, outperforming existing methods by an order of magnitude while maintaining memory efficiency.

Contribution

The paper introduces FMtree, a new quadtree-based locating algorithm that improves the speed of pattern occurrence retrieval in FM-indexes for genomic data.

Findings

FMtree is about ten times faster than previous algorithms.

FMtree maintains memory efficiency despite increased speed.

Experimental results validate FMtree's superior performance.

Abstract

Motivation: As a fundamental task in bioinformatics, searching for massive short patterns over a long text is widely accelerated by various compressed full-text indexes. These indexes are able to provide similar searching functionalities to classical indexes, e.g., suffix trees and suffix arrays, while requiring less space. For genomic data, a well-known family of compressed full-text index, called FM-indexes, presents unmatched performance in practice. One major drawback of FM-indexes is that their locating operations, which report all occurrence positions of patterns in a given text, are particularly slow, especially for the patterns with many occurrences. Results: In this paper, we introduce a novel locating algorithm, FMtree, to fast retrieve all occurrence positions of any pattern via FM-indexes. When searching for a pattern over a given text, FMtree organizes the search space of the locating operation into a conceptual quadtree. As a result, multiple occurrence positions of this pattern can be retrieved simultaneously by traversing the quadtree. Compared with the existing locating algorithms, our tree-based algorithm reduces large numbers of redundant operations and presents better data locality. Experimental results show that FMtree is usually one order of magnitude faster than the state-of-the-art algorithms, and still memory-efficient.