Research and ACM SRC Posters Archive

SHARD-DB: Scalable Hash-Based Retrieval for High-Throughput Reference Database Construction


Poster Type: Research Posters

Author: Stephanie Anne Murray (University of Hawaii at Manoa), Lenore Pipes (University of Hawaii at Manoa)

Abstract: Reference databases tailored to metabarcoding loci are essential for environmental-DNA analysis, but constructing them can require thousands of searches against multi-terabyte nucleotide collections. CRUX-style workflows commonly expand primer-derived sequences using BLAST. SHARD-DB instead performs broad approximate retrieval with densified one-permutation MinHash and locality-sensitive hashing (LSH), followed by targeted locus localization. On a full NCBI NT MiFish workload of 10,292 queries, SHARD-DB completed retrieval and localization in 73:38 using 28.6 GiB peak RSS, while CRUX-style Merged BLAST completed in 52:16 using approximately 407 GB peak RSS. SHARD-DB retrieved 1,606,861 unique candidate accessions versus 133,387 for BLAST, providing a substantially broader reference pool for database construction. Historical matched-subset experiments also showed large SHARD-DB runtime advantages for MarVer3 16S and PR2 18S, demonstrating strong workload-dependent performance.

Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing