Research and ACM SRC Posters Archive

Benchmarking AI Vector Databases for Genesis Mission


Poster Type: Research Posters

Author: Tolga Bilgis (Los Alamos National Laboratory (LANL), Clemson University), Andrea Fabian Navarro (Los Alamos National Laboratory (LANL), University of Texas at San Antonio), Giancarlo Saint-Lo (Los Alamos National Laboratory (LANL), University of Texas at San Antonio)

Abstract: In support of the Genesis Mission, the U.S. government's national AI initiative, Circe is an HPC-hosted AI service environment that supports model access, custom knowledge databases, and external tool integration. A central feature of Circe is effective retrieval-augmented generation (RAG), which requires streamlined vector databases. This work aims to identify and recommend the best-performing vector database backend for Circe's RAG services, promoting efficient and accurate query retrieval at scale.

We benchmarked five databases—Qdrant, Redis, Weaviate, ChromaDB, and Elasticsearch—using Qdrant's vector-db-benchmark framework, comparing their scalability, query speed, latency, and retrieval accuracy across three configurations. Redis achieved the strongest baseline performance, with Weaviate following closely behind. With tuning, Weaviate reached the highest throughput (3,002.3 requests per second), while Qdrant demonstrated the largest proportional improvement (620.0 to 1,504.3 requests per second). We conclude that Weaviate is the strongest candidate for maximum query speed, while Qdrant offers the greatest flexibility for tuning.

Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing