← all runs

Cohere-10M — 2026-06-24

r8i.4xlarge · peak recall 0.9996 @ 16 QPS

QPS at recall

RecallMeerkatpgvector HNSW (halfvec)Δ vs best competitor
0.90692446+55%
0.95352266+33%
0.998848+83%

Latency at recall

Meerkatpgvector HNSW (halfvec)Δ vs best competitor
@ recall 0.90
p501.42 ms2.21 ms-36%
p951.88 ms3.11 ms-40%
p992.09 ms3.60 ms-42%
@ recall 0.95
p502.82 ms3.81 ms-26%
p953.51 ms4.95 ms-29%
p993.83 ms5.59 ms-31%
@ recall 0.99
p5011.34 ms21.03 ms-46%
p9513.28 ms26.76 ms-50%
p9913.98 ms28.05 ms-50%

All values are taken at exactly the stated recall: each configuration's own sweep is log-interpolated between its two surrounding measured points (measured values are used verbatim on an exact hit) and the best configuration at that recall is shown — values are never interpolated across different configurations. “—” means no single sweep spans that recall; nothing is extrapolated. Recall is distance-based (ann-benchmarks, tie-aware). Insert/update/delete workloads are not measured.

Interpolated on config — Meerkat @0.90: mkt-n40000-cctrue-fs16-soar-cfs · pgvector HNSW (halfvec) @0.90: hnsw-m24-halfvec · Meerkat @0.95: mkt-n40000-cctrue-fs16-soar-cfs · pgvector HNSW (halfvec) @0.95: hnsw-m24-halfvec · Meerkat @0.99: mkt-n40000-cctrue-fs16-soar-cfs · pgvector HNSW (halfvec) @0.99: hnsw-m24-halfvec

Build comparison

Meerkatpgvector HNSW (halfvec)Δ vs best competitor
Build time1522 s4847 s-69%
Index size2.3 GB19.1 GB-88%

Build stats are for the configuration backing each column's best operating point: Meerkat = mkt-n24000-cctrue-fs16-soar-cfs · pgvector HNSW (halfvec) = hnsw-m24-halfvec.

Plots

Pareto svg  ·  Distance-recall svg  ·  Per-config svg  ·  Build times svg  ·  Index sizes svg
paretodistance-recallbuild-timesbuild-sizes

Host

Instance typer8i.4xlarge
Hostnameip-172-31-67-36
CPUIntel(R) Xeon(R) 6975P-C (16 vCPU)
Memory124 GB
OSUbuntu 26.04 LTS
Kernel7.0.0-1006-aws

Versions

rekall0.1.0 (47e1f05 / main)
PostgreSQLPostgreSQL 18.4 (Ubuntu 18.4-1.pgdg26.04+1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 15.2.0-16ubuntu1) 15.2.0, 64-bit
meerkat0.1.0 (d73b4f0)
pg_prewarm1.2
vector0.8.3

Search

k10
runs3
warmup500
num_queries10000
S3 archives3://rekall-bench/runs/cohere-10m/2026-06-24/r8i.4xlarge-182656/

Index builds

IndexTypeBuild timeSizeWorkers
hnsw-m24-halfvecpgvector-hnsw4846.9s19.1 GB8
mkt-n24000-cctrue-fs16-soar-cfsmeerkat1522.5s2.3 GB8
mkt-n40000-cctrue-fs16-soar-cfsmeerkat2143.1s2.4 GB8
Index parameters
hnsw-m24-halfvec: {"ef_construction":200,"encoding":"halfvec","m":24}
mkt-n24000-cctrue-fs16-soar-cfs: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":true,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":24000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n40000-cctrue-fs16-soar-cfs: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":true,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":40000,"rerank_vectors":null,"soar_lambda":1.0}
PostgreSQL settings
effective_cache_size = 96 GB
effective_io_concurrency = 256
huge_pages = try
maintenance_work_mem = 51 GB
max_connections = 100
max_parallel_maintenance_workers = 8
max_parallel_workers = 16
random_page_cost = 1.1
shared_buffers = 32 GB
wal_level = replica
work_mem = 1 GB