Cohere-10M — 2026-06-12
r8i.16xlarge · peak recall 0.9957 @ 48 QPS
QPS at recall
| Recall | mkt-n12000-cctrue-fs16-soar | mkt-n12000-cctrue-fs16-soar-cfs | mkt-n16000-cctrue-fs16-soar | mkt-n16000-cctrue-fs16-soar-cfs | mkt-n20000-cctrue-fs16-soar | mkt-n20000-cctrue-fs16-soar-cfs | mkt-n24000-cctrue-fs16-soar | mkt-n24000-cctrue-fs16-soar-cfs |
|---|---|---|---|---|---|---|---|---|
| 0.90 | 416 | 452 | 430 | 487 | 467 | 544 | 473 | 533 |
| 0.95 | 242 | 250 | 251 | 264 | 262 | 288 | 257 | 290 |
| 0.99 | 78 | 79 | 80 | 80 | 82 | 88 | 84 | 92 |
Latency at recall
| mkt-n12000-cctrue-fs16-soar | mkt-n12000-cctrue-fs16-soar-cfs | mkt-n16000-cctrue-fs16-soar | mkt-n16000-cctrue-fs16-soar-cfs | mkt-n20000-cctrue-fs16-soar | mkt-n20000-cctrue-fs16-soar-cfs | mkt-n24000-cctrue-fs16-soar | mkt-n24000-cctrue-fs16-soar-cfs | |
|---|---|---|---|---|---|---|---|---|
| @ recall 0.90 | ||||||||
| p50 | 2.37 ms | 2.19 ms | 2.31 ms | 2.03 ms | 2.13 ms | 1.81 ms | 2.08 ms | 1.84 ms |
| p95 | 2.96 ms | 2.78 ms | 2.79 ms | 2.55 ms | 2.57 ms | 2.31 ms | 2.58 ms | 2.39 ms |
| p99 | 3.24 ms | 3.04 ms | 3.04 ms | 2.79 ms | 2.80 ms | 2.52 ms | 2.79 ms | 2.69 ms |
| @ recall 0.95 | ||||||||
| p50 | 4.10 ms | 3.97 ms | 3.96 ms | 3.75 ms | 3.81 ms | 3.43 ms | 3.84 ms | 3.42 ms |
| p95 | 5.00 ms | 5.04 ms | 4.72 ms | 4.56 ms | 4.48 ms | 4.28 ms | 4.70 ms | 4.32 ms |
| p99 | 5.56 ms | 5.53 ms | 5.13 ms | 5.00 ms | 4.88 ms | 4.80 ms | 5.32 ms | 4.80 ms |
| @ recall 0.99 | ||||||||
| p50 | 12.74 ms | 12.53 ms | 12.41 ms | 12.47 ms | 12.37 ms | 11.34 ms | 11.83 ms | 10.84 ms |
| p95 | 14.99 ms | 15.49 ms | 14.18 ms | 14.26 ms | 14.13 ms | 13.38 ms | 14.16 ms | 13.30 ms |
| p99 | 16.10 ms | 16.59 ms | 14.93 ms | 15.14 ms | 15.17 ms | 14.65 ms | 15.74 ms | 14.21 ms |
All values are taken at exactly the stated recall: each configuration's own sweep is log-interpolated between its two surrounding measured points (measured values are used verbatim on an exact hit) and the best configuration at that recall is shown — values are never interpolated across different configurations. “—” means no single sweep spans that recall; nothing is extrapolated. Recall is distance-based (ann-benchmarks, tie-aware). Insert/update/delete workloads are not measured.
Build comparison
| mkt-n12000-cctrue-fs16-soar | mkt-n12000-cctrue-fs16-soar-cfs | mkt-n16000-cctrue-fs16-soar | mkt-n16000-cctrue-fs16-soar-cfs | mkt-n20000-cctrue-fs16-soar | mkt-n20000-cctrue-fs16-soar-cfs | mkt-n24000-cctrue-fs16-soar | mkt-n24000-cctrue-fs16-soar-cfs | |
|---|---|---|---|---|---|---|---|---|
| Build time | 614 s | 171 s | 215 s | 214 s | 295 s | 277 s | 314 s | 311 s |
| Index size | 2.2 GB | 2.2 GB | 2.3 GB | 2.3 GB | 2.3 GB | 2.3 GB | 2.3 GB | 2.3 GB |
Plots
Pareto svg · Distance-recall svg · Per-config svg · Build times svg · Index sizes svg
Host
| Instance type | r8i.16xlarge |
| Hostname | ip-172-31-73-29 |
| CPU | Intel(R) Xeon(R) 6975P-C (64 vCPU) |
| Memory | 496 GB |
| OS | Ubuntu 26.04 LTS |
| Kernel | 7.0.0-1006-aws |
Versions
| rekall | 0.1.0 (77145bf / main) |
| PostgreSQL | PostgreSQL 18.4 (Ubuntu 18.4-1.pgdg26.04+1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 15.2.0-16ubuntu1) 15.2.0, 64-bit |
| meerkat | 0.1.0 (8e85a2b) |
| pg_prewarm | 1.2 |
| vector | 0.8.2 |
| meerkat branch | perf/fastscan-centroids |
Search
| k | 10 |
| runs | 3 |
| warmup | 500 |
| num_queries | 10000 |
| S3 archive | s3://rekall-bench/runs/cohere-10m/2026-06-12/r8i.16xlarge-152510/ |
Index builds
| Index | Type | Build time | Size | Workers |
|---|---|---|---|---|
| mkt-n12000-cctrue-fs16-soar | meerkat | 613.7s | 2.2 GB | 32 |
| mkt-n12000-cctrue-fs16-soar-cfs | meerkat | 171.0s | 2.2 GB | 32 |
| mkt-n16000-cctrue-fs16-soar | meerkat | 215.2s | 2.3 GB | 32 |
| mkt-n16000-cctrue-fs16-soar-cfs | meerkat | 213.8s | 2.3 GB | 32 |
| mkt-n20000-cctrue-fs16-soar | meerkat | 295.0s | 2.3 GB | 32 |
| mkt-n20000-cctrue-fs16-soar-cfs | meerkat | 276.5s | 2.3 GB | 32 |
| mkt-n24000-cctrue-fs16-soar | meerkat | 314.2s | 2.3 GB | 32 |
| mkt-n24000-cctrue-fs16-soar-cfs | meerkat | 311.3s | 2.3 GB | 32 |
Index parameters
mkt-n12000-cctrue-fs16-soar: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":null,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":12000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n12000-cctrue-fs16-soar-cfs: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":true,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":12000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n16000-cctrue-fs16-soar: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":null,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":16000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n16000-cctrue-fs16-soar-cfs: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":true,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":16000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n20000-cctrue-fs16-soar: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":null,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":20000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n20000-cctrue-fs16-soar-cfs: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":true,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":20000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n24000-cctrue-fs16-soar: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":null,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":24000,"rerank_vectors":null,"soar_lambda":1.0}
mkt-n24000-cctrue-fs16-soar-cfs: {"boundary_epsilon":0.05,"centroid_compression":true,"centroid_fastscan":true,"fan_out":null,"fastscan":true,"fastscan_bits":null,"nlist":24000,"rerank_vectors":null,"soar_lambda":1.0}
PostgreSQL settings
effective_cache_size = 384 GB effective_io_concurrency = 256 huge_pages = try maintenance_work_mem = 204 GB max_connections = 100 max_parallel_maintenance_workers = 32 max_parallel_workers = 64 random_page_cost = 1.1 shared_buffers = 128 GB wal_level = replica work_mem = 1 GB