Cohere-100M — 2026-09-03

r8i.4xlarge · peak recall 0.9971 @ 19 QPS

QPS at recall

Recall	mkt-defaults
0.90	461
0.95	199
0.99	48

Latency at recall

	mkt-defaults
@ recall 0.90
p50	2.13 ms
p95	2.75 ms
p99	3.45 ms
@ recall 0.95
p50	4.95 ms
p95	6.27 ms
p99	7.25 ms
@ recall 0.99
p50	20.82 ms
p95	24.91 ms
p99	27.49 ms

All values are taken at exactly the stated recall: each configuration's own sweep is log-interpolated between its two surrounding measured points (measured values are used verbatim on an exact hit) and the best configuration at that recall is shown — values are never interpolated across different configurations. “—” means no single sweep spans that recall; nothing is extrapolated. Recall is distance-based (ann-benchmarks, tie-aware). Insert/update/delete workloads are not measured.

Build comparison

	mkt-defaults
Build time	5897 s
Index size	24.9 GB

Plots

Pareto svg · Distance-recall svg · Per-config svg · Build times svg · Index sizes svg

Host

Instance type	r8i.4xlarge
Hostname	ip-172-31-14-230
CPU	Intel(R) Xeon(R) 6975P-C (16 vCPU)
Memory	124 GB
OS	Ubuntu 26.04.1 LTS
Kernel	7.0.0-1011-aws

Versions

rekall	0.1.0 (90330ec / main)
PostgreSQL	PostgreSQL 18.6 (Ubuntu 18.6-1.pgdg26.04+2) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 15.2.0-16ubuntu1) 15.2.0, 64-bit
meerkat	0.1.0 (bdffa10)
pg_prewarm	1.2
vector	0.8.6

Search

k	10
runs	3
warmup	500
num_queries	10000
S3 archive	s3://rekall-bench/runs/cohere-100m/2026-09-03/r8i.4xlarge-100157/

Index builds

Index	Type	Build time	Size	Workers
mkt-defaults	meerkat	5897.4s	24.9 GB	8

Index parameters

mkt-defaults: {"boundary_epsilon":null,"centroid_compression":null,"centroid_fastscan":null,"fan_out":null,"fastscan":null,"fastscan_bits":null,"nlist":null,"rerank_vectors":null,"soar_lambda":null}

Instance settings (observed)

instance type          r8i.4xlarge
vCPU (observed)        16
memory (observed)      123.8 GiB
cpu model              Intel(R) Xeon(R) 6975P-C
kernel                 7.0.0-1011-aws
data directory         /var/lib/postgresql/18/main
mount point            /
filesystem             ext4
media                  unknown
device                 root
provisioned IOPS       — not an EBS volume

PostgreSQL settings

checkpoint_completion_target = 0.9
cluster_name = 18/main
data_directory = /var/lib/postgresql/18/main
effective_cache_size = 96 GB
effective_io_concurrency = 256
huge_pages = try
jit = off
maintenance_io_concurrency = 256
maintenance_work_mem = 51 GB
max_connections = 100
max_parallel_maintenance_workers = 8
max_parallel_workers = 16
max_wal_size = 32 GB
random_page_cost = 1.1
server_version = 18.6 (Ubuntu 18.6-1.pgdg26.04+2)
shared_buffers = 32 GB
wal_level = replica
work_mem = 1 GB