DADOS Flow Test Report
Performance Highlights
30 minutes · 1M metrics/second · 1,659,149,726 total metrics
| Stage |
P50 |
P99 |
P99.99 |
| Total Ingestion Latency |
2.1ms ±512ns |
3.0ms ±1.0µs |
3.8ms ±1.0µs |
| Query Duration |
384.3µs ±128ns |
984.1µs ±256ns |
5.3ms ±2.0µs |
- Date: 2026-04-14
- Workload: 1M metrics/sec target, ~3k+ streams (ProveIt! flow; rate is non-uniform)
- Data window: Data shown reflects a 30 minute data capture by querying repeatedly from the live system while the test was running.
- Percentiles: Computed over the full 30-minute window.
- Clocking: All instances co-located in the AWS cluster placement group. Sub-microsecond clock alignment via Amazon Time Sync Service (PTP).
Test Environment
- Instance type: AWS
c7g.8xlarge
- CPU: 32 vCPUs (32 cores, 1 thread/core),
arm64, sustained clock 2.6 GHz (AWS Graviton3 family).
- Memory: 65,536 MiB (64 GiB).
- Networking: Up to 15 Gigabit, ENA required, encryption in transit supported.
- EBS performance: EBS-optimized by default; 10,000 Mbps bandwidth, 1,250 MB/s throughput, 40,000 IOPS baseline/max.
- Storage model: EBS-only root, no local instance store, NVMe EBS support required.
- Platform: Nitro hypervisor/system, UEFI boot mode.
- Topology: 5 brokers, 1 DADOS Flow, 1 Lightning
- Input source: Publishers replaying data from the PROVEIT virtual factory
Latency Stage Definitions
- Broker Time: Time from message publish, through the broker, to arrival in DADOS Flow.
- DADOS Flow Internal: Processing time inside the DADOS Flow process.
- Transmission Latency: Time for the network call transmitting data from DADOS Flow to DADOS Lightning.
- Total Ingestion Latency: Total time from message publish to data becoming queryable in DADOS Lightning.
- Query Duration: Time to execute the query inside the DADOS Lightning data server.
DADOS Flow Latency Statistics
- Method: HDR Histogram (hdrhistogram v7, Rust)
- Precision: 3 significant figures | Max error: ±0.05% of value
- Files: 39 parquet file(s) | Rows: 1,659,149,726
- Duration: 30 minutes at 1M metrics/second
Broker Time (dadosflow_ingress − publisher_egress)
| Stat | Value | Precision |
|---|
| Count | 1,659,149,726 | — |
| Min | 63.5µs | exact |
| Max | 7.6ms | exact |
| Mean | 1.1ms | exact |
| Std Dev | 363.2µs | exact |
| P50 | 1.1ms | ±512ns |
| P90 | 1.6ms | ±512ns |
| P95 | 1.7ms | ±512ns |
| P99 | 1.9ms | ±512ns |
| P99.9 | 2.0ms | ±512ns |
| P99.99 | 2.1ms | ±512ns |
DadosFlow Internal (dadosflow_egress − dadosflow_ingress)
| Stat | Value | Precision |
|---|
| Count | 1,659,149,726 | — |
| Min | 18.1µs | exact |
| Max | 8.1ms | exact |
| Mean | 524.5µs | exact |
| Std Dev | 162.7µs | exact |
| P50 | 549.4µs | ±256ns |
| P90 | 721.4µs | ±256ns |
| P95 | 743.4µs | ±256ns |
| P99 | 802.3µs | ±256ns |
| P99.9 | 916.0µs | ±256ns |
| P99.99 | 1.1ms | ±512ns |
Transmission Latency (lightning_ingress − dadosflow_egress)
| Stat | Value | Precision |
|---|
| Count | 1,659,149,726 | — |
| Min | 133.8µs | exact |
| Max | 11.5ms | exact |
| Mean | 366.2µs | exact |
| Std Dev | 93.7µs | exact |
| P50 | 364.8µs | ±128ns |
| P90 | 429.1µs | ±128ns |
| P95 | 460.8µs | ±128ns |
| P99 | 743.9µs | ±256ns |
| P99.9 | 1.3ms | ±512ns |
| P99.99 | 1.6ms | ±512ns |
Total Ingestion Latency (lightning_ingress − publisher_egress)
| Stat | Value | Precision |
|---|
| Count | 1,659,149,726 | — |
| Min | 357.1µs | exact |
| Max | 14.0ms | exact |
| Mean | 2.0ms | exact |
| Std Dev | 513.1µs | exact |
| P50 | 2.1ms | ±512ns |
| P90 | 2.7ms | ±1.0µs |
| P95 | 2.8ms | ±1.0µs |
| P99 | 3.0ms | ±1.0µs |
| P99.9 | 3.4ms | ±1.0µs |
| P99.99 | 3.8ms | ±1.0µs |
Query Duration (sys_query_duration_us)
| Stat | Value | Precision |
|---|
| Count | 1,659,149,726 | — |
| Min | 57.0µs | exact |
| Max | 5.5ms | exact |
| Mean | 383.8µs | exact |
| Std Dev | 276.6µs | exact |
| P50 | 384.3µs | ±128ns |
| P90 | 674.3µs | ±256ns |
| P95 | 743.4µs | ±256ns |
| P99 | 984.1µs | ±256ns |
| P99.9 | 4.1ms | ±1.0µs |
| P99.99 | 5.3ms | ±2.0µs |
Charts
1) Latency Histograms
2) Latency Cumulative Distribution Functions
3) Latency Heatmaps
