Telemetry

Runtime performance, latency, and throughput snapshots.

Showing aggregate metrics for the last 6h.

Avg. latency

Steady response times across nodes.

Requests/min

Current throughput for inference.

Error rate

Healthy error budgets remain.

Request throughput vs. latency.