Average API latency is 200ms, but p99 is 8 seconds. What is the real problem, and why does average latency hide it?

Tests whether you know averages mask tail latency, and that a small fraction of very slow requests is often the actual production issue.