advancedScenario-Based & System Design Questions

A service exhibits high latency only for the first request after being idle for a while, then performs normally.

This is typically a cold-start effect — connection pools, JIT warm-up (for JVM-based apps), or lazy-loaded caches/resources initializing on first real use rather than at startup. Diagnose by comparing cold vs. warm request timing directly, and mitigate with readiness probes that don't mark the service ready until a warm-up routine completes, or a startup-time warm-up request/script that pre-triggers the slow initialization before traffic is routed to the instance.

This is a Pro chapter

Sign in, then upgrade to Pro or Power to unlock this and the full DevOps Mastery library.

A service exhibits high latency only for the first request after being idle for a while, then performs normally.

Next Step

Continue to A `docker compose up --scale api=3` command succeeds but only one of the three replicas ever receives traffic.← Back to all Docker questions