Cache Stampede & Thundering Herd Defenses

A Cache Stampede (also referred to as the Thundering Herd Problem or Cache Breakdown) is a catastrophic failure scenario that occurs in high-concurrency systems when an intensely accessed, computationally expensive cached key expires or is evicted:

The Anatomy of the Meltdown:

1. The Hot Key: A key (e.g., homepage:top_deals or live_match_score) receives 10,000 requests per second with a 99.99\% cache hit ratio.
2. Instant Expiration: At 12:00:00 UTC, the key's 1-hour TTL expires, and Redis evicts it.
3. The Stampede: At 12:00:01 UTC, all 10,000 concurrent requests encounter a cache miss simultaneously.
4. Database Meltdown: All 10,000 application worker threads bypass the cache and fire complex multi-table SQL join queries directly at the primary database at the exact same millisecond.
5. Cascading Failure: The database CPU hits 100\%, connection pools are exhausted, queries time out, application threads hang, and the entire platform crashes.