Model
Cache leverage
Hit rate is leverage, and leverage is fragility. A one-point drop in hit rate at 99% doubles the load on the layer below.
- Hit rate
- the fraction of reads the cache serves
- Read rate
- reads arriving at the cache
How it behaves
One input on the horizontal axis, the others held fixed.
Data table
| Hit rate h | Leverage 1/(1 − h) |
|---|---|
| 0 | 1× |
| 0.012 | 1.01× |
| 0.025 | 1.03× |
| 0.037 | 1.04× |
| 0.05 | 1.05× |
| 0.062 | 1.07× |
| 0.075 | 1.08× |
| 0.087 | 1.1× |
| 0.1 | 1.11× |
| 0.112 | 1.13× |
| 0.124 | 1.14× |
| 0.137 | 1.16× |
| 0.149 | 1.18× |
| 0.162 | 1.19× |
| 0.174 | 1.21× |
| 0.187 | 1.23× |
| 0.199 | 1.25× |
| 0.211 | 1.27× |
| 0.224 | 1.29× |
| 0.236 | 1.31× |
| 0.249 | 1.33× |
| 0.261 | 1.35× |
| 0.274 | 1.38× |
| 0.286 | 1.4× |
| 0.298 | 1.43× |
| 0.311 | 1.45× |
| 0.323 | 1.48× |
| 0.336 | 1.51× |
| 0.348 | 1.53× |
| 0.361 | 1.56× |
| 0.373 | 1.6× |
| 0.386 | 1.63× |
| 0.398 | 1.66× |
| 0.41 | 1.7× |
| 0.423 | 1.73× |
| 0.435 | 1.77× |
| 0.448 | 1.81× |
| 0.46 | 1.85× |
| 0.473 | 1.9× |
| 0.485 | 1.94× |
| 0.497 | 1.99× |
| 0.51 | 2.04× |
| 0.522 | 2.09× |
| 0.535 | 2.15× |
| 0.547 | 2.21× |
| 0.56 | 2.27× |
| 0.572 | 2.34× |
| 0.585 | 2.41× |
| 0.597 | 2.48× |
| 0.609 | 2.56× |
| 0.622 | 2.64× |
| 0.634 | 2.73× |
| 0.647 | 2.83× |
| 0.659 | 2.93× |
| 0.672 | 3.05× |
| 0.684 | 3.17× |
| 0.697 | 3.29× |
| 0.709 | 3.44× |
| 0.721 | 3.59× |
| 0.734 | 3.76× |
| 0.746 | 3.94× |
| 0.759 | 4.14× |
| 0.771 | 4.37× |
| 0.784 | 4.62× |
| 0.796 | 4.9× |
| 0.808 | 5.22× |
| 0.821 | 5.58× |
| 0.833 | 6× |
| 0.846 | 6.48× |
| 0.858 | 7.05× |
| 0.871 | 7.73× |
| 0.883 | 8.55× |
| 0.895 | 9.57× |
| 0.908 | 10.9× |
| 0.92 | 12.6× |
| 0.933 | 14.9× |
| 0.945 | 18.3× |
| 0.958 | 23.6× |
| 0.97 | 33.5× |
| 0.983 | 57.3× |
| 0.995 | 200× |
Worked examples, recomputed
Every number the mechanisms quote for this relationship is recomputed from it, so none of them disagrees with it.
- h = 95% → 20 to 1
- h = 99% → 100 to 1
- 99% → 98% doubles the load below
- h = 0.9 → 10× on a cold restart
- h = 0.99 → 100× on a cold restart
- h = 0.999 → 1000× on a cold restart
Where it appears
Each mechanism states it in its own names. The general symbol each name stands for is shown with it.
- Caching
What happens when we deliberately keep a second copy of data that no protocol forces to be correct?
- Emergent Failure Dynamics
What happens when nothing is broken, every component is healthy, and the system's own response to stress makes the stress worse?