Skip to content
About
Main content
Model

Cache leverage

Hit rate is leverage, and leverage is fragility. A one-point drop in hit rate at 99% doubles the load on the layer below.

Hit rate
the fraction of reads the cache serves
Read rate
reads arriving at the cache

Recurring principle: Undeclared dependencies

How it behaves

One input on the horizontal axis, the others held fixed.

Data table
How many reads one backing-store read stands for, by hit rate
Hit rate hLeverage 1/(1 − h)
01×
0.0121.01×
0.0251.03×
0.0371.04×
0.051.05×
0.0621.07×
0.0751.08×
0.0871.1×
0.11.11×
0.1121.13×
0.1241.14×
0.1371.16×
0.1491.18×
0.1621.19×
0.1741.21×
0.1871.23×
0.1991.25×
0.2111.27×
0.2241.29×
0.2361.31×
0.2491.33×
0.2611.35×
0.2741.38×
0.2861.4×
0.2981.43×
0.3111.45×
0.3231.48×
0.3361.51×
0.3481.53×
0.3611.56×
0.3731.6×
0.3861.63×
0.3981.66×
0.411.7×
0.4231.73×
0.4351.77×
0.4481.81×
0.461.85×
0.4731.9×
0.4851.94×
0.4971.99×
0.512.04×
0.5222.09×
0.5352.15×
0.5472.21×
0.562.27×
0.5722.34×
0.5852.41×
0.5972.48×
0.6092.56×
0.6222.64×
0.6342.73×
0.6472.83×
0.6592.93×
0.6723.05×
0.6843.17×
0.6973.29×
0.7093.44×
0.7213.59×
0.7343.76×
0.7463.94×
0.7594.14×
0.7714.37×
0.7844.62×
0.7964.9×
0.8085.22×
0.8215.58×
0.8336×
0.8466.48×
0.8587.05×
0.8717.73×
0.8838.55×
0.8959.57×
0.90810.9×
0.9212.6×
0.93314.9×
0.94518.3×
0.95823.6×
0.9733.5×
0.98357.3×
0.995200×

Worked examples, recomputed

Every number the mechanisms quote for this relationship is recomputed from it, so none of them disagrees with it.

Where it appears

Each mechanism states it in its own names. The general symbol each name stands for is shown with it.