Skip to content

Alert fatigue is arithmetic Amplification Break-even reuse count Cost per unit of work Cost-aware eviction: value density Costs of a hash shuffle Dictionary code width Endurance budget Erasure coding: overhead and repair Error-budget burn rate Event-time skew Forces per commit Freshness and ETA Freshness lag Headroom a reactive autoscaler needs How big keyed state gets How long a backfill takes How many files a pipeline writes How many runs an experiment needs How many time series a metric makes Junk dimension size Key groups Lease drift margin Load per node under replication Memory grant Memory held by batching Moving data through a rate limit Off-CPU time One commit per catalog round trip Periodic snapshot size Population stability index Reciprocal rank fusion Recovering a streaming job Retention tiers by resolution Roaring container break-even Routing between two price models Serverless cost is memory × time Sliding windows multiply work Sparse index granule The expiry invariant The miss-ratio curve The partition of RAM The real price of spot capacity The value of not reading Transactional sink timeout Usable buffer-pool frames Utilization Varint length Vector batch size What an instrument costs What keeping an old interface costs What polling costs When statistics refresh When to rewrite away deletes Write-back coalescing

The Data EngineeringBeta

Main content

Relationships
The miss-ratio curve

Relationships

Definition

The miss-ratio curve

Hit rate is a measurement, not a tuning knob: the curve says what each size buys.

MRC (C) = P (reuse distance \geq C)

$C$: Cache size; cache size in entries

Where it appears

Each mechanism states it in its own names. The general symbol each name stands for is shown with it.

Caching
What happens when we deliberately keep a second copy of data that no protocol forces to be correct?
$MRC (C) = P (reuse distance \geq C)$
Read it in place →

The expiry invariant

Previous Page

The partition of RAM

Next Page

The Data Engineering

Learn

Mechanisms
Symptoms
Routes

Practice

Labs
Playbooks
Interview

Reference

Trade-offs
Relationships
Glossary

The project

About
Privacy

Text CC BY-NC 4.0 · Lab code MIT

Written by Aayush Sharma