Skip to content
About
Main content

Workload isolation: pools, warehouses, clusters

How much capacity does sharing save, and why can a warehouse per team still be right?

The choice is between space-sharing (separate clusters or warehouses per tenant: partition the machines) and time-sharing (pools on one cluster: share them over time). The arithmetic that favors sharing is statistical multiplexing.

Size N tenants separately and you buy the sum of the peaks: Σ peak(i). Share and you buy the peak of the sum: peak(Σ i). For independent, bursty demands, means add linearly while standard deviations add in quadrature (the square root of the sum of squares). So the headroom per tenant shrinks by roughly √N: sharing among 16 tenants cuts the buffer requirement about fourfold.

tenants with independent, bursty demand
mean and standard deviation of one tenant's demand
standard deviations of headroom planned for
separate (sum of peaks)shared (peak of the sum)
Data table
Capacity to plan by tenants (mean 10, σ = 5, mean + 2σ)
Tenants nseriesSlots to provision
1separate (sum of peaks)20
1.06separate (sum of peaks)21.2
1.12separate (sum of peaks)22.4
1.19separate (sum of peaks)23.8
1.26separate (sum of peaks)25.2
1.33separate (sum of peaks)26.7
1.41separate (sum of peaks)28.3
1.5separate (sum of peaks)29.9
1.58separate (sum of peaks)31.7
1.68separate (sum of peaks)33.6
1.78separate (sum of peaks)35.6
1.88separate (sum of peaks)37.7
2separate (sum of peaks)39.9
2.11separate (sum of peaks)42.3
2.24separate (sum of peaks)44.8
2.37separate (sum of peaks)47.4
2.51separate (sum of peaks)50.2
2.66separate (sum of peaks)53.2
2.82separate (sum of peaks)56.4
2.99separate (sum of peaks)59.7
3.16separate (sum of peaks)63.2
3.35separate (sum of peaks)67
3.55separate (sum of peaks)71
3.76separate (sum of peaks)75.2
3.98separate (sum of peaks)79.6
4.22separate (sum of peaks)84.3
4.47separate (sum of peaks)89.3
4.73separate (sum of peaks)94.6
5.01separate (sum of peaks)100
5.31separate (sum of peaks)106
5.62separate (sum of peaks)112
5.96separate (sum of peaks)119
6.31separate (sum of peaks)126
6.68separate (sum of peaks)134
7.08separate (sum of peaks)142
7.5separate (sum of peaks)150
7.94separate (sum of peaks)159
8.41separate (sum of peaks)168
8.91separate (sum of peaks)178
9.44separate (sum of peaks)189
10separate (sum of peaks)200
10.6separate (sum of peaks)212
11.2separate (sum of peaks)224
11.9separate (sum of peaks)238
12.6separate (sum of peaks)252
13.3separate (sum of peaks)267
14.1separate (sum of peaks)283
15separate (sum of peaks)299
15.8separate (sum of peaks)317
16.8separate (sum of peaks)336
17.8separate (sum of peaks)356
18.8separate (sum of peaks)377
20separate (sum of peaks)399
21.1separate (sum of peaks)423
22.4separate (sum of peaks)448
23.7separate (sum of peaks)474
25.1separate (sum of peaks)502
26.6separate (sum of peaks)532
28.2separate (sum of peaks)564
29.9separate (sum of peaks)597
31.6separate (sum of peaks)632
33.5separate (sum of peaks)670
35.5separate (sum of peaks)710
37.6separate (sum of peaks)752
39.8separate (sum of peaks)796
42.2separate (sum of peaks)843
44.7separate (sum of peaks)893
47.3separate (sum of peaks)946
50.1separate (sum of peaks)1K
53.1separate (sum of peaks)1.06K
56.2separate (sum of peaks)1.12K
59.6separate (sum of peaks)1.19K
63.1separate (sum of peaks)1.26K
66.8separate (sum of peaks)1.34K
70.8separate (sum of peaks)1.42K
75separate (sum of peaks)1.5K
79.4separate (sum of peaks)1.59K
84.1separate (sum of peaks)1.68K
89.1separate (sum of peaks)1.78K
94.4separate (sum of peaks)1.89K
100separate (sum of peaks)2K
1shared (peak of the sum)20
1.06shared (peak of the sum)20.9
1.12shared (peak of the sum)21.8
1.19shared (peak of the sum)22.8
1.26shared (peak of the sum)23.8
1.33shared (peak of the sum)24.9
1.41shared (peak of the sum)26
1.5shared (peak of the sum)27.2
1.58shared (peak of the sum)28.4
1.68shared (peak of the sum)29.7
1.78shared (peak of the sum)31.1
1.88shared (peak of the sum)32.6
2shared (peak of the sum)34.1
2.11shared (peak of the sum)35.7
2.24shared (peak of the sum)37.3
2.37shared (peak of the sum)39.1
2.51shared (peak of the sum)41
2.66shared (peak of the sum)42.9
2.82shared (peak of the sum)45
2.99shared (peak of the sum)47.1
3.16shared (peak of the sum)49.4
3.35shared (peak of the sum)51.8
3.55shared (peak of the sum)54.3
3.76shared (peak of the sum)57
3.98shared (peak of the sum)59.8
4.22shared (peak of the sum)62.7
4.47shared (peak of the sum)65.8
4.73shared (peak of the sum)69.1
5.01shared (peak of the sum)72.5
5.31shared (peak of the sum)76.1
5.62shared (peak of the sum)79.9
5.96shared (peak of the sum)84
6.31shared (peak of the sum)88.2
6.68shared (peak of the sum)92.7
7.08shared (peak of the sum)97.4
7.5shared (peak of the sum)102
7.94shared (peak of the sum)108
8.41shared (peak of the sum)113
8.91shared (peak of the sum)119
9.44shared (peak of the sum)125
10shared (peak of the sum)132
10.6shared (peak of the sum)138
11.2shared (peak of the sum)146
11.9shared (peak of the sum)153
12.6shared (peak of the sum)161
13.3shared (peak of the sum)170
14.1shared (peak of the sum)179
15shared (peak of the sum)188
15.8shared (peak of the sum)198
16.8shared (peak of the sum)209
17.8shared (peak of the sum)220
18.8shared (peak of the sum)232
20shared (peak of the sum)244
21.1shared (peak of the sum)257
22.4shared (peak of the sum)271
23.7shared (peak of the sum)286
25.1shared (peak of the sum)301
26.6shared (peak of the sum)318
28.2shared (peak of the sum)335
29.9shared (peak of the sum)353
31.6shared (peak of the sum)372
33.5shared (peak of the sum)393
35.5shared (peak of the sum)414
37.6shared (peak of the sum)437
39.8shared (peak of the sum)461
42.2shared (peak of the sum)487
44.7shared (peak of the sum)514
47.3shared (peak of the sum)542
50.1shared (peak of the sum)572
53.1shared (peak of the sum)604
56.2shared (peak of the sum)637
59.6shared (peak of the sum)673
63.1shared (peak of the sum)710
66.8shared (peak of the sum)750
70.8shared (peak of the sum)792
75shared (peak of the sum)836
79.4shared (peak of the sum)883
84.1shared (peak of the sum)933
89.1shared (peak of the sum)986
94.4shared (peak of the sum)1.04K
100shared (peak of the sum)1.1K

The dividend depends on independence, and tenants are not independent

That dividend is entirely a dividend on independence, and tenant demand is not independent. Month-end close, 09:00 dashboards, the same upstream pipeline landing: correlation goes to 1 exactly at peak, which is when you needed the gain. This is "independence assumed and false," now quantified: the multiplexing discount is real on average and evaporates in the case you sized for.

If all 16 tenants peak together at 20, the shared pool needs 320 slots, not 200.

Why "a warehouse per team" can be a good design

This is why separate warehouses per team is a defensible design, not (as it is often framed) an admission of failure. You are paying the sum of peaks for the guarantee that no one else's spike is yours. The honest framing is a price quote, not a best practice: isolation costs the you forgo, minus the portion of that gain that was fictitious because demands are correlated.