goos: linux goarch: amd64 pkg: github.com/grafana/dskit/ring cpu: AMD Ryzen 9 PRO 6950H with Radeon Graphics │ output-ring-test-bench-ring-test-all-main.txt │ output-ring-test-bench-ring-test-all-edition2023-implicit.txt │ output-ring-test-bench-ring-test-all-csproto-locked-all.txt │ │ sec/op │ sec/op vs base │ sec/op vs base │ Batch10x100/go=default-16 89.93µ ± 6% 87.73µ ± 7% ~ (p=0.529 n=10) 88.64µ ± 9% ~ (p=0.971 n=10) Batch10x100/go=concurrency.ReusableGoroutinesPool-16 74.24µ ± 2% 76.79µ ± 1% +3.45% (p=0.002 n=10) 77.14µ ± 1% +3.91% (p=0.002 n=10) Batch100x100/go=default-16 180.0µ ± 3% 181.6µ ± 2% ~ (p=0.105 n=10) 196.7µ ± 6% +9.30% (p=0.000 n=10) Batch100x100/go=concurrency.ReusableGoroutinesPool-16 184.1µ ± 2% 191.0µ ± 2% +3.74% (p=0.000 n=10) 190.9µ ± 2% +3.69% (p=0.000 n=10) Batch100x1000/go=default-16 919.5µ ± 12% 968.5µ ± 1% +5.33% (p=0.023 n=10) 974.1µ ± 1% +5.94% (p=0.019 n=10) Batch100x1000/go=concurrency.ReusableGoroutinesPool-16 913.1µ ± 2% 965.7µ ± 0% +5.77% (p=0.001 n=10) 973.7µ ± 1% +6.64% (p=0.001 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_128,_update_tokens_=_false-16 12.37µ ± 2% 11.07µ ± 1% -10.56% (p=0.000 n=10) 11.10µ ± 1% -10.25% (p=0.000 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_128,_update_tokens_=_true-16 885.0µ ± 1% 889.0µ ± 0% ~ (p=0.218 n=10) 887.0µ ± 1% ~ (p=0.393 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_256,_update_tokens_=_false-16 15.56µ ± 1% 12.88µ ± 2% -17.24% (p=0.000 n=10) 12.81µ ± 1% -17.67% (p=0.000 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_256,_update_tokens_=_true-16 1.746m ± 4% 1.743m ± 3% ~ (p=0.912 n=10) 1.752m ± 2% ~ (p=1.000 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_512,_update_tokens_=_false-16 21.96µ ± 0% 16.34µ ± 1% -25.57% (p=0.000 n=10) 16.30µ ± 1% -25.75% (p=0.000 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_512,_update_tokens_=_true-16 3.385m ± 1% 3.472m ± 5% +2.57% (p=0.023 n=10) 3.420m ± 6% +1.04% (p=0.035 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_128,_update_tokens_=_false-16 23.25µ ± 2% 20.78µ ± 0% -10.60% (p=0.000 n=10) 20.77µ ± 2% -10.64% (p=0.000 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_128,_update_tokens_=_true-16 1.919m ± 3% 1.913m ± 2% ~ (p=0.353 n=10) 1.898m ± 2% ~ (p=0.280 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_256,_update_tokens_=_false-16 29.72µ ± 1% 24.47µ ± 1% -17.69% (p=0.000 n=10) 24.24µ ± 1% -18.45% (p=0.000 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_256,_update_tokens_=_true-16 3.599m ± 4% 3.581m ± 4% ~ (p=0.971 n=10) 3.612m ± 2% ~ (p=0.631 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_512,_update_tokens_=_false-16 43.01µ ± 2% 31.91µ ± 1% -25.82% (p=0.000 n=10) 32.05µ ± 1% -25.48% (p=0.000 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_512,_update_tokens_=_true-16 7.720m ± 3% 7.752m ± 2% ~ (p=0.353 n=10) 7.622m ± 2% ~ (p=0.123 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_128,_update_tokens_=_false-16 120.0µ ± 1% 106.6µ ± 1% -11.24% (p=0.000 n=10) 107.8µ ± 1% -10.22% (p=0.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_128,_update_tokens_=_true-16 13.74m ± 2% 14.02m ± 5% +2.07% (p=0.005 n=10) 13.68m ± 4% ~ (p=0.971 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_256,_update_tokens_=_false-16 158.9µ ± 1% 131.5µ ± 2% -17.21% (p=0.000 n=10) 131.1µ ± 1% -17.48% (p=0.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_256,_update_tokens_=_true-16 28.55m ± 2% 28.89m ± 3% ~ (p=0.218 n=10) 29.39m ± 4% +2.94% (p=0.011 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_512,_update_tokens_=_false-16 236.2µ ± 1% 178.5µ ± 1% -24.42% (p=0.000 n=10) 179.7µ ± 1% -23.92% (p=0.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_512,_update_tokens_=_true-16 65.48m ± 2% 65.57m ± 3% ~ (p=0.393 n=10) 66.63m ± 1% +1.76% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_0-16 52.35n ± 1% 52.27n ± 0% ~ (p=0.306 n=10) 52.61n ± 0% +0.48% (p=0.014 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_3-16 17.87µ ± 1% 17.22µ ± 0% -3.62% (p=0.000 n=10) 17.39µ ± 1% -2.70% (p=0.001 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_10-16 52.70µ ± 0% 51.69µ ± 1% -1.92% (p=0.000 n=10) 51.69µ ± 1% -1.92% (p=0.001 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_30-16 163.2µ ± 1% 159.1µ ± 1% -2.51% (p=0.000 n=10) 161.4µ ± 1% -1.11% (p=0.009 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_100-16 276.8µ ± 0% 270.8µ ± 1% -2.15% (p=0.000 n=10) 272.0µ ± 0% -1.74% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_1000-16 275.2µ ± 1% 271.2µ ± 1% -1.46% (p=0.000 n=10) 272.0µ ± 1% -1.14% (p=0.005 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_0-16 52.30n ± 1% 52.34n ± 0% ~ (p=0.446 n=10) 52.52n ± 0% +0.42% (p=0.014 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_3-16 39.95µ ± 0% 39.41µ ± 0% -1.35% (p=0.000 n=10) 39.39µ ± 1% -1.41% (p=0.001 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_10-16 83.87µ ± 0% 82.53µ ± 1% -1.60% (p=0.001 n=10) 82.53µ ± 1% -1.61% (p=0.001 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_30-16 205.5µ ± 1% 201.7µ ± 0% -1.86% (p=0.000 n=10) 201.8µ ± 1% -1.80% (p=0.001 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_100-16 304.1µ ± 1% 298.5µ ± 0% -1.85% (p=0.000 n=10) 299.0µ ± 1% -1.65% (p=0.001 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_1000-16 304.3µ ± 1% 298.1µ ± 0% -2.04% (p=0.000 n=10) 298.3µ ± 1% -2.00% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_0-16 52.46n ± 1% 52.25n ± 1% ~ (p=0.085 n=10) 52.66n ± 1% +0.37% (p=0.015 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_3-16 17.73µ ± 2% 17.19µ ± 1% -3.06% (p=0.000 n=10) 17.21µ ± 1% -2.97% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_10-16 52.72µ ± 1% 51.45µ ± 0% -2.40% (p=0.000 n=10) 51.60µ ± 0% -2.12% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_30-16 162.8µ ± 0% 158.4µ ± 1% -2.73% (p=0.000 n=10) 159.5µ ± 1% -2.08% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_100-16 616.4µ ± 1% 604.4µ ± 1% -1.94% (p=0.000 n=10) 605.2µ ± 1% -1.82% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_1000-16 616.0µ ± 1% 603.4µ ± 1% -2.06% (p=0.000 n=10) 608.7µ ± 0% -1.18% (p=0.002 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_0-16 52.39n ± 1% 52.30n ± 1% ~ (p=0.383 n=10) 52.60n ± 0% ~ (p=0.196 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_3-16 39.71µ ± 1% 39.34µ ± 0% -0.92% (p=0.000 n=10) 39.21µ ± 1% -1.24% (p=0.002 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_10-16 83.84µ ± 3% 82.44µ ± 1% -1.67% (p=0.000 n=10) 82.50µ ± 1% -1.60% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_30-16 204.4µ ± 1% 199.9µ ± 0% -2.17% (p=0.000 n=10) 200.4µ ± 0% -1.92% (p=0.002 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_100-16 665.9µ ± 0% 652.4µ ± 1% -2.03% (p=0.000 n=10) 654.2µ ± 1% -1.76% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_1000-16 665.0µ ± 2% 653.5µ ± 1% -1.72% (p=0.000 n=10) 654.3µ ± 1% -1.60% (p=0.002 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_0-16 52.39n ± 0% 52.73n ± 1% ~ (p=0.118 n=10) 52.61n ± 1% +0.43% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_3-16 16.72µ ± 0% 16.59µ ± 1% -0.77% (p=0.001 n=10) 16.38µ ± 1% -2.07% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_10-16 50.45µ ± 1% 49.91µ ± 1% ~ (p=0.052 n=10) 49.29µ ± 0% -2.31% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_30-16 158.6µ ± 3% 154.8µ ± 1% -2.39% (p=0.000 n=10) 152.9µ ± 1% -3.55% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_100-16 631.8µ ± 1% 627.2µ ± 1% ~ (p=0.123 n=10) 618.4µ ± 0% -2.13% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_1000-16 8.482m ± 1% 8.606m ± 1% +1.46% (p=0.001 n=10) 8.444m ± 2% ~ (p=0.739 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_0-16 52.53n ± 1% 53.12n ± 1% +1.11% (p=0.000 n=10) 52.63n ± 0% ~ (p=0.159 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_3-16 37.44µ ± 1% 37.65µ ± 1% +0.56% (p=0.015 n=10) 37.00µ ± 1% -1.17% (p=0.005 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_10-16 79.16µ ± 1% 79.55µ ± 0% +0.50% (p=0.029 n=10) 78.06µ ± 1% -1.39% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_30-16 196.6µ ± 1% 194.5µ ± 1% ~ (p=0.075 n=10) 191.5µ ± 2% -2.64% (p=0.001 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_100-16 690.9µ ± 2% 692.1µ ± 0% ~ (p=0.912 n=10) 680.1µ ± 1% -1.55% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_1000-16 9.050m ± 1% 9.016m ± 1% ~ (p=0.075 n=10) 8.817m ± 1% -2.58% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_0-16 56.28n ± 1% 60.83n ± 0% +8.08% (p=0.000 n=10) 60.36n ± 2% +7.26% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_3-16 145.7n ± 3% 101.8n ± 3% -30.19% (p=0.000 n=10) 101.2n ± 4% -30.53% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_10-16 366.2n ± 4% 217.6n ± 5% -40.57% (p=0.000 n=10) 214.3n ± 5% -41.49% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_30-16 1008.0n ± 5% 538.5n ± 1% -46.58% (p=0.000 n=10) 540.3n ± 3% -46.40% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_100-16 1641.0n ± 1% 833.0n ± 1% -49.24% (p=0.000 n=10) 821.6n ± 2% -49.93% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_1000-16 1643.0n ± 3% 826.8n ± 3% -49.67% (p=0.000 n=10) 819.5n ± 2% -50.12% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_0-16 55.79n ± 0% 60.28n ± 2% +8.07% (p=0.000 n=10) 60.05n ± 3% +7.65% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_3-16 144.70n ± 6% 99.86n ± 3% -30.99% (p=0.000 n=10) 100.25n ± 3% -30.72% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_10-16 432.4n ± 4% 242.0n ± 3% -44.03% (p=0.000 n=10) 245.1n ± 4% -43.30% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_30-16 993.7n ± 3% 542.3n ± 2% -45.43% (p=0.000 n=10) 533.1n ± 3% -46.35% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_100-16 1620.5n ± 3% 829.2n ± 2% -48.83% (p=0.000 n=10) 817.4n ± 3% -49.56% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_1000-16 1626.5n ± 2% 832.8n ± 2% -48.80% (p=0.000 n=10) 820.8n ± 2% -49.53% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_0-16 55.89n ± 1% 60.45n ± 2% +8.18% (p=0.000 n=10) 61.24n ± 3% +9.58% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_3-16 144.8n ± 6% 102.9n ± 4% -28.94% (p=0.000 n=10) 101.4n ± 7% -30.01% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_10-16 378.4n ± 3% 212.9n ± 2% -43.72% (p=0.000 n=10) 213.8n ± 4% -43.50% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_30-16 1004.0n ± 2% 542.2n ± 3% -45.99% (p=0.000 n=10) 540.4n ± 2% -46.18% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_100-16 3.302µ ± 3% 1.622µ ± 1% -50.88% (p=0.000 n=10) 1.608µ ± 3% -51.30% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_1000-16 3.307µ ± 2% 1.636µ ± 2% -50.54% (p=0.000 n=10) 1.607µ ± 2% -51.40% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_0-16 55.93n ± 2% 60.41n ± 2% +8.03% (p=0.000 n=10) 61.11n ± 2% +9.27% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_3-16 144.9n ± 2% 101.5n ± 7% -29.95% (p=0.000 n=10) 102.4n ± 3% -29.33% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_10-16 437.2n ± 2% 247.8n ± 2% -43.32% (p=0.000 n=10) 244.6n ± 3% -44.06% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_30-16 1009.5n ± 2% 549.2n ± 3% -45.60% (p=0.000 n=10) 539.6n ± 2% -46.54% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_100-16 3.320µ ± 2% 1.654µ ± 1% -50.19% (p=0.000 n=10) 1.606µ ± 1% -51.62% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_1000-16 3.333µ ± 2% 1.625µ ± 3% -51.25% (p=0.000 n=10) 1.621µ ± 2% -51.36% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_0-16 56.26n ± 1% 60.77n ± 1% +8.02% (p=0.000 n=10) 60.80n ± 3% +8.07% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_3-16 144.00n ± 2% 101.30n ± 2% -29.65% (p=0.000 n=10) 98.13n ± 4% -31.86% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_10-16 365.0n ± 1% 203.7n ± 4% -44.20% (p=0.000 n=10) 205.8n ± 5% -43.61% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_30-16 1006.5n ± 2% 522.8n ± 2% -48.06% (p=0.000 n=10) 521.4n ± 2% -48.20% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_100-16 3.480µ ± 2% 1.595µ ± 2% -54.17% (p=0.000 n=10) 1.559µ ± 1% -55.19% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_1000-16 50.80µ ± 2% 29.14µ ± 1% -42.64% (p=0.000 n=10) 28.86µ ± 0% -43.19% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_0-16 56.59n ± 1% 61.22n ± 1% +8.17% (p=0.000 n=10) 61.66n ± 1% +8.97% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_3-16 143.20n ± 5% 101.05n ± 3% -29.43% (p=0.000 n=10) 99.00n ± 2% -30.87% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_10-16 431.6n ± 4% 241.7n ± 3% -44.01% (p=0.000 n=10) 239.4n ± 2% -44.52% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_30-16 993.1n ± 2% 518.6n ± 2% -47.78% (p=0.000 n=10) 520.8n ± 2% -47.56% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_100-16 3.537µ ± 1% 1.622µ ± 1% -54.15% (p=0.000 n=10) 1.628µ ± 2% -53.97% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_1000-16 50.52µ ± 1% 29.33µ ± 1% -41.94% (p=0.000 n=10) 28.81µ ± 1% -42.97% (p=0.000 n=10) Ring_ShuffleShard_512Tokens-16 169.6µ ± 2% 169.0µ ± 0% ~ (p=0.165 n=10) 167.4µ ± 1% -1.32% (p=0.001 n=10) Ring_ShuffleShard_LargeShardSize-16 8.014m ± 3% 8.147m ± 1% +1.66% (p=0.019 n=10) 7.872m ± 1% -1.76% (p=0.000 n=10) Ring_ShuffleShard_ShardSize_0-16 52.57n ± 2% 53.17n ± 0% +1.16% (p=0.014 n=10) 52.03n ± 0% -1.01% (p=0.000 n=10) Ring_Get/with_zone_awareness-16 808.5n ± 2% 902.8n ± 1% +11.66% (p=0.000 n=10) 833.9n ± 3% +3.14% (p=0.000 n=10) Ring_Get/one_excluded_zone-16 579.8n ± 4% 633.6n ± 1% +9.27% (p=0.000 n=10) 600.6n ± 1% +3.58% (p=0.009 n=10) Ring_Get/without_zone_awareness-16 539.0n ± 1% 586.4n ± 1% +8.80% (p=0.000 n=10) 559.9n ± 1% +3.88% (p=0.001 n=10) Ring_Get/without_zone_awareness,_not_enough_instances-16 409.8n ± 2% 442.2n ± 1% +7.89% (p=0.000 n=10) 440.1n ± 1% +7.39% (p=0.000 n=10) geomean 14.33µ 11.96µ -16.56% 11.90µ -16.96% │ output-ring-test-bench-ring-test-all-main.txt │ output-ring-test-bench-ring-test-all-edition2023-implicit.txt │ output-ring-test-bench-ring-test-all-csproto-locked-all.txt │ │ B/op │ B/op vs base │ B/op vs base │ Batch10x100/go=default-16 17.85Ki ± 0% 18.98Ki ± 0% +6.37% (p=0.000 n=10) 18.98Ki ± 0% +6.36% (p=0.000 n=10) Batch10x100/go=concurrency.ReusableGoroutinesPool-16 17.86Ki ± 0% 19.00Ki ± 0% +6.36% (p=0.000 n=10) 19.00Ki ± 0% +6.36% (p=0.000 n=10) Batch100x100/go=default-16 54.01Ki ± 0% 63.12Ki ± 0% +16.87% (p=0.000 n=10) 63.13Ki ± 0% +16.89% (p=0.000 n=10) Batch100x100/go=concurrency.ReusableGoroutinesPool-16 54.03Ki ± 0% 63.14Ki ± 0% +16.86% (p=0.000 n=10) 63.14Ki ± 0% +16.87% (p=0.000 n=10) Batch100x1000/go=default-16 171.7Ki ± 0% 181.3Ki ± 0% +5.59% (p=0.000 n=10) 181.3Ki ± 0% +5.59% (p=0.000 n=10) Batch100x1000/go=concurrency.ReusableGoroutinesPool-16 171.7Ki ± 0% 181.3Ki ± 0% +5.61% (p=0.000 n=10) 181.3Ki ± 0% +5.64% (p=0.000 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_128,_update_tokens_=_false-16 328.0 ± 0% 327.0 ± 0% -0.30% (p=0.000 n=10) 328.0 ± 0% 0.00% (p=0.033 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_128,_update_tokens_=_true-16 822.9Ki ± 0% 822.8Ki ± 0% ~ (p=0.971 n=10) 822.8Ki ± 0% ~ (p=0.353 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_256,_update_tokens_=_false-16 341.0 ± 0% 338.0 ± 0% -0.88% (p=0.000 n=10) 337.0 ± 0% -1.17% (p=0.000 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_256,_update_tokens_=_true-16 1.570Mi ± 0% 1.570Mi ± 0% ~ (p=0.436 n=10) 1.570Mi ± 0% ~ (p=0.218 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_512,_update_tokens_=_false-16 380.5 ± 0% 365.0 ± 0% -4.07% (p=0.000 n=10) 365.0 ± 0% -4.07% (p=0.000 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_512,_update_tokens_=_true-16 3.092Mi ± 0% 3.092Mi ± 0% ~ (p=0.853 n=10) 3.093Mi ± 0% +0.01% (p=0.003 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_128,_update_tokens_=_false-16 353.0 ± 0% 349.0 ± 0% -1.13% (p=0.000 n=10) 349.0 ± 0% -1.13% (p=0.000 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_128,_update_tokens_=_true-16 1.609Mi ± 0% 1.609Mi ± 0% ~ (p=0.247 n=10) 1.609Mi ± 0% ~ (p=0.796 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_256,_update_tokens_=_false-16 402.0 ± 0% 388.0 ± 0% -3.48% (p=0.000 n=10) 387.0 ± 1% -3.73% (p=0.000 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_256,_update_tokens_=_true-16 3.131Mi ± 0% 3.131Mi ± 0% ~ (p=0.448 n=10) 3.131Mi ± 0% ~ (p=0.190 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_512,_update_tokens_=_false-16 556.0 ± 1% 495.0 ± 1% -10.97% (p=0.000 n=10) 497.0 ± 1% -10.61% (p=0.000 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_512,_update_tokens_=_true-16 6.176Mi ± 0% 6.176Mi ± 0% ~ (p=0.481 n=10) 6.176Mi ± 0% ~ (p=0.436 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_128,_update_tokens_=_false-16 1.562Ki ± 0% 1.448Ki ± 1% -7.25% (p=0.000 n=10) 1.428Ki ± 1% -8.54% (p=0.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_128,_update_tokens_=_true-16 11.81Mi ± 0% 11.81Mi ± 0% ~ (p=0.739 n=10) 11.81Mi ± 0% ~ (p=1.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_256,_update_tokens_=_false-16 3.958Ki ± 13% 2.938Ki ± 1% -25.78% (p=0.000 n=10) 2.937Ki ± 0% -25.80% (p=0.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_256,_update_tokens_=_true-16 23.12Mi ± 0% 23.12Mi ± 0% -0.01% (p=0.043 n=10) 23.13Mi ± 0% ~ (p=0.075 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_512,_update_tokens_=_false-16 10.278Ki ± 1% 8.089Ki ± 1% -21.30% (p=0.000 n=10) 8.124Ki ± 1% -20.96% (p=0.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_512,_update_tokens_=_true-16 45.74Mi ± 0% 45.75Mi ± 0% +0.01% (p=0.015 n=10) 45.75Mi ± 0% ~ (p=0.052 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_3-16 10.430Ki ± 0% 9.547Ki ± 0% -8.46% (p=0.000 n=10) 9.547Ki ± 0% -8.46% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_10-16 16.80Ki ± 0% 14.98Ki ± 0% -10.86% (p=0.000 n=10) 14.98Ki ± 0% -10.86% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_30-16 38.02Ki ± 0% 30.49Ki ± 0% -19.80% (p=0.000 n=10) 30.49Ki ± 0% -19.80% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_100-16 48.79Ki ± 0% 40.11Ki ± 0% -17.80% (p=0.000 n=10) 40.11Ki ± 0% -17.80% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_1000-16 48.80Ki ± 0% 40.11Ki ± 0% -17.81% (p=0.000 n=10) 40.11Ki ± 0% -17.81% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_3-16 22.59Ki ± 0% 21.71Ki ± 0% -3.91% (p=0.000 n=10) 21.71Ki ± 0% -3.91% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_10-16 34.36Ki ± 0% 32.42Ki ± 0% -5.65% (p=0.000 n=10) 32.42Ki ± 0% -5.65% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_30-16 65.10Ki ± 0% 57.58Ki ± 0% -11.56% (p=0.000 n=10) 57.58Ki ± 0% -11.56% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_100-16 76.16Ki ± 0% 67.47Ki ± 0% -11.40% (p=0.000 n=10) 67.47Ki ± 0% -11.40% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_1000-16 76.16Ki ± 0% 67.47Ki ± 0% -11.41% (p=0.000 n=10) 67.47Ki ± 0% -11.41% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_3-16 10.430Ki ± 0% 9.547Ki ± 0% -8.46% (p=0.000 n=10) 9.547Ki ± 0% -8.46% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_10-16 16.81Ki ± 0% 14.98Ki ± 0% -10.86% (p=0.000 n=10) 14.98Ki ± 0% -10.86% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_30-16 38.02Ki ± 0% 30.49Ki ± 0% -19.80% (p=0.000 n=10) 30.49Ki ± 0% -19.80% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_100-16 97.50Ki ± 0% 81.59Ki ± 0% -16.32% (p=0.000 n=10) 81.59Ki ± 0% -16.32% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_1000-16 97.50Ki ± 0% 81.59Ki ± 0% -16.32% (p=0.000 n=10) 81.59Ki ± 0% -16.32% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_3-16 22.59Ki ± 0% 21.71Ki ± 0% -3.91% (p=0.000 n=10) 21.71Ki ± 0% -3.91% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_10-16 34.36Ki ± 0% 32.42Ki ± 0% -5.65% (p=0.000 n=10) 32.42Ki ± 0% -5.65% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_30-16 65.11Ki ± 0% 57.58Ki ± 0% -11.56% (p=0.000 n=10) 57.58Ki ± 0% -11.56% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_100-16 149.4Ki ± 0% 133.5Ki ± 0% -10.66% (p=0.000 n=10) 133.5Ki ± 0% -10.66% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_1000-16 149.4Ki ± 0% 133.5Ki ± 0% -10.65% (p=0.000 n=10) 133.5Ki ± 0% -10.65% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_3-16 10.430Ki ± 0% 9.547Ki ± 0% -8.46% (p=0.000 n=10) 9.547Ki ± 0% -8.46% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_10-16 16.81Ki ± 0% 14.98Ki ± 0% -10.86% (p=0.000 n=10) 14.98Ki ± 0% -10.86% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_30-16 38.02Ki ± 0% 30.49Ki ± 0% -19.80% (p=0.000 n=10) 30.49Ki ± 0% -19.79% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_100-16 102.79Ki ± 0% 86.86Ki ± 0% -15.50% (p=0.000 n=10) 86.86Ki ± 0% -15.50% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_1000-16 963.5Ki ± 0% 739.5Ki ± 0% -23.25% (p=0.000 n=10) 739.5Ki ± 0% -23.25% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_3-16 22.59Ki ± 0% 21.71Ki ± 0% -3.91% (p=0.000 n=10) 21.71Ki ± 0% -3.91% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_10-16 34.36Ki ± 0% 32.42Ki ± 0% -5.65% (p=0.000 n=10) 32.42Ki ± 0% -5.65% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_30-16 65.10Ki ± 0% 57.58Ki ± 0% -11.56% (p=0.000 n=10) 57.58Ki ± 0% -11.56% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_100-16 166.2Ki ± 0% 150.1Ki ± 0% -9.72% (p=0.000 n=10) 150.1Ki ± 0% -9.71% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_1000-16 1.421Mi ± 0% 1.203Mi ± 0% -15.39% (p=0.000 n=10) 1.203Mi ± 0% -15.39% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_1000-16 42.00 ± 2% 19.00 ± 0% -54.76% (p=0.000 n=10) 18.00 ± 0% -57.14% (p=0.000 n=10) Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_1000-16 64.00 ± 2% 32.00 ± 3% -50.00% (p=0.000 n=10) 31.00 ± 3% -51.56% (p=0.000 n=10) Ring_ShuffleShard_512Tokens-16 57.85Ki ± 0% 56.04Ki ± 0% -3.13% (p=0.000 n=10) 56.04Ki ± 0% -3.12% (p=0.000 n=10) Ring_ShuffleShard_LargeShardSize-16 1.214Mi ± 0% 1.157Mi ± 0% -4.66% (p=0.000 n=10) 1.157Mi ± 0% -4.66% (p=0.000 n=10) Ring_ShuffleShard_ShardSize_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/with_zone_awareness-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/one_excluded_zone-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/without_zone_awareness-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/without_zone_awareness,_not_enough_instances-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ geomean ² -5.39% ² -5.47% ² ¹ all samples are equal ² summaries must be >0 to compute geomean │ output-ring-test-bench-ring-test-all-main.txt │ output-ring-test-bench-ring-test-all-edition2023-implicit.txt │ output-ring-test-bench-ring-test-all-csproto-locked-all.txt │ │ allocs/op │ allocs/op vs base │ allocs/op vs base │ Batch10x100/go=default-16 62.00 ± 0% 62.00 ± 0% ~ (p=1.000 n=10) ¹ 62.00 ± 0% ~ (p=1.000 n=10) ¹ Batch10x100/go=concurrency.ReusableGoroutinesPool-16 63.00 ± 0% 63.00 ± 0% ~ (p=1.000 n=10) ¹ 63.00 ± 0% ~ (p=1.000 n=10) ¹ Batch100x100/go=default-16 526.0 ± 0% 526.0 ± 0% ~ (p=1.000 n=10) ¹ 526.0 ± 0% ~ (p=1.000 n=10) ¹ Batch100x100/go=concurrency.ReusableGoroutinesPool-16 527.0 ± 0% 527.0 ± 0% ~ (p=1.000 n=10) ¹ 527.0 ± 0% ~ (p=1.000 n=10) ¹ Batch100x1000/go=default-16 519.0 ± 0% 519.0 ± 0% ~ (p=1.000 n=10) ¹ 519.0 ± 0% ~ (p=1.000 n=10) ¹ Batch100x1000/go=concurrency.ReusableGoroutinesPool-16 520.0 ± 0% 520.0 ± 0% ~ (p=1.000 n=10) ¹ 520.0 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_50,_num_tokens_=_128,_update_tokens_=_false-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ 20.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_50,_num_tokens_=_128,_update_tokens_=_true-16 615.5 ± 0% 615.0 ± 0% ~ (p=0.450 n=10) 615.0 ± 0% ~ (p=0.141 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_256,_update_tokens_=_false-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ 20.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_50,_num_tokens_=_256,_update_tokens_=_true-16 880.5 ± 0% 880.0 ± 0% ~ (p=0.419 n=10) 880.0 ± 0% ~ (p=0.231 n=10) UpdateRingState/num_instances_=_50,_num_tokens_=_512,_update_tokens_=_false-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ 20.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_50,_num_tokens_=_512,_update_tokens_=_true-16 1.408k ± 0% 1.408k ± 0% ~ (p=0.745 n=10) 1.409k ± 0% +0.11% (p=0.002 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_128,_update_tokens_=_false-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ 20.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_100,_num_tokens_=_128,_update_tokens_=_true-16 1.242k ± 0% 1.243k ± 0% ~ (p=0.109 n=10) 1.243k ± 0% ~ (p=0.611 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_256,_update_tokens_=_false-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ 20.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_100,_num_tokens_=_256,_update_tokens_=_true-16 1.770k ± 0% 1.771k ± 0% ~ (p=0.379 n=10) 1.772k ± 0% ~ (p=0.178 n=10) UpdateRingState/num_instances_=_100,_num_tokens_=_512,_update_tokens_=_false-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ 20.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_100,_num_tokens_=_512,_update_tokens_=_true-16 2.853k ± 0% 2.854k ± 0% ~ (p=0.426 n=10) 2.852k ± 0% ~ (p=0.339 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_128,_update_tokens_=_false-16 20.00 ± 0% 20.00 ± 0% ~ (p=1.000 n=10) ¹ 20.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_500,_num_tokens_=_128,_update_tokens_=_true-16 5.943k ± 0% 5.943k ± 0% ~ (p=0.777 n=10) 5.941k ± 0% ~ (p=1.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_256,_update_tokens_=_false-16 21.00 ± 0% 20.00 ± 0% -4.76% (p=0.000 n=10) 20.00 ± 0% -4.76% (p=0.000 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_256,_update_tokens_=_true-16 8.341k ± 0% 8.334k ± 0% -0.08% (p=0.045 n=10) 8.348k ± 0% +0.08% (p=0.040 n=10) UpdateRingState/num_instances_=_500,_num_tokens_=_512,_update_tokens_=_false-16 22.00 ± 0% 22.00 ± 0% ~ (p=1.000 n=10) ¹ 22.00 ± 0% ~ (p=1.000 n=10) ¹ UpdateRingState/num_instances_=_500,_num_tokens_=_512,_update_tokens_=_true-16 13.12k ± 0% 13.14k ± 0% +0.13% (p=0.018 n=10) 13.14k ± 0% +0.12% (p=0.037 n=10) Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_3-16 27.00 ± 0% 27.00 ± 0% ~ (p=1.000 n=10) ¹ 27.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_10-16 36.00 ± 0% 36.00 ± 0% ~ (p=1.000 n=10) ¹ 36.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_30-16 57.00 ± 0% 57.00 ± 0% ~ (p=1.000 n=10) ¹ 57.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_100-16 77.00 ± 0% 77.00 ± 0% ~ (p=1.000 n=10) ¹ 77.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_1,_shard_size_=_1000-16 77.00 ± 0% 77.00 ± 0% ~ (p=1.000 n=10) ¹ 77.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_3-16 42.00 ± 0% 42.00 ± 0% ~ (p=1.000 n=10) ¹ 42.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_10-16 57.00 ± 0% 57.00 ± 0% ~ (p=1.000 n=10) ¹ 57.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_30-16 81.00 ± 0% 81.00 ± 0% ~ (p=1.000 n=10) ¹ 81.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_100-16 98.00 ± 0% 98.00 ± 0% ~ (p=1.000 n=10) ¹ 98.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_50,_num_zones_=_3,_shard_size_=_1000-16 98.00 ± 0% 98.00 ± 0% ~ (p=1.000 n=10) ¹ 98.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_3-16 27.00 ± 0% 27.00 ± 0% ~ (p=1.000 n=10) ¹ 27.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_10-16 36.00 ± 0% 36.00 ± 0% ~ (p=1.000 n=10) ¹ 36.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_30-16 57.00 ± 0% 57.00 ± 0% ~ (p=1.000 n=10) ¹ 57.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_100-16 129.0 ± 0% 128.0 ± 0% -0.78% (p=0.000 n=10) 128.0 ± 0% -0.78% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_1,_shard_size_=_1000-16 129.0 ± 0% 128.0 ± 0% -0.78% (p=0.000 n=10) 128.0 ± 0% -0.78% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_3-16 42.00 ± 0% 42.00 ± 0% ~ (p=1.000 n=10) ¹ 42.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_10-16 57.00 ± 0% 57.00 ± 0% ~ (p=1.000 n=10) ¹ 57.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_30-16 81.00 ± 0% 81.00 ± 0% ~ (p=1.000 n=10) ¹ 81.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_100-16 150.0 ± 0% 149.0 ± 0% -0.67% (p=0.000 n=10) 149.0 ± 0% -0.67% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_100,_num_zones_=_3,_shard_size_=_1000-16 150.0 ± 0% 149.0 ± 0% -0.67% (p=0.000 n=10) 149.0 ± 0% -0.67% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_3-16 27.00 ± 0% 27.00 ± 0% ~ (p=1.000 n=10) ¹ 27.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_10-16 36.00 ± 0% 36.00 ± 0% ~ (p=1.000 n=10) ¹ 36.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_30-16 57.00 ± 0% 57.00 ± 0% ~ (p=1.000 n=10) ¹ 57.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_100-16 131.0 ± 0% 130.0 ± 0% -0.76% (p=0.000 n=10) 130.0 ± 0% -0.76% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_1,_shard_size_=_1000-16 1.031k ± 0% 1.031k ± 0% ~ (p=1.000 n=10) ¹ 1.031k ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_3-16 42.00 ± 0% 42.00 ± 0% ~ (p=1.000 n=10) ¹ 42.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_10-16 57.00 ± 0% 57.00 ± 0% ~ (p=1.000 n=10) ¹ 57.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_30-16 81.00 ± 0% 81.00 ± 0% ~ (p=1.000 n=10) ¹ 81.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_100-16 159.0 ± 1% 157.0 ± 0% -1.26% (p=0.000 n=10) 157.0 ± 0% -1.26% (p=0.000 n=10) Ring_ShuffleShard/num_instances_=_1000,_num_zones_=_3,_shard_size_=_1000-16 1.058k ± 0% 1.058k ± 0% ~ (p=1.000 n=10) ¹ 1.058k ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_1,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_50,_num_zones_=_3,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_1,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_100,_num_zones_=_3,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_1,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_3-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_10-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_30-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_100-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShardCached/num_instances_=_1000,_num_zones_=_3,_shard_size_=_1000-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard_512Tokens-16 54.00 ± 0% 54.00 ± 0% ~ (p=1.000 n=10) ¹ 54.00 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard_LargeShardSize-16 331.0 ± 0% 331.0 ± 0% ~ (p=1.000 n=10) ¹ 331.0 ± 0% ~ (p=1.000 n=10) ¹ Ring_ShuffleShard_ShardSize_0-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/with_zone_awareness-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/one_excluded_zone-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/without_zone_awareness-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ Ring_Get/without_zone_awareness,_not_enough_instances-16 0.000 ± 0% 0.000 ± 0% ~ (p=1.000 n=10) ¹ 0.000 ± 0% ~ (p=1.000 n=10) ¹ geomean ² -0.09% ² -0.09% ² ¹ all samples are equal ² summaries must be >0 to compute geomean