More efficient Merge implementation. #486

brian-brazil · 2018-12-28T18:08:59Z

Avoid a tree of merge objects, which can result in
what I suspect is n^2 calls to Seek when using Without.

With 100k metrics, and a regex of ^$ in BenchmarkHeadPostingForMatchers:

Before:
BenchmarkHeadPostingForMatchers-8 1 51633185216 ns/op 29745528 B/op 200357 allocs/op

After:
BenchmarkHeadPostingForMatchers-8 10 108924996 ns/op 25715025 B/op 101748 allocs/op

Signed-off-by: Brian Brazil brian.brazil@robustperception.io

Avoid a tree of merge objects, which can result in what I suspect is n^2 calls to Seek when using Without. With 100k metrics, and a regex of ^$ in BenchmarkHeadPostingForMatchers: Before: BenchmarkHeadPostingForMatchers-8 1 51633185216 ns/op 29745528 B/op 200357 allocs/op After: BenchmarkHeadPostingForMatchers-8 10 108924996 ns/op 25715025 B/op 101748 allocs/op Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>

krasi-georgiev · 2019-01-03T02:37:20Z

The promql bench results.

 benchcmp -mag -best oldMerge.txt newMerge.txt
benchmark                                                                                                              old ns/op      new ns/op      delta
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1-48                                                  169283         347805         +105.46%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1-48                                                     168951         343640         +103.40%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1-48                                                      170243         345981         +103.23%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=10-48                                                     174896         353455         +102.09%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=10-48                                                 177163         351201         +98.24%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=10-48                                                    177947         341303         +91.80%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=100-48                                                   220313         387748         +76.00%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=100-48                                                    243809         422483         +73.28%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=100-48                                                247425         417941         +68.92%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1-48                                                     333202         509578         +52.93%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1-48                                                  333182         502929         +50.95%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1-48                                                      343544         508539         +48.03%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=10-48                                                    375862         543703         +44.65%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=10-48                                                 378429         544195         +43.80%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=10-48                                                     409200         576563         +40.90%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1000-48                                                  664512         843656         +26.96%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1000-48                                                   903663         1091416        +20.78%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=100-48                                                   915572         1093335        +19.42%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=100-48                                                918419         1090722        +18.76%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1000-48                                               897735         1064529        +18.58%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=100-48                                                    1142549        1314560        +15.06%


benchmark                                                                                                              old bytes     new bytes     delta
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1-48                                                     102270        130327        +27.43%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1-48                                                  102350        130364        +27.37%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1-48                                                      102351        130359        +27.36%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=10-48                                                    103424        131439        +27.09%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=10-48                                                     103504        131516        +27.06%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=10-48                                                 103504        131516        +27.06%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=100-48                                                   115001        143012        +24.36%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=100-48                                                115084        143109        +24.35%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=100-48                                                    115084        143106        +24.35%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1-48                                                     122726        150749        +22.83%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1-48                                                  122724        150733        +22.82%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1-48                                                      123787        151803        +22.63%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=10-48                                                    123886        151901        +22.61%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=10-48                                                 123884        151898        +22.61%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=10-48                                                     127888        155906        +21.91%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=100-48                                                135186        163221        +20.74%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=100-48                                                   135186        163220        +20.74%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=100-48                                                    168530        196633        +16.68%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1000-48                                                  232757        260794        +12.05%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1000-48                                               232870        260906        +12.04%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1000-48                                                   232886        260923        +12.04%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1000-48                                                  274293        302933        +10.44%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1000-48                                               274197        302614        +10.36%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=1-48                                             314860        342882        +8.90%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=1-48                                          314868        342889        +8.90%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=1-48                                              324480        352547        +8.65%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=10-48                                         336269        364318        +8.34%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=10-48                                            336313        364268        +8.31%

krasi-georgiev · 2019-01-03T08:56:28Z

@brian-brazil btw how did you run BenchmarkHeadPostingForMatchers exactly as I can't replicate your results.

brian-brazil · 2019-01-03T10:39:56Z

I changed the matcher to ^$ and had 100k iterators of the for loop.

krasi-georgiev · 2019-01-03T10:50:27Z

yep , I replicated it.

Any idea for the promql bench results?

brian-brazil · 2019-01-03T11:05:49Z

Those are all for small queries, how do the bigger ones look?

krasi-georgiev · 2019-01-03T14:15:28Z

the full result

benchcmp -mag -best oldMerge.txt newMerge.txt
benchmark                                                                                                              old ns/op      new ns/op      delta
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1-48                                                  169283         347805         +105.46%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1-48                                                     168951         343640         +103.40%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1-48                                                      170243         345981         +103.23%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=10-48                                                     174896         353455         +102.09%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=10-48                                                 177163         351201         +98.24%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=10-48                                                    177947         341303         +91.80%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=100-48                                                   220313         387748         +76.00%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=100-48                                                    243809         422483         +73.28%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=100-48                                                247425         417941         +68.92%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1-48                                                     333202         509578         +52.93%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1-48                                                  333182         502929         +50.95%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1-48                                                      343544         508539         +48.03%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=10-48                                                    375862         543703         +44.65%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=10-48                                                 378429         544195         +43.80%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=10-48                                                     409200         576563         +40.90%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1000-48                                                  664512         843656         +26.96%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1000-48                                                   903663         1091416        +20.78%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=100-48                                                   915572         1093335        +19.42%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=100-48                                                918419         1090722        +18.76%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1000-48                                               897735         1064529        +18.58%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=100-48                                                    1142549        1314560        +15.06%
BenchmarkRangeQuery/expr=a_hundred,steps=1000-48                                                                       12088639       12969297       +7.29%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=10-48                                                 1916247        2051659        +7.07%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=1-48                                             1917459        2052721        +7.05%
BenchmarkRangeQuery/expr=-a_ten,steps=1000-48                                                                          1238690        1323885        +6.88%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=1-48                                                                 1047925        1118250        +6.71%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=10-48                                                                1233312        1304771        +5.79%
BenchmarkRangeQuery/expr=-a_hundred,steps=1000-48                                                                      12307187       13018450       +5.78%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=1-48                                              1999380        2114486        +5.76%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=1-48                                                                    1042869        1102784        +5.75%
BenchmarkRangeQuery/expr=-a_one,steps=10-48                                                                            37495          39628          +5.69%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=10-48                                                                   1139865        1204633        +5.68%
BenchmarkRangeQuery/expr=-a_one,steps=1000-48                                                                          147696         155924         +5.57%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=1-48                                          1938513        2042146        +5.35%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=10-48                                            2389495        2510243        +5.05%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=10-48                                                                   9277092        9734588        +4.93%
BenchmarkRangeQuery/expr=a_ten,steps=1000-48                                                                           1208455        1267177        +4.86%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=1-48                                                  9627638        10092413       +4.83%
BenchmarkRangeQuery/expr=a_one,steps=1000-48                                                                           145756         152682         +4.75%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=10-48                                         2394168        2507761        +4.74%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=100-48                                                                  2056113        2153364        +4.73%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1000-48                                               6008065        6291834        +4.72%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=10-48                                             2638046        2757476        +4.53%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1000-48                                                  6021818        6283523        +4.35%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=1000-48                                                         3500126        3651906        +4.34%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=10-48                                                                10215450       10628521       +4.04%
BenchmarkRangeQuery/expr=-a_one,steps=1-48                                                                             37482          38885          +3.74%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=1000-48                                                                  21332070       22068452       +3.45%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=1000-48                                                               2971406        3073971        +3.45%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=1-48                                                                    8295458        8579670        +3.43%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=100-48                                                               2955819        3055362        +3.37%
BenchmarkRangeQuery/expr=sum(a_ten),steps=1000-48                                                                      2681152        2756332        +2.80%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1000-48                                                   8366789        8601296        +2.80%
BenchmarkRangeQuery/expr=-a_ten,steps=100-48                                                                           253235         259958         +2.65%
BenchmarkRangeQuery/expr=abs(a_ten),steps=1000-48                                                                      5686280        5836009        +2.63%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=100-48              438975         427973         -2.51%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                                   6395359        6557376        +2.53%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=1-48                96329          98711          +2.47%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=1-48                                                                 8485932        8688860        +2.39%
BenchmarkRangeQuery/expr=abs(a_one),steps=1-48                                                                         44065          45118          +2.39%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=1000-48                                                              20082873       20528590       +2.22%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=100-48                                           8155907        8329255        +2.13%
BenchmarkRangeQuery/expr=abs(a_one),steps=10-48                                                                        47557          48565          +2.12%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=100-48                                        8164826        8336185        +2.10%
BenchmarkRangeQuery/expr=abs(a_one),steps=1000-48                                                                      529471         540561         +2.09%
BenchmarkRangeQuery/expr=-a_hundred,steps=100-48                                                                       2345530        2394075        +2.07%
BenchmarkRangeQuery/expr=a_ten,steps=100-48                                                                            244135         249182         +2.07%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=1000-48                                      63578497       64800315       +1.92%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=1000-48                                        6228907        6347516        +1.90%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=100-48                                                          495732         505156         +1.90%
BenchmarkRangeQuery/expr=-a_one,steps=100-48                                                                           50753          51697          +1.86%
BenchmarkRangeQuery/expr=abs(a_one),steps=100-48                                                                       96114          97839          +1.79%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=10000-48                                                                  123905203      126061642      +1.74%
BenchmarkRangeQuery/expr=a_one,steps=10-48                                                                             36160          36765          +1.67%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                       65675030       66757137       +1.65%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=1000-48                                          6638465        6747156        +1.64%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=1-48                                                                      60162          61147          +1.64%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=1000-48                                                                  58712366       59661959       +1.62%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                               62432081       63402519       +1.55%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                                   829038         841897         +1.55%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=100-48                                                                   3138632        3187162        +1.55%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=10-48                                                 16169546       16418755       +1.54%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=1000-48                                                          14142316       14355949       +1.51%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=100-48                                                           1551198        1574300        +1.49%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=100-48                                                                  72096          73167          +1.49%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=10-48                                          237120         240587         +1.46%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=1000-48                                                              10278207       10427709       +1.45%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=1000-48                                                          43443011       44074514       +1.45%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=10-48                                                               96661394       95285518       -1.42%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                      71770          72784          +1.41%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=100-48                                                208410         211344         +1.41%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=10-48                                                                 168081         170404         +1.38%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                          65767198       66670958       +1.37%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=1-48                                                             13186854       13012139       -1.32%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=100-48                                                              192769506      190233299      -1.32%
BenchmarkRangeQuery/expr=a_ten,steps=1-48                                                                              123336         124914         +1.28%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=1-48                                                                  150029         151939         +1.27%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=10-48                                                       16418347       16214241       -1.24%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=1000-48                                                         40514727       41020795       +1.25%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=100-48                                            10220791       10347197       +1.24%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=1000-48                                               13590527       13756958       +1.22%
BenchmarkRangeQuery/expr=sum(a_ten),steps=100-48                                                                       398436         403250         +1.21%
BenchmarkRangeQuery/expr=abs(a_ten),steps=100-48                                                                       711722         720226         +1.19%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=1000-48                                        63035780       63782466       +1.18%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                           85653969       86661555       +1.18%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=1000-48                                                               34535994       34940718       +1.17%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                    810802         820197         +1.16%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=1000-48                                                                   12241667       12380077       +1.13%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=1000-48                                                             22235274       22001073       -1.05%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=10-48                                                            15097401       14939656       -1.04%
BenchmarkRangeQuery/expr=a_one,steps=100-48                                                                            47997          48501          +1.05%
BenchmarkRangeQuery/expr=a_one,steps=1-48                                                                              36202          36568          +1.01%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=100-48                                         796845         804789         +1.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=1-48                                                                         42463          42886          +1.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=100-48                                                                443769         448146         +0.99%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=10-48                                            68984          69662          +0.98%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=100-48                                                          5107452        5157193        +0.97%
BenchmarkRangeQuery/expr=a_hundred,steps=100-48                                                                        2277513        2299462        +0.96%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=100-48                                                7906951        7982824        +0.96%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=100-48                                       7470363        7541404        +0.95%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=1000-48                                                                 2225776        2205018        -0.93%
BenchmarkRangeQuery/expr=abs(a_ten),steps=1-48                                                                         153837         155265         +0.93%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=1-48                                                   163816         162310         -0.92%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=1-48                                                                84968800       84197541       -0.91%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=1-48                                                             85689679       84926119       -0.89%
BenchmarkRangeQuery/expr=-a_ten,steps=10-48                                                                            137440         138652         +0.88%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                7402150        7466907        +0.87%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=1000-48                                                1295678        1284516        -0.86%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=10000-48                                                          1294663738     1305878048     +0.87%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=10-48                                                            108448758      107521521      -0.86%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=1-48                298802         301372         +0.86%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=1-48                                                             176898         178418         +0.86%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=10-48                                                  194823         193196         -0.84%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=1000-48     62411221       61892336       -0.83%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=100-48                                                           5398522        5443752        +0.84%
BenchmarkRangeQuery/expr=sum(a_ten),steps=10-48                                                                        152715         153993         +0.84%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=1-48                                                         13211448       13104040       -0.81%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=100-48                                                           285195143      282913418      -0.80%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=10-48                                                 89755          90471          +0.80%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=1-48                                                  303256         305630         +0.78%
BenchmarkRangeQuery/expr=a_hundred,steps=1-48                                                                          1069056        1060782        -0.77%
BenchmarkRangeQuery/expr=-a_hundred,steps=10-48                                                                        1178981        1169985        -0.76%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=10-48                                                                     74258          73696          -0.76%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=1000-48                                                           125907270      126861368      +0.76%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=1-48                                                   57181          57602          +0.74%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=10-48                                                        15325829       15214167       -0.73%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=100-48                                                           43605501       43290755       -0.72%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=10-48                                          1939579        1953611        +0.72%
BenchmarkRangeQuery/expr=sum(a_one),steps=10-48                                                                        49463          49819          +0.72%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=100-48                                                                   6932713        6982393        +0.72%
BenchmarkRangeQuery/expr=abs(a_ten),steps=10-48                                                                        199467         200868         +0.70%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=10000-48                                                                23657733       23821184       +0.69%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=100-48                                     78705301       78169598       -0.68%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=1-48                                                        13421256       13330266       -0.68%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=100-48                                                                  18872597       19001228       +0.68%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=1000-48                                                          2001880092     2015520278     +0.68%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=1000-48                                                      359754869      357388740      -0.66%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=1000-48                                                              37435278       37682943       +0.66%
BenchmarkRangeQuery/expr=a_hundred,steps=10-48                                                                         1106706        1099519        -0.65%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=1-48                                                                    45918          46216          +0.65%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=1000-48                                                                 11011556       11082726       +0.65%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=1-48                                                                      272177         270448         -0.64%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=1-48                                                              13296933       13212519       -0.63%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=100-48                                                               1196350        1203975        +0.64%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=100-48                                           158918         157917         -0.63%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=10-48                                                                   161495         160479         -0.63%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=1000-48                                          1048849        1042377        -0.62%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=100-48                                                                    178540         179642         +0.62%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=100-48                                                               4810419        4839880        +0.61%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=1000-48                                                                 109319904      109987777      +0.61%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=100-48                                                 592334         595860         +0.60%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=1000-48                                                4291442        4316919        +0.59%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=1-48                                                                     1082477        1088747        +0.58%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=1-48                                             170419         171392         +0.57%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=100-48                                                                    1467577        1475862        +0.56%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=100-48      8682118        8635017        -0.54%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=1-48        2392791        2380102        -0.53%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=100-48                                                1661393        1670203        +0.53%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=10000-48                                                            244315041      243055511      -0.52%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=10-48                                                                1462261        1454783        -0.51%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=1-48                                                  1361361        1368356        +0.51%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=10-48                                                                 1427028        1419973        -0.49%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                    147663         148373         +0.48%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=1000-48                                                          337158287      338734264      +0.47%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=1-48                                               1208476        1202878        -0.46%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=1000-48             8880113        8839098        -0.46%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=100-48                                                                4536974        4557961        +0.46%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=10-48                                                                256106         257285         +0.46%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=10-48                                                             15707473       15635767       -0.46%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=10-48       2826766        2814175        -0.45%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=10-48                                                           175592         176374         +0.45%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=10-48                                                            1517654        1524370        +0.44%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=100-48                                                                  377646         376016         -0.43%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=1-48                                                                 169908         170638         +0.43%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=1-48                                       15677787       15745089       +0.43%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=1-48                                              95696675       96098135       +0.42%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=10-48                                              1453317        1447341        -0.41%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=10-48                                             162512810      163163475      +0.40%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=10-48                                            223329         224209         +0.39%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=1000-48                                                              199442547      200226747      +0.39%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=100-48                                                               28116533       28007817       -0.39%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=1000-48             3418952        3406027        -0.38%
BenchmarkRangeQuery/expr=sum(a_one),steps=100-48                                                                       128820         128335         -0.38%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=1-48                                                            151915         151346         -0.37%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=1000-48                                               1326001        1321044        -0.37%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=1-48                                                                1178787        1174407        -0.37%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=100-48                                                       45932712       45763036       -0.37%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=1-48                                                              2459473        2450787        -0.35%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=1000-48                                    678830462      676479989      -0.35%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=100-48                                             4606174        4590476        -0.34%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=1-48                                          2663744        2672849        +0.34%
BenchmarkRangeQuery/expr=-a_hundred,steps=1-48                                                                         1132074        1128233        -0.34%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=100-48                                                              3475960        3464225        -0.34%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=10-48               367578         368816         +0.34%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=1000-48                                                                   1204061        1208113        +0.34%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=1-48                                           1442346        1438013        -0.30%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=10-48                                                             3435290        3424997        -0.30%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=100-48                                         7610870        7633203        +0.29%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=1-48                                                  80466          80234          -0.29%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=100-48                                                75437857       75222495       -0.29%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=1-48                                                                  1197495        1194080        -0.29%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=100-48                                                            49561735       49423717       -0.28%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=1000-48                                               666560076      664716032      -0.28%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=10-48                                                                    1729030        1724330        -0.27%
BenchmarkRangeQuery/expr=-a_ten,steps=1-48                                                                             133552         133882         +0.25%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=1-48                                         1346642        1343339        -0.25%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=1000-48                                            33774654       33854341       +0.24%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=10-48                                                 418201         417224         -0.23%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=10-48                                        1831429        1835588        +0.23%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=100-48                                        16536719       16499354       -0.23%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                  1392928        1396045        +0.22%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=10-48                                                            297440         298073         +0.21%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                     76883          76724          -0.21%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=10-48                                                                    1203708        1201253        -0.20%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=1-48                                                                 1204259        1201836        -0.20%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=1-48                                                            1209432        1207037        -0.20%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=10-48                                                               1317078        1314531        -0.19%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=10-48                                         3795955        3788838        -0.19%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                      188907         188581         -0.17%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=1-48                                           187405         187082         -0.17%
BenchmarkRangeQuery/expr=sum(a_ten),steps=1-48                                                                         136110         136343         +0.17%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=100-48                                                      55486269       55393536       -0.17%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=100-48              1199414        1201300        +0.16%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=100-48                                            754372333      753234732      -0.15%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=1000-48                                                           393464872      394038720      +0.15%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=1000-48                                               67128863       67223712       +0.14%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=100-48                                                            14543138       14563387       +0.14%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=1-48                                             57067          56989          -0.14%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=100-48                                                 185700         185953         +0.14%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=1-48                                                                    146107         146294         +0.13%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=10-48                                                           1485779        1487672        +0.13%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=10-48               127470         127620         +0.12%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=10000-48                                                                  11916259       11902569       -0.11%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=1000-48                                                                 257154         257382         +0.09%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=100-48                                           822565         823290         +0.09%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=1-48                                                                     1278032        1277032        -0.08%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=1-48                                                             1216745        1215808        -0.08%
BenchmarkRangeQuery/expr=sum(a_one),steps=1000-48                                                                      864554         865209         +0.08%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=1000-48                                                             1085849621     1085028046     -0.08%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                     237988         238166         +0.07%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=1000-48                                                     447988463      447673962      -0.07%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=10-48                                                  70682          70650          -0.05%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=10-48                                                                     369440         369274         -0.04%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=10000-48                                                                2431217        2432240        +0.04%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=1000-48                                           6648638767     6645998529     -0.04%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=1000-48                                       141802573      141844023      +0.03%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=10-48                                                                   47458          47466          +0.02%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=10-48                                      20600065       20597916       -0.01%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                 1872193        1872007        -0.01%
BenchmarkRangeQuery/expr=a_ten,steps=10-48                                                                             129376         129376         +0.00%

benchmark                                                                                                              old allocs     new allocs     delta
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=10000-48                                                          173127         179857         +3.89%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=1000-48                                                           21002          20377          -2.98%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=1000-48                                       21306          21664          +1.68%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1-48                                                     389            386            -0.77%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1-48                                                      391            388            -0.77%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1-48                                                  391            388            -0.77%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=10-48                                                    425            422            -0.71%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=10-48                                                     427            424            -0.70%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=10-48                                                 427            424            -0.70%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1-48                                                     625            622            -0.48%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1-48                                                  625            622            -0.48%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1-48                                                      634            631            -0.47%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=10-48                                                    661            658            -0.45%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=10-48                                                 661            658            -0.45%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=10-48                                                     690            687            -0.43%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=1000-48                                               6048           6074           +0.43%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=100-48                                                   786            783            -0.38%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=100-48                                                    788            785            -0.38%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=100-48                                                788            785            -0.38%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=100-48                                                   1023           1020           -0.29%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=100-48                                                1023           1020           -0.29%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=100-48                                        5997           5987           -0.17%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                          24966          24925          -0.16%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=100-48                                                    1247           1245           -0.16%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=1-48                                             2752           2749           -0.11%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                               16526          16543          +0.10%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=10-48                                            2930           2927           -0.10%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=10-48                                         2930           2927           -0.10%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=10-48                                             3079           3076           -0.10%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=100-48                                                                    1040           1039           -0.10%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=100-48                                                1163           1162           -0.09%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=1000-48                                      18296          18311          +0.08%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=1-48                                          2751           2749           -0.07%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=1-48                                              2821           2819           -0.07%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1000-48                                                  4405           4402           -0.07%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1000-48                                                   4407           4404           -0.07%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1000-48                                               4407           4404           -0.07%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=100-48                                        4716           4713           -0.06%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1000-48                                                  4869           4866           -0.06%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1000-48                                               4869           4866           -0.06%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=1000-48                                    151837         151744         -0.06%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=100-48                                                            5134           5137           +0.06%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1000-48                                                   7048           7044           -0.06%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=100-48                                     33544          33563          +0.06%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=1-48                                                             1904           1903           -0.05%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=10-48                                                             3870           3868           -0.05%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=1000-48                                                              1935           1936           +0.05%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=10-48                                                                2195           2196           +0.05%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=10-48                                                            2437           2438           +0.04%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=1000-48                                                      93776          93813          +0.04%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=100-48                                                           20443          20435          -0.04%
BenchmarkRangeQuery/expr=abs(a_ten),steps=1000-48                                                                      2582           2583           +0.04%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=1-48                                                             16749          16743          -0.04%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                           33804          33793          -0.03%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                3862           3863           +0.03%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=100-48                                         3923           3922           -0.03%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=1000-48                                                                  12067          12064          -0.02%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=1-48        4109           4108           -0.02%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=1-48                                                              17395          17391          -0.02%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=1-48                                                        17797          17793          -0.02%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=100-48                                                       22674          22669          -0.02%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=100-48                                                            48865          48855          -0.02%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=1000-48                                                              40910          40918          +0.02%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=100-48                                                               5556           5557           +0.02%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=100-48                                            5651           5652           +0.02%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=10-48                                                            17080          17077          -0.02%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=10-48                                      23515          23511          -0.02%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=1000-48                                                                   5990           5991           +0.02%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=1000-48                                           18218          18215          -0.02%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                                   6700           6699           -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=100-48                                                           7779           7778           -0.01%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=1000-48                                          8640           8639           -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=10-48                                                        17323          17321          -0.01%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=1000-48                                                          18117          18119          +0.01%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=1000-48                                        19265          19263          -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=1000-48                                            10467          10468          +0.01%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=1000-48                                                              37841          37838          -0.01%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=1000-48                                                         57715          57711          -0.01%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=1-48                                                             16458          16459          +0.01%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=10-48                                                            16458          16459          +0.01%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=1-48                                                                16458          16459          +0.01%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=10-48                                                               16459          16458          -0.01%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=10-48                                             16508          16509          +0.01%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=100-48                                                              16659          16660          +0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=1-48                                                         16784          16785          +0.01%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=100-48                                                      69060          69064          +0.01%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=1000-48                                                               37689          37691          +0.01%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=10000-48                                                            20179          20178          -0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=10-48                                                             20245          20244          -0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=10-48                                                       22453          22452          -0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=1-48                                       22523          22522          -0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=1000-48     24899          24900          +0.00%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                       24965          24964          -0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=1000-48                                                     552754         552733         -0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=1000-48                                                           352673         352684         +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=1000-48                                                          71814          71816          +0.00%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=10000-48                                                                  55387          55386          -0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=1000-48                                                          59862          59863          +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=1000-48                                                          62938          62937          -0.00%
BenchmarkRangeQuery/expr=-a_hundred,steps=1-48                                                                         2018           2018           +0.00%
BenchmarkRangeQuery/expr=-a_hundred,steps=10-48                                                                        2018           2018           +0.00%
BenchmarkRangeQuery/expr=-a_hundred,steps=100-48                                                                       2019           2019           +0.00%
BenchmarkRangeQuery/expr=-a_hundred,steps=1000-48                                                                      3622           3622           +0.00%
BenchmarkRangeQuery/expr=-a_one,steps=1-48                                                                             122            122            +0.00%
BenchmarkRangeQuery/expr=-a_one,steps=10-48                                                                            122            122            +0.00%
BenchmarkRangeQuery/expr=-a_one,steps=100-48                                                                           123            123            +0.00%
BenchmarkRangeQuery/expr=-a_one,steps=1000-48                                                                          142            142            +0.00%
BenchmarkRangeQuery/expr=-a_ten,steps=1-48                                                                             299            299            +0.00%
BenchmarkRangeQuery/expr=-a_ten,steps=10-48                                                                            299            299            +0.00%
BenchmarkRangeQuery/expr=-a_ten,steps=100-48                                                                           300            300            +0.00%
BenchmarkRangeQuery/expr=-a_ten,steps=1000-48                                                                          463            463            +0.00%
BenchmarkRangeQuery/expr=a_hundred,steps=1-48                                                                          1605           1605           +0.00%
BenchmarkRangeQuery/expr=a_hundred,steps=10-48                                                                         1605           1605           +0.00%
BenchmarkRangeQuery/expr=a_hundred,steps=100-48                                                                        1606           1606           +0.00%
BenchmarkRangeQuery/expr=a_hundred,steps=1000-48                                                                       3209           3209           +0.00%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=1-48                                                              3744           3744           +0.00%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=100-48                                           4714           4714           +0.00%
BenchmarkRangeQuery/expr=a_one,steps=1-48                                                                              112            112            +0.00%
BenchmarkRangeQuery/expr=a_one,steps=10-48                                                                             112            112            +0.00%
BenchmarkRangeQuery/expr=a_one,steps=100-48                                                                            113            113            +0.00%
BenchmarkRangeQuery/expr=a_one,steps=1000-48                                                                           132            132            +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=1-48                                                                      196            196            +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=10-48                                                                     232            232            +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=100-48                                                                    594            594            +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=1000-48                                                                   4232           4232           +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=10000-48                                                                  40609          40609          +0.00%
BenchmarkRangeQuery/expr=a_ten,steps=1-48                                                                              252            252            +0.00%
BenchmarkRangeQuery/expr=a_ten,steps=10-48                                                                             252            252            +0.00%
BenchmarkRangeQuery/expr=a_ten,steps=100-48                                                                            253            253            +0.00%
BenchmarkRangeQuery/expr=a_ten,steps=1000-48                                                                           416            416            +0.00%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=1-48                                                                      530            530            +0.00%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=10-48                                                                     576            576            +0.00%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=1-48                                                                     2162           2162           +0.00%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=10-48                                                                    2237           2237           +0.00%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=100-48                                                                   2985           2985           +0.00%
BenchmarkRangeQuery/expr=abs(a_one),steps=1-48                                                                         146            146            +0.00%
BenchmarkRangeQuery/expr=abs(a_one),steps=10-48                                                                        155            155            +0.00%
BenchmarkRangeQuery/expr=abs(a_one),steps=100-48                                                                       246            246            +0.00%
BenchmarkRangeQuery/expr=abs(a_one),steps=1000-48                                                                      1165           1165           +0.00%
BenchmarkRangeQuery/expr=abs(a_ten),steps=1-48                                                                         335            335            +0.00%
BenchmarkRangeQuery/expr=abs(a_ten),steps=10-48                                                                        354            354            +0.00%
BenchmarkRangeQuery/expr=abs(a_ten),steps=100-48                                                                       542            542            +0.00%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=100-48                                                           16659          16659          +0.00%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=1-48                                                                 301            301            +0.00%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=10-48                                                                301            301            +0.00%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=100-48                                                               303            303            +0.00%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=1000-48                                                              317            317            +0.00%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=1-48                                                                 1774           1774           +0.00%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=10-48                                                                1774           1774           +0.00%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=100-48                                                               1794           1794           +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=1-48                                           404            404            +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=10-48                                          449            449            +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=100-48                                         900            900            +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=1000-48                                        5579           5579           +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=1-48                                           2428           2428           +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=10-48                                          2564           2564           +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=1-48                                              16510          16510          +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=100-48                                            16720          16720          +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=1-48                                                  349            349            +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=10-48                                                 349            349            +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=100-48                                                351            351            +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=1000-48                                               365            365            +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=1-48                                                  1825           1825           +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=10-48                                                 1822           1822           +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=100-48                                                1838           1838           +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=1000-48                                               1981           1981           +0.00%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=1-48                                         2405           2405           +0.00%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=10-48                                        2534           2534           +0.00%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=100-48                                       3822           3822           +0.00%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=1-48                                             190            190            +0.00%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=10-48                                            253            253            +0.00%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=100-48                                           884            884            +0.00%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=1000-48                                          7203           7203           +0.00%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=1-48                                             398            398            +0.00%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=10-48                                            471            471            +0.00%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=100-48                                           1199           1199           +0.00%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                  2643           2643           +0.00%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                 2754           2754           +0.00%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                      238            238            +0.00%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                     283            283            +0.00%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                    734            734            +0.00%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                                   5253           5253           +0.00%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                      456            456            +0.00%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                     511            511            +0.00%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                    1059           1059           +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=1000-48                                                             18096          18096          +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=1-48                                                                2036           2036           +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=10-48                                                               2036           2036           +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=100-48                                                              2037           2037           +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=1000-48                                                             3441           3441           +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=1-48                                          4597           4597           +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=10-48                                         4721           4721           +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=1-48                                                                    301            301            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=10-48                                                                   301            301            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=100-48                                                                  303            303            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=1000-48                                                                 317            317            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=1-48                                                                    140            140            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=10-48                                                                   140            140            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=100-48                                                                  141            141            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=1000-48                                                                 158            158            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=10000-48                                                                351            351            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=1-48                                                  247            247            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=10-48                                                 283            283            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=100-48                                                645            645            +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=1000-48                                               4279           4279           +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=1-48                                                                    1774           1774           +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=10-48                                                                   1774           1774           +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=100-48                                                                  1794           1794           +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=1000-48                                                                 1934           1934           +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=1-48                                                                    317            317            +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=10-48                                                                   317            317            +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=100-48                                                                  318            318            +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=1000-48                                                                 461            461            +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=10000-48                                                                2158           2158           +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=1-48                                                  653            653            +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=10-48                                                 699            699            +0.00%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=1-48                                                                     1632           1632           +0.00%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=10-48                                                                    1668           1668           +0.00%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=100-48                                                                   2029           2029           +0.00%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=1000-48                                                                  7233           7233           +0.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=1-48                                                                         137            137            +0.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=10-48                                                                        173            173            +0.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=100-48                                                                       534            534            +0.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=1000-48                                                                      4153           4153           +0.00%
BenchmarkRangeQuery/expr=sum(a_ten),steps=1-48                                                                         278            278            +0.00%
BenchmarkRangeQuery/expr=sum(a_ten),steps=10-48                                                                        314            314            +0.00%
BenchmarkRangeQuery/expr=sum(a_ten),steps=100-48                                                                       675            675            +0.00%
BenchmarkRangeQuery/expr=sum(a_ten),steps=1000-48                                                                      4438           4438           +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=1-48                                                                  296            296            +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=10-48                                                                 341            341            +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=100-48                                                                792            792            +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=1000-48                                                               5471           5471           +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=1-48                                                                  1852           1852           +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=10-48                                                                 2159           2159           +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=100-48                                                                5230           5230           +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=1-48                                                                 370            370            +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=10-48                                                                706            706            +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=100-48                                                               4067           4067           +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=1-48                                                                 1860           1860           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=1-48                                                             414            414            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=10-48                                                            948            948            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=100-48                                                           6289           6289           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=1-48                                               2068           2068           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=10-48                                              2131           2131           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=100-48                                             2762           2762           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=10-48       4270           4270           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=100-48      5892           5892           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=1-48                                                   168            168            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=10-48                                                  222            222            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=100-48                                                 763            763            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=1000-48                                                6180           6180           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=1-48                307            307            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=10-48               451            451            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=100-48              1893           1893           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=1000-48             16327          16327          +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=1-48                                                   348            348            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=10-48                                                  411            411            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=100-48                                                 1042           1042           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=1000-48                                                7485           7485           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=1-48                667            667            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=10-48               829            829            +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=100-48              2451           2451           +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=1000-48             18937          18937          +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=1-48                                                            300            300            +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=10-48                                                           363            363            +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=100-48                                                          994            994            +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=1000-48                                                         7473           7473           +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=1-48                                                            1892           1892           +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=10-48                                                           2379           2379           +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=100-48                                                          7250           7250           +0.00%

benchmark                                                                                                              old bytes     new bytes     delta
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1-48                                                     102270        130327        +27.43%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1-48                                                  102350        130364        +27.37%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1-48                                                      102351        130359        +27.36%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=10-48                                                    103424        131439        +27.09%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=10-48                                                     103504        131516        +27.06%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=10-48                                                 103504        131516        +27.06%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=100-48                                                   115001        143012        +24.36%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=100-48                                                115084        143109        +24.35%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=100-48                                                    115084        143106        +24.35%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1-48                                                     122726        150749        +22.83%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1-48                                                  122724        150733        +22.82%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1-48                                                      123787        151803        +22.63%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=10-48                                                    123886        151901        +22.61%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=10-48                                                 123884        151898        +22.61%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=10-48                                                     127888        155906        +21.91%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=100-48                                                135186        163221        +20.74%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=100-48                                                   135186        163220        +20.74%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=100-48                                                    168530        196633        +16.68%
BenchmarkRangeQuery/expr=a_one_and_b_one{l=~'.*[0-4]$'},steps=1000-48                                                  232757        260794        +12.05%
BenchmarkRangeQuery/expr=a_one_unless_b_one{l=~'.*[0-4]$'},steps=1000-48                                               232870        260906        +12.04%
BenchmarkRangeQuery/expr=a_one_or_b_one{l=~'.*[0-4]$'},steps=1000-48                                                   232886        260923        +12.04%
BenchmarkRangeQuery/expr=a_ten_and_b_ten{l=~'.*[0-4]$'},steps=1000-48                                                  274293        302933        +10.44%
BenchmarkRangeQuery/expr=a_ten_unless_b_ten{l=~'.*[0-4]$'},steps=1000-48                                               274197        302614        +10.36%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=1-48                                             314860        342882        +8.90%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=1-48                                          314868        342889        +8.90%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=1-48                                              324480        352547        +8.65%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=10-48                                         336269        364318        +8.34%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=10-48                                            336313        364268        +8.31%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=10-48                                             368441        396520        +7.62%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=1000-48                                                           3473392       3255236       -6.28%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=100-48                                           546297        576266        +5.49%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=100-48                                        546560        575679        +5.33%
BenchmarkRangeQuery/expr=a_ten_or_b_ten{l=~'.*[0-4]$'},steps=1000-48                                                   602018        630756        +4.77%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=10000-48                                                                  3659771       3823550       +4.48%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=1000-48                                       3390904       3534146       +4.22%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=100-48                                            803563        833224        +3.69%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=1000-48                                        1030332       1010262       -1.95%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=1000-48                                               377823        385260        +1.97%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=10000-48                                                                229777        233901        +1.79%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=1000-48                                                                  490471        482281        -1.67%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=1000-48                                                           30418323      30010593      -1.34%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=1000-48                                                      11324248      11470841      +1.29%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=100-48                                     2742455       2771632       +1.06%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=1000-48     1667471       1685090       +1.06%
BenchmarkRangeQuery/expr=a_hundred,steps=1000-48                                                                       259630        262366        +1.05%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=1000-48                                                               2472851       2452619       -0.82%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=100-48                                                           1842630       1827968       -0.80%
BenchmarkRangeQuery/expr=-a_hundred,steps=1000-48                                                                      292395        294567        +0.74%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=1000-48                                                          6013735       5974148       -0.66%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=100-48                                        678269        674457        -0.56%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=100-48                                                                  555592        558670        +0.55%
BenchmarkRangeQuery/expr=a_hundred_or_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                           5463691       5491217       +0.50%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=100-48                                                80771         80396         -0.46%
BenchmarkRangeQuery/expr=a_hundred_and_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                          2951841       2938448       -0.45%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=100-48                                                                  682294        685393        +0.45%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=1000-48                                                                   380367        381992        +0.43%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=100-48                                                       2197083       2187889       -0.42%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=10-48                                                                   678913        681435        +0.37%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=1-48                                                                    681410        678894        -0.37%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=100-48                                                            613942        612242        -0.28%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=100-48                                                               555894        557432        +0.28%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=100-48                                       395862        396863        +0.25%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=100-48                                                            3955032       3946068       -0.23%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=1000-48                                                          8755976       8737031       -0.22%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=100-48                                                                   361011        361696        +0.19%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=100-48                                                                375655        376366        +0.19%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=10-48                                                                557061        556011        -0.19%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=100-48                                                                    73556         73422         -0.18%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=10000-48                                                                47875         47793         -0.17%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=1-48                                                                 556303        557245        +0.17%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=100-48      451788        451090        -0.15%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=100-48                                                                   155770        156000        +0.15%
BenchmarkRangeQuery/expr=-a_hundred,steps=100-48                                                                       150042        150250        +0.14%
BenchmarkRangeQuery/expr=-a_ten,steps=1000-48                                                                          35633         35584         -0.14%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=1000-48                                                                 34372         34325         -0.14%
BenchmarkRangeQuery/expr=a_hundred_unless_b_hundred{l=~'.*[0-4]$'},steps=1000-48                                       2960690       2964411       +0.13%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=100-48                                                      7017099       7025588       +0.12%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=10000-48                                                          45640253      45694933      +0.12%
BenchmarkRangeQuery/expr=abs(a_ten),steps=1000-48                                                                      236138        235859        -0.12%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=1000-48                                                             287674        287338        -0.12%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                398569        398105        -0.12%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=100-48                                                              150534        150658        +0.08%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=1-48                                                                    557186        557561        +0.07%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=10-48                                                             373811        373571        -0.06%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=1000-48                                                              2641074       2639442       -0.06%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=10-48                                         436524        436743        +0.05%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=100-48                                                           730887        731194        +0.04%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=100-48                                         289731        289614        -0.04%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                               2202946       2203784       +0.04%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=1000-48                                    16565801      16559750      -0.04%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=1000-48                                      2259898       2260687       +0.03%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=1000-48             1133386       1133028       -0.03%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=1000-48                                                               261790        261716        -0.03%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=10-48                                      2270684       2270058       -0.03%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=1000-48                                               148012        147974        -0.03%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=100-48                                           67444         67427         -0.03%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=100-48                                                               393623        393720        +0.02%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=100-48                                                          683148        682981        -0.02%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=10-48                                                                   557190        557064        -0.02%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=1-48                                                        1708307       1707941       -0.02%
BenchmarkRangeQuery/expr=a_hundred_-_b_hundred,steps=1-48                                                              349684        349616        -0.02%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=1000-48                                          431434        431512        +0.02%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=10-48                                                            1623159       1622869       -0.02%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=100-48                                             219482        219443        -0.02%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=100-48                                         45033         45025         -0.02%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=1-48                                                  1185161       1184952       -0.02%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=1-48                                                         1605285       1605560       +0.02%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=1000-48                                        205410        205375        -0.02%
BenchmarkRangeQuery/expr=abs(a_one),steps=1000-48                                                                      43270         43263         -0.02%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=10-48                                                 53693         53685         -0.01%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                                   176799        176773        -0.01%
BenchmarkRangeQuery/expr=a_one,steps=10-48                                                                             7018          7019          +0.01%
BenchmarkRangeQuery/expr=a_one,steps=1-48                                                                              7019          7020          +0.01%
BenchmarkRangeQuery/expr=sum(a_ten),steps=1000-48                                                                      227217        227185        -0.01%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=1000-48                                                     58489412      58497595      +0.01%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                    64884         64893         +0.01%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=1-48                                                              1647564       1647337       -0.01%
BenchmarkRangeQuery/expr=-a_one,steps=100-48                                                                           7596          7595          -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=1000-48                                                502264        502200        -0.01%
BenchmarkRangeQuery/expr=a_ten,steps=1000-48                                                                           31897         31893         -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(h_hundred),steps=10-48                                                        1660020       1659820       -0.01%
BenchmarkRangeQuery/expr=a_ten,steps=100-48                                                                            17011         17009         -0.01%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=1000-48                                                                   146661        146678        +0.01%
BenchmarkRangeQuery/expr=sum_without_(le)(h_hundred),steps=10-48                                                       2192735       2192483       -0.01%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=10-48                                                                190014        190034        +0.01%
BenchmarkRangeQuery/expr=sum(a_ten),steps=100-48                                                                       39404         39400         -0.01%
BenchmarkRangeQuery/expr=rate(a_hundred[1m])_+_rate(b_hundred[1m]),steps=1-48                                          412498        412457        -0.01%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=1000-48                                                                 10275         10274         -0.01%
BenchmarkRangeQuery/expr=-a_ten,steps=100-48                                                                           20757         20759         +0.01%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=1-48                                           232063        232085        +0.01%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=100-48                                                                  21114         21116         +0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=10-48                                                            226804        226825        +0.01%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                      33090         33093         +0.01%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=10-48                                                               153302        153315        +0.01%
BenchmarkRangeQuery/expr=sum(a_one),steps=1000-48                                                                      202577        202594        +0.01%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=10-48                                        228507        228489        -0.01%
BenchmarkRangeQuery/expr=rate(a_ten[1m])_+_rate(b_ten[1m]),steps=1-48                                                  50961         50957         -0.01%
BenchmarkRangeQuery/expr=abs(a_ten),steps=1-48                                                                         25866         25864         -0.01%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=10-48                                                                    211304        211320        +0.01%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=1000-48                                          237347        237330        -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=1000-48             1015391       1015319       -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=100-48                                                 70939         70944         +0.01%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=1000-48                                   371297        371271        -0.01%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_ten[5m])),steps=10-48                                          237640        237656        +0.01%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=10-48                                                                     46596         46599         +0.01%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=1000-48                                                              2333077       2332928       -0.01%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=10-48                                                                 187989        188001        +0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=10-48       361795        361773        -0.01%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=100-48                                                               253643        253628        -0.01%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=1-48                                                                153269        153278        +0.01%
BenchmarkRangeQuery/expr=a_ten,steps=1-48                                                                              17244         17245         +0.01%
BenchmarkRangeQuery/expr=a_ten,steps=10-48                                                                             17245         17244         -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=100-48                                                           555872        555904        +0.01%
BenchmarkRangeQuery/expr=rate(a_one[1d]),steps=1000-48                                                                 557242        557274        +0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m]))_/_sum_without_(l)(rate(b_hundred[1m])),steps=1-48        352277        352257        -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=1000-48                                                443615        443640        +0.01%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=1-48                                                                     195989        196000        +0.01%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=100-48                                                          71370         71374         +0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=10-48                                              180304        180294        -0.01%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=1-48                19047         19046         -0.01%
BenchmarkRangeQuery/expr=a_hundred,steps=100-48                                                                        114676        114682        +0.01%
BenchmarkRangeQuery/expr=-a_hundred,steps=10-48                                                                        152924        152932        +0.01%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=1000-48                                                         5496748       5496466       -0.01%
BenchmarkRangeQuery/expr=abs(a_hundred),steps=1000-48                                                                  2053059       2052959       -0.00%
BenchmarkRangeQuery/expr=sum(a_ten),steps=1-48                                                                         20620         20621         +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=1000-48                                           4364472       4364264       -0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=1-48                                                                  21981         21980         -0.00%
BenchmarkRangeQuery/expr=sum(a_ten),steps=10-48                                                                        22349         22350         +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=1-48                                                            22524         22525         +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=10-48                                                                 23998         23997         -0.00%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=1000-48                                                              731795        731825        +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=100-48                                                 52345         52347         +0.00%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=10-48                                                            1919478       1919551       +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=10-48                                                            80542         80539         -0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=1-48                                                                 26997         26996         -0.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=100-48                                                                       27262         27263         +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=100-48                                                28076         28077         +0.00%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=1-48                                             29289         29290         +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=1000-48                                               1352307       1352352       +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=1-48                                                             32981         32982         +0.00%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=1000-48                                                          3187964       3188060       +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=1-48                                               176100        176095        -0.00%
BenchmarkRangeQuery/expr=label_replace(a_ten,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                     36004         36003         -0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=100-48              154575        154579        +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=1000-48                                                         534141        534128        -0.00%
BenchmarkRangeQuery/expr=a_ten_-_b_ten,steps=1-48                                                                      43860         43861         +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_hundred),steps=1-48                                                             1598856       1598821       -0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=1-48                50456         50455         -0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_hundred),steps=10-48                                                             1856332       1856296       -0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_hundred[5m])),steps=1-48                                       2223038       2223079       +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_hundred[1m])),steps=1000-48                                            791304        791318        +0.00%
BenchmarkRangeQuery/expr=a_hundred,steps=10-48                                                                         117429        117427        -0.00%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                 235585        235581        -0.00%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=10-48                                             2539354       2539395       +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_one),steps=1000-48                                                          5328831       5328915       +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=10-48                                                               1919486       1919515       +0.00%
BenchmarkRangeQuery/expr=label_join(a_hundred,_'l2',_'-',_'l',_'l'),steps=1-48                                         211446        211449        +0.00%
BenchmarkRangeQuery/expr=-a_hundred,steps=1-48                                                                         152899        152901        +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_ten),steps=1-48                                                                  168879        168881        +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=1-48                                                                1918833       1918852       +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=100-48              117384        117383        -0.00%
BenchmarkRangeQuery/expr=a_hundred,steps=1-48                                                                          117816        117815        -0.00%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=10-48                                                                    141485        141486        +0.00%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=1-48                                                             1918838       1918851       +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_ten),steps=1-48                                                                 169353        169352        -0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=1-48                                                            174957        174958        +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(h_ten),steps=1-48                                                             176042        176041        -0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=100-48                                                              1959181       1959192       +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=1-48                                              2537190       2537178       -0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=10-48                                                 1309941       1309947       +0.00%
BenchmarkRangeQuery/expr=label_replace(a_hundred,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                  219076        219077        +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_ten),steps=10-48                                                           221445        221444        -0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1d]),steps=1000-48                                                                 707618        707621        +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=100-48                                                1187291       1187286       -0.00%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=10-48                                                                680172        680170        -0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1m]),steps=10000-48                                                            3597499       3597489       -0.00%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=1000-48                                               1203534       1203531       -0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=100-48                                                1287708       1287711       +0.00%
BenchmarkRangeQuery/expr=changes(a_one[1d]),steps=1000-48                                                              559215        559216        +0.00%
BenchmarkRangeQuery/expr=changes(a_hundred[1d]),steps=100-48                                                           1959163       1959166       +0.00%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=1-48                                                                 678918        678919        +0.00%
BenchmarkRangeQuery/expr=changes(a_ten[1d]),steps=100-48                                                               685448        685447        -0.00%
BenchmarkRangeQuery/expr=holt_winters(a_hundred[1d],_0.3,_0.3),steps=100-48                                            2569785       2569784       -0.00%
BenchmarkRangeQuery/expr=-a_one,steps=1-48                                                                             7546          7546          +0.00%
BenchmarkRangeQuery/expr=-a_one,steps=10-48                                                                            7546          7546          +0.00%
BenchmarkRangeQuery/expr=-a_one,steps=1000-48                                                                          10081         10081         +0.00%
BenchmarkRangeQuery/expr=-a_ten,steps=1-48                                                                             20992         20992         +0.00%
BenchmarkRangeQuery/expr=-a_ten,steps=10-48                                                                            20992         20992         +0.00%
BenchmarkRangeQuery/expr=a_one,steps=100-48                                                                            7067          7067          +0.00%
BenchmarkRangeQuery/expr=a_one,steps=1000-48                                                                           9552          9552          +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=1-48                                                                      13699         13699         +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=10-48                                                                     14852         14852         +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=100-48                                                                    26471         26471         +0.00%
BenchmarkRangeQuery/expr=a_one_-_b_one,steps=10000-48                                                                  1375434       1375434       +0.00%
BenchmarkRangeQuery/expr=abs(a_one),steps=1-48                                                                         8747          8747          +0.00%
BenchmarkRangeQuery/expr=abs(a_one),steps=10-48                                                                        9036          9036          +0.00%
BenchmarkRangeQuery/expr=abs(a_one),steps=100-48                                                                       11965         11965         +0.00%
BenchmarkRangeQuery/expr=abs(a_ten),steps=10-48                                                                        27624         27624         +0.00%
BenchmarkRangeQuery/expr=abs(a_ten),steps=100-48                                                                       44980         44980         +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=1-48                                           29443         29443         +0.00%
BenchmarkRangeQuery/expr=histogram_quantile(0.9,_rate(h_one[5m])),steps=10-48                                          30884         30884         +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_one[1d],_0.3,_0.3),steps=10-48                                                 1185522       1185522       +0.00%
BenchmarkRangeQuery/expr=holt_winters(a_ten[1d],_0.3,_0.3),steps=1-48                                                  1308687       1308687       +0.00%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=1-48                                             10924         10924         +0.00%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=10-48                                            12941         12941         +0.00%
BenchmarkRangeQuery/expr=label_join(a_one,_'l2',_'-',_'l',_'l'),steps=100-48                                           33156         33156         +0.00%
BenchmarkRangeQuery/expr=label_join(a_ten,_'l2',_'-',_'l',_'l'),steps=10-48                                            32779         32779         +0.00%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=1-48                                      14325         14325         +0.00%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=10-48                                     15766         15766         +0.00%
BenchmarkRangeQuery/expr=label_replace(a_one,_'l2',_'$1',_'l',_'(.*)'),steps=100-48                                    30219         30219         +0.00%
BenchmarkRangeQuery/expr=rate(a_hundred[1d]),steps=1000-48                                                             2807320       2807320       +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=1-48                                                                    7900          7900          +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=10-48                                                                   7900          7900          +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m]),steps=100-48                                                                  7949          7949          +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=1-48                                                  15302         15302         +0.00%
BenchmarkRangeQuery/expr=rate(a_one[1m])_+_rate(b_one[1m]),steps=10-48                                                 16454         16454         +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=1-48                                                                    21347         21347         +0.00%
BenchmarkRangeQuery/expr=rate(a_ten[1m]),steps=10-48                                                                   21348         21348         +0.00%
BenchmarkRangeQuery/expr=sum(a_hundred),steps=1-48                                                                     139731        139731        +0.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=1-48                                                                         8202          8202          +0.00%
BenchmarkRangeQuery/expr=sum(a_one),steps=10-48                                                                        9930          9930          +0.00%
BenchmarkRangeQuery/expr=sum_by_(l)(h_one),steps=100-48                                                                43897         43897         +0.00%
BenchmarkRangeQuery/expr=sum_by_(le)(h_one),steps=10-48                                                                47622         47622         +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=1-48                                                   9516          9516          +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m])),steps=10-48                                                  13405         13405         +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_one[1m]))_/_sum_without_(l)(rate(b_one[1m])),steps=10-48               27977         27977         +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=1-48                                                   25220         25220         +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m])),steps=10-48                                                  29398         29398         +0.00%
BenchmarkRangeQuery/expr=sum_without_(l)(rate(a_ten[1m]))_/_sum_without_(l)(rate(b_ten[1m])),steps=10-48               59963         59963         +0.00%
BenchmarkRangeQuery/expr=sum_without_(le)(h_one),steps=10-48                                                           26990         26990         +0.00%

brian-brazil · 2019-01-03T16:36:51Z

It looks like if there's less than ~100 iterators, then the current implementation can be faster. However the cost here is something like 0.2ms, against saving many seconds in larger cases.

krasi-georgiev · 2019-01-03T16:57:32Z

and it is much easier to understand.

LGTM

Avoid a tree of merge objects, which can result in what I suspect is n^2 calls to Seek when using Without. With 100k metrics, and a regex of ^$ in BenchmarkHeadPostingForMatchers: Before: BenchmarkHeadPostingForMatchers-8 1 51633185216 ns/op 29745528 B/op 200357 allocs/op After: BenchmarkHeadPostingForMatchers-8 10 108924996 ns/op 25715025 B/op 101748 allocs/op Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>

bwplotka · 2019-01-23T15:03:49Z

FYI that suprisingly killed our ability to use this helper in Thanos (thanos-io/thanos#753). The interface allows for it, so maybe it's fair, but just a lesson to me to subscribe for TSDB changes ;p

krasi-georgiev · 2019-01-23T15:05:58Z

@bwplotka could we have added something in the changelog to help for such cases in the future?

bwplotka · 2019-01-23T15:08:32Z

What exactly? I think it's general rule to think seriously about other users of TSDB than just Prometheus. (:

brian-brazil merged commit 296f943 into master Jan 3, 2019

brian-brazil deleted the merge-perf branch January 3, 2019 16:59

bwplotka mentioned this pull request Jan 22, 2019

store: Moved to our own custom posting helpers. thanos-io/thanos#753

Merged

brian-brazil mentioned this pull request Feb 21, 2019

Improve Merge performance #531

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

More efficient Merge implementation. #486

More efficient Merge implementation. #486

brian-brazil commented Dec 28, 2018

krasi-georgiev commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

brian-brazil commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

brian-brazil commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

brian-brazil commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

bwplotka commented Jan 23, 2019 •

edited

Loading

krasi-georgiev commented Jan 23, 2019

bwplotka commented Jan 23, 2019

More efficient Merge implementation. #486

More efficient Merge implementation. #486

Conversation

brian-brazil commented Dec 28, 2018

krasi-georgiev commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

brian-brazil commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

brian-brazil commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

brian-brazil commented Jan 3, 2019

krasi-georgiev commented Jan 3, 2019

bwplotka commented Jan 23, 2019 • edited Loading

krasi-georgiev commented Jan 23, 2019

bwplotka commented Jan 23, 2019

bwplotka commented Jan 23, 2019 •

edited

Loading