You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Take the "get vehicles" row: in 136s the workload has processed 28450, so 28450/136= 209 ops/second, not 24. 24 is the result of the partial ops 3307/136, which does not make sense calculating. Rather, it should be ops/current_period_duration, that is, 3307/15s = 220
I think these column labels are just misleading. The ops(total) column label should be a cumulative total for the lifetime of the generator. It follows that time(total) should also be a cumulative time elapsed for the lifetime of the generator, but it appears that it is, in fact, just the lifetime of the stats calculator (what Fabio called current_period_duration).
Problem
@fabiog1901 recently expressed concern over the accuracy of the statistics calculator.
I think these column labels are just misleading. The
ops(total)
column label should be a cumulative total for the lifetime of the generator. It follows thattime(total)
should also be a cumulative time elapsed for the lifetime of the generator, but it appears that it is, in fact, just the lifetime of the stats calculator (what Fabio calledcurrent_period_duration
).ops/second
is roughlyops
/time(total)
(https://github.com/cockroachdb/movr/blob/master/movr_stats.py#L45). The reason it is so imprecise appears to be because the time measurement displayed fortime(total)
is rounded to the nearest integer.Suggested resolution
Update the stats table titles to make the time statistic title less confusing:
https://github.com/cockroachdb/movr/blob/master/movr_stats.py#L54
We could also potentially update the time measurement to be a little more precise.
The text was updated successfully, but these errors were encountered: