Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more statistical values (minimum latency, variance, skewness, kurtosis...) #367

Open
thatsdone opened this issue Jun 15, 2022 · 2 comments

Comments

@thatsdone
Copy link
Contributor

Describe the Issue (Bug/Feature)
This is a suggestion improving performance measurement output.

I think it's a good idea some more statistical values including:

  • minimum latency (Actually, this is the 0th percentile that we don't have now.)
  • variance (or standard deviation)
  • skewness
  • kurtosis

To Reproduce

Run sbk (at least object storage test such as '-driver minio').

Expected behavior

Output the additional output values listed abve.

Additional context

BTW, is there any explanations of SLC?
More simply speaking, what does SLC stand for in the measurement results?

@kmgowda
Copy link
Owner

kmgowda commented Jun 16, 2022

@thatsdone thank you for your issue on improvements

here are my comments

  • minimum latency (Actually, this is the 0th percentile that we don't have now.)
    ok, I will add the minimum latency and 1st percentile , but now i am the verge of reaching version 1.0 ; I will add this feature after 1.0 release ; however, I welcome you want to contribute to this.

  • variance (or standard deviation)
    SLC (Sliding latency Coverage) factors , solve this purpose , read this : https://github.com/kmgowda/SBK#running-performance-benchmarking

  • skewness
    performance latency percentile graphs are always right skewed (hence the name , sliding latencies ) ; nothing can be done for this

  • kurtosis
    there are lower and higher discarded latency counts ; I think it's a good idea to add percentage values ; I will add this feature after 1.0 release ; however, I welcome you want to contribute to this.

@kmgowda
Copy link
Owner

kmgowda commented Jul 19, 2022

@thatsdone check this paper about SLC : https://kmgowda.github.io/SBK/docs/sbk-slc.pdf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants