Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Meta] Track performance metrics for cloud snapshots and master branch #35

Open
dmlemeshko opened this issue Jan 26, 2021 · 2 comments
Open

Comments

@dmlemeshko
Copy link
Member

dmlemeshko commented Jan 26, 2021

As we agreed, we gonna have different load scenarios for testing snapshots and locally build Kibana: Kibana + ES hosted on worker can take higher load so it is irrelevant to compare cloud vs worker results.

We plan to proceed this way:

  • monitor cloud by running daily "cloud scenario" for 8.0 (CI trigger) & 7.x (currently triggered manually)
  • daily monitor master by building Kibana and using latests ES snapshot, running "local scenario" for it.
  • build charts in Kibana stats to:
    • track cloud snaphots performance
    • track master build performance
    • compare dev branch vs master

Tasks:

  • define cloud scenario
  • define local scenario
  • set 7.x trigger on CI
  • set master branch trigger on CI
  • configure dashboards on build stats
@dmlemeshko dmlemeshko mentioned this issue Jan 26, 2021
2 tasks
@LeeDr
Copy link

LeeDr commented Jan 26, 2021

  1. daily master snapshots on Cloud (Cloud scenario)
  2. daily master Kibana branch build (local scenario)
  3. ad-hoc load test runner for PRs (local scenario) (these should be comparable to Add esArchiver functionality #2, not Cloud Identify queries associated with scenario/user workflow in log  #1)

Comparison across versions. One-time per release jobs. 7.9, 7.10, etc. Are these on Cloud or local or both?

lower priority
daily Cloud on 7.x or release branch?
daily local on 7.x or release branch?

@dmlemeshko
Copy link
Member Author

  1. daily master snapshots on Cloud (Cloud scenario) DONE
  2. daily master Kibana branch build (local scenario) DONE

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants