Skip to content

More boot time metrics #5176

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

ShadowCurse
Copy link
Contributor

Changes

  • Emit systemd-analyze output as metrics.
  • Emit already collected, but not emitted metrics

Reason

Better boot time test visibility.

License Acceptance

By submitting this pull request, I confirm that my contribution is made under
the terms of the Apache 2.0 license. For more information on following Developer
Certificate of Origin and signing off your commits, please check
CONTRIBUTING.md.

PR Checklist

  • I have read and understand CONTRIBUTING.md.
  • I have run tools/devtool checkstyle to verify that the PR passes the
    automated style checks.
  • I have described what is done in these changes, why they are needed, and
    how they are solving the problem in a clear and encompassing way.
  • I have updated any relevant documentation (both in code and in the docs)
    in the PR.
  • I have mentioned all user-facing changes in CHANGELOG.md.
  • If a specific issue led to this PR, this PR closes the issue.
  • When making API changes, I have followed the
    Runbook for Firecracker API changes.
  • I have tested all new and changed functionalities in unit tests and/or
    integration tests.
  • I have linked an issue to every new TODO.

  • This functionality cannot be added in rust-vmm.

Sorry, something went wrong.

@ShadowCurse ShadowCurse force-pushed the systemd_analyze_boottime branch from cd205f0 to ea3a06a Compare April 29, 2025 15:26
Copy link

codecov bot commented Apr 29, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 82.93%. Comparing base (dafee92) to head (266718c).
Report is 4 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #5176      +/-   ##
==========================================
+ Coverage   82.87%   82.93%   +0.05%     
==========================================
  Files         250      250              
  Lines       26932    26932              
==========================================
+ Hits        22321    22335      +14     
+ Misses       4611     4597      -14     
Flag Coverage Δ
5.10-c5n.metal 83.37% <ø> (ø)
5.10-m5n.metal 83.36% <ø> (ø)
5.10-m6a.metal 82.58% <ø> (+<0.01%) ⬆️
5.10-m6g.metal 79.19% <ø> (ø)
5.10-m6i.metal 83.36% <ø> (+<0.01%) ⬆️
5.10-m7a.metal-48xl 82.57% <ø> (?)
5.10-m7g.metal 79.19% <ø> (ø)
5.10-m7i.metal-24xl 83.33% <ø> (?)
5.10-m7i.metal-48xl 83.33% <ø> (?)
5.10-m8g.metal-24xl 79.19% <ø> (?)
5.10-m8g.metal-48xl 79.19% <ø> (?)
6.1-c5n.metal 83.41% <ø> (ø)
6.1-m5n.metal 83.41% <ø> (-0.01%) ⬇️
6.1-m6a.metal 82.63% <ø> (ø)
6.1-m6g.metal 79.18% <ø> (ø)
6.1-m6i.metal 83.40% <ø> (-0.01%) ⬇️
6.1-m7a.metal-48xl 82.61% <ø> (?)
6.1-m7g.metal 79.19% <ø> (ø)
6.1-m7i.metal-24xl 83.43% <ø> (?)
6.1-m7i.metal-48xl 83.42% <ø> (?)
6.1-m8g.metal-24xl 79.19% <ø> (?)
6.1-m8g.metal-48xl 79.19% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ShadowCurse ShadowCurse force-pushed the systemd_analyze_boottime branch 3 times, most recently from c8ec305 to 9b806cd Compare April 29, 2025 15:52
@ShadowCurse ShadowCurse added the Type: Enhancement Indicates new feature requests label Apr 29, 2025
@ShadowCurse ShadowCurse marked this pull request as ready for review April 29, 2025 15:52
@ShadowCurse ShadowCurse added the Status: Awaiting review Indicates that a pull request is ready to be reviewed label Apr 29, 2025
@ShadowCurse ShadowCurse self-assigned this Apr 29, 2025
@ShadowCurse ShadowCurse force-pushed the systemd_analyze_boottime branch 2 times, most recently from a12c403 to 0ef4e46 Compare April 29, 2025 17:34
pb8o
pb8o previously approved these changes Apr 29, 2025
Copy link
Contributor

@pb8o pb8o left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@ShadowCurse ShadowCurse force-pushed the systemd_analyze_boottime branch 3 times, most recently from 90b3ef1 to 5a63e50 Compare April 30, 2025 09:36
@ShadowCurse ShadowCurse requested review from roypat and pb8o April 30, 2025 10:32

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Currently we measure boottime by looking at the Firecracker
logs and waiting for the guest to trigger a special boot device
inside Firecracker.
There is an alternative way of measuring boot time from
a guest perspective by using systemd-analyze. Will help us to understand
boot times better.

Signed-off-by: Egor Lazarchuk <yegorlz@amazon.co.uk>
Emit both boot time metrics for boot device: clock time and cpu time.
Additionally, stop subtracting VM build time from a guest boot time at
the metric emit time. This can be done later at the visualization stage.

Signed-off-by: Egor Lazarchuk <yegorlz@amazon.co.uk>
Since we already collect this delta, put it into
metrics as well.

Signed-off-by: Egor Lazarchuk <yegorlz@amazon.co.uk>
This metrics has very small numbers which makes it too
volatile for A/B tests.

Signed-off-by: Egor Lazarchuk <yegorlz@amazon.co.uk>
@ShadowCurse ShadowCurse force-pushed the systemd_analyze_boottime branch from b438de8 to 266718c Compare May 2, 2025 08:42
@ShadowCurse ShadowCurse merged commit 4a02df4 into firecracker-microvm:main May 2, 2025
6 of 7 checks passed
@ShadowCurse ShadowCurse deleted the systemd_analyze_boottime branch May 2, 2025 09:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Awaiting review Indicates that a pull request is ready to be reviewed Type: Enhancement Indicates new feature requests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants