-
Notifications
You must be signed in to change notification settings - Fork 123
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ci: Fail QNS run on Rust panic #1976
Conversation
So we hopefully catch interop panics in CI earlier.
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #1976 +/- ##
==========================================
+ Coverage 94.96% 94.99% +0.02%
==========================================
Files 112 112
Lines 36411 36366 -45
==========================================
- Hits 34579 34547 -32
+ Misses 1832 1819 -13 ☔ View full report in Codecov by Sentry. |
Benchmark resultsPerformance differences relative to e82da39. coalesce_acked_from_zero 1+1 entries: No change in performance detected.time: [192.06 ns 192.63 ns 193.23 ns] change: [-0.3782% +0.0481% +0.4975%] (p = 0.84 > 0.05) coalesce_acked_from_zero 3+1 entries: Change within noise threshold.time: [233.52 ns 234.14 ns 234.79 ns] change: [-0.7543% -0.4260% -0.1064%] (p = 0.01 < 0.05) coalesce_acked_from_zero 10+1 entries: Change within noise threshold.time: [232.57 ns 233.51 ns 234.54 ns] change: [-1.3140% -0.8198% -0.3372%] (p = 0.00 < 0.05) coalesce_acked_from_zero 1000+1 entries: No change in performance detected.time: [214.49 ns 214.69 ns 214.94 ns] change: [-1.2432% -0.5422% +0.1558%] (p = 0.14 > 0.05) RxStreamOrderer::inbound_frame(): 💔 Performance has regressed.time: [120.49 ms 120.66 ms 120.91 ms] change: [+1.3265% +1.5142% +1.7505%] (p = 0.00 < 0.05) transfer/Run multiple transfers with varying seeds: No change in performance detected.time: [51.052 ms 54.103 ms 57.175 ms] thrpt: [69.961 MiB/s 73.932 MiB/s 78.352 MiB/s] change: time: [-12.582% -5.9786% +1.3674%] (p = 0.11 > 0.05) thrpt: [-1.3490% +6.3588% +14.392%] transfer/Run multiple transfers with the same seed: No change in performance detected.time: [60.470 ms 67.333 ms 74.132 ms] thrpt: [53.958 MiB/s 59.406 MiB/s 66.149 MiB/s] change: time: [-20.409% -9.1186% +1.1046%] (p = 0.13 > 0.05) thrpt: [-1.0925% +10.034% +25.642%] 1-conn/1-100mb-resp (aka. Download)/client: No change in performance detected.time: [287.78 ms 292.01 ms 296.51 ms] thrpt: [337.25 MiB/s 342.46 MiB/s 347.49 MiB/s] change: time: [-3.7881% -1.0519% +1.7142%] (p = 0.48 > 0.05) thrpt: [-1.6853% +1.0631% +3.9373%] 1-conn/10_000-parallel-1b-resp (aka. RPS)/client: No change in performance detected.time: [412.91 ms 416.29 ms 419.70 ms] thrpt: [23.826 Kelem/s 24.022 Kelem/s 24.219 Kelem/s] change: time: [-0.6794% +0.4930% +1.6323%] (p = 0.40 > 0.05) thrpt: [-1.6061% -0.4906% +0.6841%] 1-conn/1-1b-resp (aka. HPS)/client: No change in performance detected.time: [67.819 ms 68.052 ms 68.328 ms] thrpt: [14.635 elem/s 14.695 elem/s 14.745 elem/s] change: time: [-2.1209% -0.8984% +0.0631%] (p = 0.11 > 0.05) thrpt: [-0.0631% +0.9066% +2.1669%] Client/server transfer resultsTransfer of 33554432 bytes over loopback.
|
This needs to wait until #1975 is fixed, otherwise all CI will fail. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks 👍
Signed-off-by: Lars Eggert <lars@eggert.org>
The single remaining failure is Run QNS (neqo-latest vs. neqo), which is because mainline neqo doesn't have #1981 yet. |
So we hopefully catch interop panics in CI earlier.