Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Remove test_ from test names #2024

Merged
merged 1 commit into from
Jul 31, 2024

Conversation

larseggert
Copy link
Collaborator

To make @martinthomson happy :-)

Copy link
Collaborator

@mxinden mxinden left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🙂

Copy link

Failed Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Copy link

codecov bot commented Jul 31, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.00%. Comparing base (4dc6ca4) to head (8831053).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2024   +/-   ##
=======================================
  Coverage   95.00%   95.00%           
=======================================
  Files         112      112           
  Lines       36364    36364           
=======================================
+ Hits        34546    34548    +2     
+ Misses       1818     1816    -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@larseggert larseggert added this pull request to the merge queue Jul 31, 2024
Copy link

Benchmark results

Performance differences relative to 4dc6ca4.

coalesce_acked_from_zero 1+1 entries: 💔 Performance has regressed.
       time:   [195.77 ns 196.25 ns 196.75 ns]
       change: [+1.2089% +1.5393% +1.8955%] (p = 0.00 < 0.05)

Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) low mild
3 (3.00%) high mild
2 (2.00%) high severe

coalesce_acked_from_zero 3+1 entries: No change in performance detected.
       time:   [235.54 ns 236.15 ns 236.81 ns]
       change: [-0.4531% +0.0042% +0.4117%] (p = 0.99 > 0.05)

Found 11 outliers among 100 measurements (11.00%)
2 (2.00%) high mild
9 (9.00%) high severe

coalesce_acked_from_zero 10+1 entries: No change in performance detected.
       time:   [236.03 ns 237.20 ns 238.57 ns]
       change: [-0.9599% -0.2566% +0.5778%] (p = 0.53 > 0.05)

Found 8 outliers among 100 measurements (8.00%)
8 (8.00%) high severe

coalesce_acked_from_zero 1000+1 entries: No change in performance detected.
       time:   [217.38 ns 217.61 ns 217.94 ns]
       change: [-0.1249% +0.5823% +1.2388%] (p = 0.11 > 0.05)

Found 13 outliers among 100 measurements (13.00%)
3 (3.00%) high mild
10 (10.00%) high severe

RxStreamOrderer::inbound_frame(): No change in performance detected.
       time:   [119.23 ms 119.37 ms 119.61 ms]
       change: [+0.0249% +0.1592% +0.3647%] (p = 0.05 > 0.05)

Found 25 outliers among 100 measurements (25.00%)
5 (5.00%) low severe
8 (8.00%) low mild
6 (6.00%) high mild
6 (6.00%) high severe

transfer/pacing-false/varying-seeds: No change in performance detected.
       time:   [40.029 ms 41.878 ms 43.773 ms]
       change: [-8.9600% -1.7980% +5.5612%] (p = 0.63 > 0.05)

Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) low mild
2 (2.00%) high mild

transfer/pacing-true/varying-seeds: No change in performance detected.
       time:   [54.209 ms 57.918 ms 61.631 ms]
       change: [-8.0939% +0.2371% +9.7016%] (p = 0.95 > 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild

transfer/pacing-false/same-seed: No change in performance detected.
       time:   [47.197 ms 48.997 ms 50.726 ms]
       change: [-8.6910% -4.1889% +0.4307%] (p = 0.08 > 0.05)

Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) low mild

transfer/pacing-true/same-seed: No change in performance detected.
       time:   [63.718 ms 71.112 ms 78.556 ms]
       change: [-20.245% -7.5569% +5.3023%] (p = 0.26 > 0.05)
1-conn/1-100mb-resp (aka. Download)/client: No change in performance detected.
       time:   [260.80 ms 271.37 ms 281.26 ms]
       thrpt:  [355.54 MiB/s 368.50 MiB/s 383.43 MiB/s]
change:
       time:   [-4.4387% +0.7384% +6.2345%] (p = 0.78 > 0.05)
       thrpt:  [-5.8686% -0.7330% +4.6449%]

Found 21 outliers among 100 measurements (21.00%)
19 (19.00%) low severe
1 (1.00%) low mild
1 (1.00%) high mild

1-conn/10_000-parallel-1b-resp (aka. RPS)/client: No change in performance detected.
       time:   [414.94 ms 418.78 ms 422.58 ms]
       thrpt:  [23.664 Kelem/s 23.879 Kelem/s 24.100 Kelem/s]
change:
       time:   [-1.1570% +0.1067% +1.3829%] (p = 0.87 > 0.05)
       thrpt:  [-1.3640% -0.1066% +1.1705%]
1-conn/1-1b-resp (aka. HPS)/client: No change in performance detected.
       time:   [67.047 ms 67.338 ms 67.669 ms]
       thrpt:  [14.778  elem/s 14.850  elem/s 14.915  elem/s]
change:
       time:   [-0.6538% +0.0463% +0.7924%] (p = 0.90 > 0.05)
       thrpt:  [-0.7862% -0.0463% +0.6581%]

Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) high mild
4 (4.00%) high severe

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing Mean [ms] Min [ms] Max [ms] Relative
msquic msquic 209.6 ± 131.3 102.3 549.2 1.00
neqo msquic reno on 265.6 ± 7.7 255.4 277.7 1.00
neqo msquic reno 296.9 ± 56.0 257.7 431.9 1.00
neqo msquic cubic on 263.1 ± 7.5 254.8 280.7 1.00
neqo msquic cubic 288.4 ± 46.9 254.5 413.4 1.00
msquic neqo reno on 236.5 ± 93.7 158.5 369.3 1.00
msquic neqo reno 182.8 ± 87.4 111.4 360.3 1.00
msquic neqo cubic on 193.1 ± 106.0 135.6 539.3 1.00
msquic neqo cubic 175.2 ± 25.4 113.9 226.5 1.00
neqo neqo reno on 192.0 ± 18.6 166.4 238.0 1.00
neqo neqo reno 218.6 ± 74.6 167.3 384.0 1.00
neqo neqo cubic on 185.7 ± 19.7 168.0 245.7 1.00
neqo neqo cubic 200.4 ± 58.2 163.9 382.1 1.00

⬇️ Download logs

Merged via the queue into mozilla:main with commit b63e0ff Jul 31, 2024
53 of 56 checks passed
@larseggert larseggert deleted the chore-test-no-test branch July 31, 2024 08:35
Copy link

Firefox builds for this PR

The following builds are available for testing. Crossed-out builds did not succeed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants