Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "ci: Trigger secondary checks off check.yml (#1984)" #1987

Merged
merged 1 commit into from
Jul 16, 2024

Conversation

larseggert
Copy link
Collaborator

@larseggert larseggert commented Jul 16, 2024

This reverts commit 735be28.

Maybe #1985 or #1986 pan out.

@larseggert larseggert merged commit e05cc70 into mozilla:main Jul 16, 2024
20 checks passed
@larseggert larseggert deleted the ci-fix branch July 16, 2024 16:50
Copy link

Failed Interop Tests

QUIC Interop Runner, client vs. server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

Copy link

Benchmark results

Performance differences relative to e05cc70.

coalesce_acked_from_zero 1+1 entries: No change in performance detected.
       time:   [189.74 ns 190.25 ns 190.80 ns]
       change: [-0.3928% +0.0952% +0.5842%] (p = 0.71 > 0.05)

Found 14 outliers among 100 measurements (14.00%)
2 (2.00%) low mild
6 (6.00%) high mild
6 (6.00%) high severe

coalesce_acked_from_zero 3+1 entries: No change in performance detected.
       time:   [229.72 ns 230.29 ns 230.90 ns]
       change: [-0.9146% -0.4325% +0.0124%] (p = 0.07 > 0.05)

Found 17 outliers among 100 measurements (17.00%)
3 (3.00%) low mild
3 (3.00%) high mild
11 (11.00%) high severe

coalesce_acked_from_zero 10+1 entries: No change in performance detected.
       time:   [230.57 ns 231.53 ns 232.61 ns]
       change: [-1.7825% -0.7348% +0.1070%] (p = 0.13 > 0.05)

Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) high mild
8 (8.00%) high severe

coalesce_acked_from_zero 1000+1 entries: Change within noise threshold.
       time:   [212.65 ns 212.83 ns 213.05 ns]
       change: [+0.3976% +0.9539% +1.4818%] (p = 0.00 < 0.05)

Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe

RxStreamOrderer::inbound_frame(): Change within noise threshold.
       time:   [118.72 ms 118.81 ms 118.89 ms]
       change: [+0.0800% +0.1789% +0.2864%] (p = 0.00 < 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild

transfer/Run multiple transfers with varying seeds: No change in performance detected.
       time:   [50.390 ms 53.380 ms 56.385 ms]
       thrpt:  [70.941 MiB/s 74.934 MiB/s 79.380 MiB/s]
change:
       time:   [-12.179% -4.7696% +2.9196%] (p = 0.23 > 0.05)
       thrpt:  [-2.8368% +5.0085% +13.868%]

Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild

transfer/Run multiple transfers with the same seed: No change in performance detected.
       time:   [63.873 ms 70.458 ms 77.046 ms]
       thrpt:  [51.917 MiB/s 56.771 MiB/s 62.625 MiB/s]
change:
       time:   [-19.371% -7.9806% +4.8360%] (p = 0.20 > 0.05)
       thrpt:  [-4.6129% +8.6728% +24.025%]
1-conn/1-100mb-resp (aka. Download)/client: No change in performance detected.
       time:   [277.29 ms 282.48 ms 287.75 ms]
       thrpt:  [347.52 MiB/s 354.01 MiB/s 360.64 MiB/s]
change:
       time:   [-2.6869% -0.3974% +2.0007%] (p = 0.76 > 0.05)
       thrpt:  [-1.9615% +0.3990% +2.7611%]
1-conn/10_000-parallel-1b-resp (aka. RPS)/client: No change in performance detected.
       time:   [447.23 ms 450.20 ms 453.15 ms]
       thrpt:  [22.068 Kelem/s 22.212 Kelem/s 22.360 Kelem/s]
change:
       time:   [-1.0331% -0.0808% +0.9467%] (p = 0.87 > 0.05)
       thrpt:  [-0.9379% +0.0808% +1.0439%]
1-conn/1-1b-resp (aka. HPS)/client: No change in performance detected.
       time:   [68.635 ms 68.997 ms 69.407 ms]
       thrpt:  [14.408  elem/s 14.493  elem/s 14.570  elem/s]
change:
       time:   [-0.7899% +0.0184% +0.7813%] (p = 0.96 > 0.05)
       thrpt:  [-0.7752% -0.0184% +0.7962%]

Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) high mild
8 (8.00%) high severe

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing Mean [ms] Min [ms] Max [ms] Relative
msquic msquic 128.2 ± 36.2 101.7 214.1 1.00
neqo msquic reno on 265.8 ± 9.1 252.6 280.9 1.00
neqo msquic reno 267.8 ± 9.8 255.2 285.6 1.00
neqo msquic cubic on 264.6 ± 9.2 255.8 284.8 1.00
neqo msquic cubic 265.2 ± 10.3 251.5 283.4 1.00
msquic neqo reno on 157.6 ± 19.7 92.9 181.4 1.00
msquic neqo reno 148.8 ± 25.5 110.7 212.7 1.00
msquic neqo cubic on 152.2 ± 11.0 141.2 174.2 1.00
msquic neqo cubic 175.1 ± 32.4 111.8 209.8 1.00
neqo neqo reno on 304.5 ± 130.7 175.9 534.0 1.00
neqo neqo reno 179.1 ± 16.8 148.2 200.5 1.00
neqo neqo cubic on 189.9 ± 26.3 151.4 236.2 1.00
neqo neqo cubic 175.1 ± 10.8 159.0 198.5 1.00

⬇️ Download logs

Copy link

Firefox builds for this PR

The following builds are available for testing. Crossed-out builds did not succeed.

larseggert added a commit to larseggert/neqo that referenced this pull request Jul 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant