Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Disable taskcluster again #1949

Merged
merged 1 commit into from
Jul 2, 2024

Conversation

larseggert
Copy link
Collaborator

Until someone who understands it can debug. #1935 didn't fix it.

Until someone who understands it can debug. mozilla#1935 didn't fix it.
@larseggert larseggert enabled auto-merge July 2, 2024 07:12
@larseggert larseggert disabled auto-merge July 2, 2024 07:12
@larseggert larseggert merged commit a79d720 into mozilla:main Jul 2, 2024
18 checks passed
@larseggert larseggert deleted the ci-taskcluster-off branch July 2, 2024 07:12
Copy link

github-actions bot commented Jul 2, 2024

Failed Interop Tests

QUIC Interop Runner, client vs. server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

Copy link

github-actions bot commented Jul 2, 2024

Firefox builds for this PR

The following builds are available for testing. Crossed-out builds did not succeed.

Copy link

github-actions bot commented Jul 2, 2024

Benchmark results

Performance differences relative to ea54273.

coalesce_acked_from_zero 1+1 entries: 💔 Performance has regressed.
       time:   [195.78 ns 196.16 ns 196.58 ns]
       change: [+2.2006% +2.5783% +2.9923%] (p = 0.00 < 0.05)
Found 17 outliers among 100 measurements (17.00%)
  1 (1.00%) low mild
  7 (7.00%) high mild
  9 (9.00%) high severe
coalesce_acked_from_zero 3+1 entries: 💔 Performance has regressed.
       time:   [236.59 ns 237.11 ns 237.68 ns]
       change: [+1.6511% +2.1303% +2.6876%] (p = 0.00 < 0.05)
Found 16 outliers among 100 measurements (16.00%)
  3 (3.00%) low mild
  13 (13.00%) high severe
coalesce_acked_from_zero 10+1 entries: 💔 Performance has regressed.
       time:   [237.64 ns 238.61 ns 239.71 ns]
       change: [+1.3027% +1.8894% +2.4083%] (p = 0.00 < 0.05)
Found 9 outliers among 100 measurements (9.00%)
  9 (9.00%) high severe
coalesce_acked_from_zero 1000+1 entries: Change within noise threshold.
       time:   [217.69 ns 217.85 ns 218.04 ns]
       change: [+0.0343% +0.8527% +1.5343%] (p = 0.02 < 0.05)
Found 17 outliers among 100 measurements (17.00%)
  2 (2.00%) low mild
  15 (15.00%) high severe
RxStreamOrderer::inbound_frame(): No change in performance detected.
       time:   [117.99 ms 118.10 ms 118.21 ms]
       change: [-0.0961% +0.0245% +0.1493%] (p = 0.70 > 0.05)
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
transfer/Run multiple transfers with varying seeds: Change within noise threshold.
       time:   [123.41 ms 123.73 ms 124.04 ms]
       thrpt:  [32.247 MiB/s 32.328 MiB/s 32.412 MiB/s]
change:
       time:   [+2.8924% +3.2237% +3.5699%] (p = 0.00 < 0.05)
       thrpt:  [-3.4468% -3.1231% -2.8111%]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) low mild
transfer/Run multiple transfers with the same seed: Change within noise threshold.
       time:   [123.28 ms 123.45 ms 123.63 ms]
       thrpt:  [32.355 MiB/s 32.401 MiB/s 32.447 MiB/s]
change:
       time:   [+2.5142% +2.7464% +2.9681%] (p = 0.00 < 0.05)
       thrpt:  [-2.8825% -2.6730% -2.4526%]

1-conn/1-100mb-resp (aka. Download)/client
time: [1.1142 s 1.1442 s 1.1778 s]
thrpt: [84.908 MiB/s 87.395 MiB/s 89.752 MiB/s]
change:
time: [+1.3306% +5.1418% +8.9423%] (p = 0.02 < 0.05)
thrpt: [-8.2083% -4.8903% -1.3132%]
:broken_heart: Performance has regressed.

1-conn/10_000-parallel-1b-resp (aka. RPS)/client: No change in performance detected.
       time:   [388.78 ms 391.69 ms 394.62 ms]
       thrpt:  [25.341 Kelem/s 25.531 Kelem/s 25.722 Kelem/s]
change:
       time:   [-1.2862% -0.2363% +0.8481%] (p = 0.66 > 0.05)
       thrpt:  [-0.8410% +0.2369% +1.3030%]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
1-conn/1-1b-resp (aka. HPS)/client: Change within noise threshold.
       time:   [41.857 ms 41.962 ms 42.085 ms]
       thrpt:  [23.761  elem/s 23.831  elem/s 23.891  elem/s]
change:
       time:   [-1.6609% -1.1800% -0.7111%] (p = 0.00 < 0.05)
       thrpt:  [+0.7161% +1.1941% +1.6890%]
Found 29 outliers among 100 measurements (29.00%)
  13 (13.00%) low severe
  1 (1.00%) high mild
  15 (15.00%) high severe

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing Mean [ms] Min [ms] Max [ms] Relative
msquic msquic 133.5 ± 32.0 102.4 192.2 1.00
neqo msquic reno on 275.2 ± 11.4 259.5 289.9 1.00
neqo msquic reno 272.9 ± 25.1 251.2 338.5 1.00
neqo msquic cubic on 274.2 ± 13.6 247.7 290.0 1.00
neqo msquic cubic 275.7 ± 9.4 264.5 285.9 1.00
msquic neqo reno on 929.0 ± 12.6 901.0 943.0 1.00
msquic neqo reno 922.0 ± 12.7 908.4 937.7 1.00
msquic neqo cubic on 895.1 ± 10.8 883.7 920.5 1.00
msquic neqo cubic 889.7 ± 15.4 871.5 913.8 1.00
neqo neqo reno on 921.9 ± 15.6 896.7 946.4 1.00
neqo neqo reno 939.1 ± 54.2 903.5 1086.8 1.00
neqo neqo cubic on 897.8 ± 14.3 881.0 922.2 1.00
neqo neqo cubic 873.1 ± 12.4 859.5 892.6 1.00

⬇️ Download logs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant