Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test PGO on x86_64 ubuntu #21

Merged
merged 5 commits into from
Mar 9, 2024
Merged

Test PGO on x86_64 ubuntu #21

merged 5 commits into from
Mar 9, 2024

Conversation

MarshalX
Copy link
Owner

@MarshalX MarshalX commented Mar 2, 2024

TODO:

  • build pgo-optimized wheels in release.yml
  • remove tiny benchmarks?

Copy link

codspeed-hq bot commented Mar 2, 2024

CodSpeed Performance Report

Merging #21 will degrade performances by 25.35%

Comparing add-pgo (9e94ce8) with main (9bef349)

Summary

⚡ 94 improvements
❌ 5 (👁 5) regressions
✅ 93 untouched benchmarks

Benchmarks breakdown

Benchmark main add-pgo Change
test_dag_cbor_decode[roundtrip03.json] 33.1 µs 25.7 µs +28.81%
test_dag_cbor_decode[roundtrip04.json] 33.7 µs 27.3 µs +23.22%
test_dag_cbor_decode[roundtrip07.json] 31.4 µs 22.7 µs +38.46%
👁 test_dag_cbor_decode[roundtrip08.json] 26.8 µs 34 µs -21.25%
test_dag_cbor_decode[roundtrip09.json] 42.3 µs 33.1 µs +27.65%
👁 test_dag_cbor_decode[roundtrip11.json] 26.2 µs 34.9 µs -24.87%
test_dag_cbor_decode[roundtrip12.json] 36.1 µs 28.7 µs +25.63%
test_dag_cbor_decode[roundtrip15.json] 33.7 µs 24.9 µs +35.18%
test_dag_cbor_decode[roundtrip18.json] 38 µs 27.5 µs +38.36%
test_dag_cbor_decode[roundtrip21.json] 36.2 µs 26.8 µs +34.97%
test_dag_cbor_decode[roundtrip25.json] 36.1 µs 27.2 µs +32.72%
test_dag_cbor_decode[roundtrip26.json] 34.3 µs 25.8 µs +33.31%
test_dag_cbor_decode_fixtures[array-255] 29.4 µs 26.3 µs +11.72%
test_dag_cbor_decode_fixtures[array-2] 29.3 µs 26.2 µs +11.63%
test_dag_cbor_decode_fixtures[array-5-nested] 55.3 µs 47.3 µs +16.93%
test_dag_cbor_decode_fixtures[array-500] 31.5 µs 28.6 µs +10.15%
test_dag_cbor_decode_fixtures[array-65536] 31.5 µs 28.7 µs +10.04%
test_dag_cbor_decode_fixtures[array-9007199254740991] 31.5 µs 28.3 µs +11.15%
test_dag_cbor_decode_fixtures[array-empty] 27 µs 24.1 µs +12.07%
test_dag_cbor_decode_fixtures[array-mixed] 56.4 µs 50 µs +12.87%
... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

@MarshalX
Copy link
Owner Author

MarshalX commented Mar 2, 2024

Real data decoding:
image

Real data encoding:
image

  • decode_car +15%
  • decode_torture_cids +17%

@MarshalX MarshalX merged commit de9738c into main Mar 9, 2024
18 checks passed
@MarshalX MarshalX deleted the add-pgo branch March 9, 2024 18:14
@MarshalX
Copy link
Owner Author

MarshalX commented Mar 9, 2024

Release wheels with PGO for many platforms were added in #30

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant