Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

try using tests/benchmarks as PGO input #686

Closed
wants to merge 3 commits into from
Closed

try using tests/benchmarks as PGO input #686

wants to merge 3 commits into from

Conversation

davidhewitt
Copy link
Contributor

@codspeed-hq
Copy link

codspeed-hq bot commented Jun 22, 2023

CodSpeed Performance Report

Merging #686 dh/pgo-2 (bef03cb) will improve performances by 37.3%.

Summary

🔥 54 improvements
❌ 0 regressions
✅ 71 untouched benchmarks

🆕 0 new benchmarks
⁉️ 0 dropped benchmarks

Benchmarks breakdown

Benchmark main dh/pgo-2 Change
🔥 test_complete_core_lax 1.4 ms 1.2 ms +16.43%
🔥 test_complete_core_strict 1.4 ms 1.2 ms +16.67%
🔥 test_build_schema 4 ms 3.5 ms +15.66%
🔥 test_core_python_fs 347.9 µs 292.6 µs +18.88%
🔥 test_core_json_fs 855 µs 771.3 µs +10.85%
🔥 test_core_python 508.1 µs 450.3 µs +12.84%
🔥 test_small_class_core_dict 30.4 µs 26.7 µs +13.95%
🔥 test_small_class_core_model 55 µs 45.4 µs +21.21%
🔥 test_definition_model_core 2 ms 1.8 ms +10.99%
🔥 test_list_of_dict_models_core 508.1 µs 446.2 µs +13.88%
🔥 test_list_of_ints_core_py 2.6 ms 2.2 ms +16.52%
🔥 test_set_of_ints_core 3.8 ms 3.3 ms +15.53%
🔥 test_set_of_ints_core_duplicates 2.4 ms 1.8 ms +33.21%
🔥 test_set_of_ints_core_length 3.8 ms 3.3 ms +15.59%
🔥 test_set_of_ints_core_json_duplicates 5.4 ms 4.8 ms +12.53%
🔥 test_frozenset_of_ints_core 1.3 ms 1.1 ms +16.54%
🔥 test_frozenset_of_ints_duplicates_core 997.6 µs 808 µs +23.47%
🔥 test_dict_of_ints_core 6 ms 4.7 ms +25.83%
🔥 test_dict_of_any_core 4.2 ms 3.3 ms +25.59%
🔥 test_dict_of_ints_core_json 15.6 ms 13.5 ms +15.95%
🔥 test_many_models_core_dict 5.5 ms 4.9 ms +11.04%
🔥 test_many_models_core_model 14.7 ms 12.9 ms +13.96%
🔥 test_list_of_nullable_core 641.4 µs 540.4 µs +18.68%
🔥 test_core_python 46.5 µs 42.1 µs +10.46%
🔥 test_core_future_str 29.4 µs 26.5 µs +11.05%
🔥 test_core_future 29.4 µs 25.3 µs +16.1%
🔥 test_core_future_str 25.2 µs 22.2 µs +13.23%
🔥 test_positional_tuple 30.4 µs 27.5 µs +10.89%
🔥 test_variable_tuple 30.1 µs 26.2 µs +14.61%
🔥 test_tuple_many_variable 33 µs 28.7 µs +14.91%
🔥 test_arguments 44.2 µs 38.1 µs +16.03%
🔥 test_with_default 41 µs 36.2 µs +13.25%
🔥 test_generator_rust 30.7 µs 27.4 µs +11.88%
🔥 test_isinstance_json 29.5 µs 26.4 µs +11.9%
🔥 test_definition_in_tree 6 ms 4.6 ms +31.48%
🔥 test_definition_out_of_tree 9.9 ms 7.4 ms +32.82%
🔥 test_model_instance 54.4 µs 46.2 µs +17.78%
🔥 test_model_instance_abc 65.4 µs 56.2 µs +16.31%
🔥 test_validate_literal[python-few_str_enum] 23 µs 20.6 µs +11.57%
🔥 test_validate_literal[json-few_str_enum] 30 µs 27 µs +11.19%
🔥 test_validate_literal[json-few_mixed] 26.5 µs 24.1 µs +10.01%
🔥 test_core_root_model 114.6 µs 97.5 µs +17.46%
🔥 test_tagged_union_int_keys_python 33.7 µs 30.5 µs +10.46%
🔥 test_core_dict 287.3 µs 246.2 µs +16.7%
🔥 test_core_dict_filter 296.1 µs 256.2 µs +15.56%
🔥 test_core_json 395 µs 342.1 µs +15.47%
🔥 test_json_direct_list_str 929.2 µs 710.8 µs +30.72%
🔥 test_python_json_list_str 709.8 µs 580.4 µs +22.29%
🔥 test_json_any_list_str 1.6 ms 1.3 ms +27.34%
🔥 test_json_direct_list_int 904.7 µs 658.9 µs +37.3%
🔥 test_json_any_list_int 1.6 ms 1.3 ms +22.36%
🔥 test_python_json_list_int 706.4 µs 576.5 µs +22.54%
🔥 test_python_json_list_none 685.3 µs 556.3 µs +23.19%
🔥 test_model_list_core_json 968.7 µs 725.9 µs +33.45%

@davidhewitt davidhewitt added the Full Build cause CI to do a full build label Jun 22, 2023
@davidhewitt
Copy link
Contributor Author

This is now included in #678

@davidhewitt davidhewitt closed this Jul 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Full Build cause CI to do a full build
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant