You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
These are called for every compiler that will be built with. There might be a way to request the information for all compilers at once and then only do the lookup per compiler.
I'm thinking that Conan is meant to lift these concerns out from us. Maybe it's time to implement a more standard Conan workflow to build all libraries? I think the end result could be super cool :)
I'm thinking that Conan is meant to lift these concerns out from us. Maybe it's time to implement a more standard Conan workflow to build all libraries? I think the end result could be super cool :)
I invite you to try, but I can pretty much promise you you'll be wasting your time. I have tried all kinds of standard things, they just don't work for the library builder.
Now that the Cloudfront caching in front of the Conan server is disabled, we need to figure out a way to manually optimize the process.
A large IO bottleneck is the checks that we do to prevent from building the same thing over and over again:
has_failed_before
https://github.com/compiler-explorer/infra/blob/main/bin/lib/library_builder.py#L783is_already_uploaded
https://github.com/compiler-explorer/infra/blob/main/bin/lib/library_builder.py#L796get_build_annotations
https://github.com/compiler-explorer/infra/blob/main/bin/lib/library_builder.py#L752 is part of thisThese are called for every compiler that will be built with. There might be a way to request the information for all compilers at once and then only do the lookup per compiler.
Related endpoint: https://github.com/compiler-explorer/conanproxy/blob/main/index.js#L454
Lesser influence, but still IO:
get_commit_hash
infra/bin/lib/library_builder.py
Line 769 in 8564738
The text was updated successfully, but these errors were encountered: