Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recommend reducing runfiles tree creation #107

Open
ulfjack opened this issue Mar 24, 2023 · 2 comments
Open

Recommend reducing runfiles tree creation #107

ulfjack opened this issue Mar 24, 2023 · 2 comments
Labels
type/feat Suggests new features.

Comments

@ulfjack
Copy link
Member

ulfjack commented Mar 24, 2023

Problem

We have a build that is slow due to excessive local runfiles tree creation, while most actions are cached (or executed) remotely and do not need a runfiles tree. Enabling --nobuild_runfiles_links can reduce the time of such builds by a factor of 2 or more.

I attached before/after screenshots that show the effect of setting this flag. In this build, we still see an excessive amount of "acquiring semaphore" operations locally, but at least it is significantly faster.

Before

excessive-runfiles-before-2023-03-24

After

excessive-runfiles-after-2023-03-24

@ulfjack ulfjack added the type/feat Suggests new features. label Mar 24, 2023
@ulfjack
Copy link
Member Author

ulfjack commented Mar 24, 2023

Posting two internal invocation ids as a reminder if we need more details:

  • before: 03879072-f1e6-4770-a392-9dc0c5fc1173
  • after: 2a542e2b-cf26-4219-8a0d-a3feef010719

@ulfjack
Copy link
Member Author

ulfjack commented Mar 24, 2023

Also see bazelbuild/bazel#6627 for more details on runfiles trees.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/feat Suggests new features.
Projects
None yet
Development

No branches or pull requests

1 participant