Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel execution of uptodate-properties #201

Merged
merged 1 commit into from
Apr 3, 2024

Conversation

mkarg
Copy link
Contributor

@mkarg mkarg commented Mar 22, 2024

As File::exists, just like obtaining a file's modification date, both are potentially blocking operations, huge file sets can slow down the uptodate-property and uptodate-properties Mojos.

A potential solution is to use several threads, so while the first thread is still blocked, another thread can take over the next uptodate-check. With multi-core CPUs being ubiquitous these days, such a rather small change can improve the build time considerably, in particular for huge projects with thousands of files and / or slows disks (like typically on NTFS). For single-core CPUs the drawback is neglectable.

@mkarg
Copy link
Contributor Author

mkarg commented Mar 22, 2024

@slachiewicz @slawekjaranowski @khmarbaise Kindly requesting your review. :-)

@slawekjaranowski slawekjaranowski merged commit 3185dbb into mojohaus:master Apr 3, 2024
19 checks passed
@mkarg mkarg deleted the parallel-uptodate branch April 3, 2024 17:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants