Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Use jdupes to deduplicate build #1103

Merged
merged 1 commit into from
Sep 3, 2024

Conversation

michael-wisely-gravwell
Copy link
Contributor

@michael-wisely-gravwell michael-wisely-gravwell commented Sep 3, 2024

This PR addresses no issue.

A full wiki build includes multiple versions of the Gravwell docs. Each version is different, but much of the content is the same.

This PR proposes using jdupes to find duplicate files and replace them with soft links. By replacing copies with links, this PR aims to reduce the size of builds.

Because we tar the build before GitHub Actions zips it, all of the softlinks remain intact.

The workflow changes won't be available until this PR is merged to main. Until then, one can see the proposed workflow run on my fork: https://github.com/michael-wisely-gravwell/wiki/actions/runs/10690709826/job/29635873170

Note that the built artifact is 201 MB with de-duplication compared to 2.01 GB without it.

@michael-wisely-gravwell michael-wisely-gravwell changed the title Use jdupes to deduplicate build ci: Use jdupes to deduplicate build Sep 3, 2024
Copy link
Collaborator

@ashnwade ashnwade left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

YESSSSS! This is great! 🎉

@ashnwade ashnwade merged commit 9100555 into gravwell:main Sep 3, 2024
@michael-wisely-gravwell michael-wisely-gravwell deleted the dedup-build-files branch September 3, 2024 21:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants