Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ignore temporary files for directory size #28265

Merged
merged 2 commits into from
Nov 28, 2023

Conversation

earl-warren
Copy link
Contributor

  • While looking trough the logs for unrelated things I noticed errors for directory size calculations in pushUpdates that were being caused by a race condition in which git was making temporary file, filepath.WalkDir noticed that but by the time the second lstat came(info.Info()) it was already gone and it would error.
  • Ignore temporary files created by Git.
  • There are other cases but much much more rarer and not trivial to detect.

Examples:

...s/repository/push.go:96:pushUpdates() [E] Failed to update size for repository: updateSize: lstat [...]/objects/info/commit-graphs/tmp_graph_Wcy9kR: no such file or directory
...s/repository/push.go:96:pushUpdates() [E] Failed to update size for repository: updateSize: lstat [...]/packed-refs.lock: no such file or directory

Refs: https://codeberg.org/forgejo/forgejo/pulls/1748

(cherry picked from commit c3aebcf16a7181192432730b827e369728196968)

- While looking trough the logs for unrelated things I noticed errors
for directory size calculations in `pushUpdates` that were being caused
by a race condition in which git was making temporary file,
`filepath.WalkDir` noticed that but by the time the second lstat
came(`info.Info()`) it was already gone and it would error.
- Ignore temporary files created by Git.
- There are other cases but much much more rarer and not trivial to detect.

Examples:

...s/repository/push.go:96:pushUpdates() [E] Failed to update size for repository: updateSize: lstat [...]/objects/info/commit-graphs/tmp_graph_Wcy9kR: no such file or directory
...s/repository/push.go:96:pushUpdates() [E] Failed to update size for repository: updateSize: lstat [...]/packed-refs.lock: no such file or directory

Refs: https://codeberg.org/forgejo/forgejo/pulls/1748

(cherry picked from commit c3aebcf16a7181192432730b827e369728196968)
@GiteaBot GiteaBot added the lgtm/need 2 This PR needs two approvals by maintainers to be considered for merging. label Nov 28, 2023
@pull-request-size pull-request-size bot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Nov 28, 2023
@GiteaBot GiteaBot added lgtm/need 1 This PR needs approval from one additional maintainer to be merged. and removed lgtm/need 2 This PR needs two approvals by maintainers to be considered for merging. labels Nov 28, 2023
@GiteaBot GiteaBot added lgtm/done This PR has enough approvals to get merged. There are no important open reservations anymore. and removed lgtm/need 1 This PR needs approval from one additional maintainer to be merged. labels Nov 28, 2023
@jolheiser jolheiser enabled auto-merge (squash) November 28, 2023 21:20
@jolheiser jolheiser added the reviewed/wait-merge This pull request is part of the merge queue. It will be merged soon. label Nov 28, 2023
@jolheiser jolheiser merged commit cb8298b into go-gitea:main Nov 28, 2023
25 checks passed
@GiteaBot GiteaBot added this to the 1.22.0 milestone Nov 28, 2023
@GiteaBot GiteaBot removed the reviewed/wait-merge This pull request is part of the merge queue. It will be merged soon. label Nov 28, 2023
@wxiaoguang
Copy link
Contributor

This fix is not right.

@wxiaoguang
Copy link
Contributor

-> Ignore "non-existing" errors when getDirectorySize calculates the size #28276

zjjhot added a commit to zjjhot/gitea that referenced this pull request Nov 29, 2023
* giteaofficial/main:
  Fix required error for token name (go-gitea#28267)
  Use appSubUrl for OAuth2 callback URL tip (go-gitea#28266)
  Ignore temporary files for directory size (go-gitea#28265)
  Check for v prefix on tags for release clean name (go-gitea#28257)
fuxiaohei pushed a commit to fuxiaohei/gitea that referenced this pull request Jan 17, 2024
Co-authored-by: Gusted <postmaster@gusted.xyz>
silverwind pushed a commit to silverwind/gitea that referenced this pull request Feb 20, 2024
Co-authored-by: Gusted <postmaster@gusted.xyz>
@go-gitea go-gitea locked as resolved and limited conversation to collaborators Feb 26, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
lgtm/done This PR has enough approvals to get merged. There are no important open reservations anymore. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants