Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug: artifact files are sometimes not present in the path manifest generated #171

Open
TillaTheHun0 opened this issue Mar 26, 2024 · 0 comments
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@TillaTheHun0
Copy link
Member

TillaTheHun0 commented Mar 26, 2024

I am seeing CI retrying a lot of gateway operations, via the ArDrive CLI, due to gateway timeouts. I suspect some of those retries may be asynchronous and so a file either isn't uploaded yet or isn't indexed by the gateway by the time the path manifest is generated using the folder id.

I've seen ArDrive delays on files being "in" folders, which matters because the path manifest is generated using the folder id. So long term, I think we want a more robust check ensuring all files are "in" the folder, prior to generating the manifest; right now, the check only ensure there are >0 files in the folder.

We could probably add an explicit count here, based on count of local artifacts uploaded or maybe using jq to parse the previous command stdout and count the files created. Either way, this line is where we would check the count is what we expect.

Current workaround is to simply run the CI again, as the issue with missing files seems intermittent, more reason to suspect that gateway indexing delays, or bundler delays, may be the root cause.

@TillaTheHun0 TillaTheHun0 added bug Something isn't working help wanted Extra attention is needed labels Mar 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
Status: Todo
Development

No branches or pull requests

1 participant