-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement new cached metadata system #39
Comments
I just tested out Gos3, so dropping my results.
I will keep using AWS, but it would be so nice to have broader S3 compatibility. |
this also now happens at the demo instance https://gose.0l.de ... (@stv0g) |
Thanks for the input. I am currently running a bit low on resources since I am occupied with my other projects. But contributions in the direction of a new metadata system are very welcome :) |
We currently use S3 object tags to store some metadata information about each upload.
This works well for most use-cases, however has the disadvantage that the object tags are not easily modifiable.
Or flat out not supported by some cloud hosters (Wasabi).
Some planned features require that we can modify upload metadata (#10, #11).
Hence, I've thought about moving the metadata to a dedicated S3 object.
There is still the disadvantage, that S3 does not really support atomic operations on objects so we still have a hard time tracking download numbers (e.g. any sort of counter). But I already have an idea of implementing some sort of local or distributed (Redis) caching layer in front of those metadata objects which could solve this.
The text was updated successfully, but these errors were encountered: