Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BitTorrent directory loader download caching #4

Open
mwatts15 opened this issue Jul 27, 2019 · 0 comments
Open

BitTorrent directory loader download caching #4

mwatts15 opened this issue Jul 27, 2019 · 0 comments

Comments

@mwatts15
Copy link
Contributor

Directory loaders are given a directory where their downloaded files should be stored and this directory is returned to the loader each time we attempt a directory load. Although we have logic to check whether a given data source's directory has already been loaded irrespective of the loader that loaded it, it is possible for multiple data sources to share the same directory and the BitTorrent loader should find these cases naturally since it uses content-based identifiers for torrents. When two data sources with the same files associated are downloaded in succession, the loader should recognize this and not attempt to re-download something it already has.

@mwatts15 mwatts15 transferred this issue from openworm/owmeta Feb 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant