Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MNIST url update #8752

Open
rmchurch opened this issue Nov 26, 2024 · 1 comment
Open

MNIST url update #8752

rmchurch opened this issue Nov 26, 2024 · 1 comment

Comments

@rmchurch
Copy link

🐛 Describe the bug

MNIST no longer downloading from LeCun website, according to him should update URL to HuggingFace
https://x.com/ylecun/status/1861178764996079752?t=i9U_SMktZgFKXGIAUbif4g&s=19

Versions

Any

@NicolasHug
Copy link
Member

Thanks for the heads up @rmchurch .

Unfortunately torchvision cannot take a dependency on HF, and MNIST on HF is stored as a parquet file, which isn't something we can natively read (at least not with the current code-base). So I'm afraid it'll be tricky to directly integrate this new recommended URL within the existing code.

If we can download such files without depending on HF (or require an account) and if we can read the .parquet files without adding a new dep to torchvision, then I think we should be able to go ahead with the new URL.

If you know of an official mirror that could just be plug-and-play with the current ones, please do let me know!

mirrors = [
"http://yann.lecun.com/exdb/mnist/",
"https://ossci-datasets.s3.amazonaws.com/mnist/",
]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants