Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

skipped due to duplication #48

Open
Felix-liu0989 opened this issue Feb 9, 2024 · 0 comments
Open

skipped due to duplication #48

Felix-liu0989 opened this issue Feb 9, 2024 · 0 comments

Comments

@Felix-liu0989
Copy link

Felix-liu0989 commented Feb 9, 2024

[...]

WARNING: file pg992.txt.utf8 skipped due to duplication

WARNING: file pg993.txt.utf8 skipped due to duplication

WARNING: file pg9931.txt.utf8 skipped due to duplication

WARNING: file pg9938.txt.utf8 skipped due to duplication

WARNING: file pg994.txt.utf8 skipped due to duplication

WARNING: file pg9959.txt.utf8 skipped due to duplication

WARNING: file pg996.txt.utf8 skipped due to duplication

WARNING: file pg9960.txt.utf8 skipped due to duplication

WARNING: file pg997.txt.utf8 skipped due to duplication

WARNING: file pg9970.txt.utf8 skipped due to duplication

WARNING: file pg9974.txt.utf8 skipped due to duplication

WARNING: file pg998.txt.utf8 skipped due to duplication

WARNING: file pg999.txt.utf8 skipped due to duplication

WARNING: file pg9998.txt.utf8 skipped due to duplication

All pg files have warning issues. Are these warnings caused by files appearing in dups_list being skipped and not copied to the raw_dir directory? How can I deal with this problem and successfully download all files?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant