Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace usage of pickle in fetchrss.py #1

Open
josharrington opened this issue Apr 26, 2014 · 0 comments
Open

Replace usage of pickle in fetchrss.py #1

josharrington opened this issue Apr 26, 2014 · 0 comments

Comments

@josharrington
Copy link
Owner

Pickle is a great way to quickly store data for later use. However, it can get slow after a long time.

I created a list with 10M random torrent links and saved it with pickle. Loading, adding a new item, and dumping with pickle takes about 1.5 minutes on my machine. It also created a pickle file that is 690MB which means it will take up at least that much memory.

Would using sqlite be a faster way of handing torrent history? Would it use less memory?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant