Replies: 1 comment
-
If you got any, let me know 😁 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Does anyone know of any good discord servers for general Python chat? Or any alternatives? I just made a major breakthrough in my current project and have no one to share it with. lol
I am working with multiprocessing in Python and I implemented a workflow to find all lemmas in the wiktextract file ( for English Wiktionary data, about a 3GB data file.) My single process method that reads one line at a time took 15 seconds to examine about 1.4 Million lines, , and my multiprocessing code using a memory mapped file and all 12 cores on my laptop can do it in about 3 seconds. I know that the author of this project deals with much larger data and computing power, but I'm just very excited to figure out how to get a 5x speedup for my little project and wanted to share it with someone.
:)
Thanks!
-Rob
Beta Was this translation helpful? Give feedback.
All reactions