Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pycp is slow #20

Closed
dmerejkowsky opened this issue Oct 30, 2017 · 3 comments
Closed

pycp is slow #20

dmerejkowsky opened this issue Oct 30, 2017 · 3 comments

Comments

@dmerejkowsky
Copy link
Collaborator

dmerejkowsky commented Oct 30, 2017

version 8 is slower than 7, which is slower than cp, and not by a small margin.

Ideas:

  • Optimize usage of python-cli-ui
  • Use 2 processes, one for the disk I/O, and an other one for the output
  • Throttle console output
  • Use async stuff ?
  • Rewrite in an other language. Rust ? Javascript ?

But first we need to do some serious benchmarking ...

This was referenced Oct 30, 2017
@dmerejkowsky
Copy link
Collaborator Author

#22 contains the first two ideas.

I'm more or less convinced using async stuff wo't help.

Let's keep the 'rewrite in rust' idea for later

@dmerejkowsky
Copy link
Collaborator Author

Implementing output throttle now makes pycp 8 faster than pycp 7

Let's say we're done now :)

@dmerejkowsky
Copy link
Collaborator Author

I'm wondering if throttling the output is enough, but it was fun playing with multiple processes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant