Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multithread page generation #57

Open
linsyking opened this issue Nov 19, 2023 · 1 comment
Open

Multithread page generation #57

linsyking opened this issue Nov 19, 2023 · 1 comment

Comments

@linsyking
Copy link

Is it possible to generate pages by using multiple threads to speed up?

@dmbaturin
Copy link
Collaborator

Not yet, sadly. The main problem is that Lua-ML, the Lua interpreter that soupault uses, is not thread-safe, so it will need a global lock and whenever plugins are involved, worker threads will spend a lot of time waiting for their chance to run Lua code.

But maybe my idea is wrong and there are substantial gains from parallelizing the work that can be parallelized (such as loading page source files into element trees). I'll need to experiment with it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants