Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async and parallel processing #69

Open
frankiedrake opened this issue Apr 28, 2022 · 0 comments
Open

Async and parallel processing #69

frankiedrake opened this issue Apr 28, 2022 · 0 comments

Comments

@frankiedrake
Copy link

First, sorry if this question is addressed here wrong, but I should try.
The original question was asked here, I described the problem in detail.
In general: I have an application where some audios are being processed. There's function that embeds audio file which internally calls preprocess_wav function.
When processing requests synchronously (using flask), everything is working fine, but in async-way processing (via rabbitmq using amqp-storm), my gunicorn workers are sometimes being restarted. Adding a debug points show that it breaks at the preprocess_wav call and more precisely at trim_long_silences call.
What I've noticed is that there isn't high CPU or memory usage (logged it with psutil), also this even happens with the only one worker, so this tells me that probably this is not a resource usage issue but probably some blocking operations.
Could you suggest me what can I do to solve this or which way I get the details on why this actually happen?
Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant