Fixes #31815 - Allow setting number of workers for content app #170
Conversation
Which should be? |
|
Now I had hoped you had an answer for that. We do see that |
|
Sounds reasonable to go with how we set this in other places, and then see how the tuning plays out. |
|
Is there any documentation on the difference between pulpcore workers and pulpcore content app workers? I'm not finding it readily I did find however some more notes about hardware requirements vs worker counts at https://docs.pulpproject.org/pulpcore/components.html#hardware-requirements We currently consider CPUs but not memory, which looks like it can also be a significant bottleneck. In particular for the RPM content plugin a single worker can consume several GBs of memory while syncing. In the future we should at least update the docs here to include this information. |
|
pulpcore workers are the background workers, content app workers are really gunicorn workers for the webserver piece of the content app. |
|
I wouldn't be surprised if at some point we also need to be able to tune the API workers. If you have more jobs and end up polling more, a single worker may not be able to handle it anymore. It would be good to add a parameter for that as well, even if we hardcode it to a single worker now. |
|
Related to what sparked this change I have a pulp-list thread started -- https://listman.redhat.com/archives/pulp-list/2021-February/msg00007.html |
|
Regarding the mentioned issue: we can't use the event worker on EL7's httpd. In theforeman/foreman-installer@0ed45f7 we reverted this. There's a bugzilla somewhere that's closed as WONTFIX so we either need to move to the httpd SCL or drop EL7 for that. |
|
Added an entry for the API service to adjust worker counts as well. |
| @@ -178,6 +186,8 @@ | |||
| Integer[0] $worker_count = min(8, $facts['processors']['count']), | |||
| Boolean $service_enable = true, | |||
| Boolean $service_ensure = true, | |||
| Integer[0] $content_service_worker_count = (2*min(8, $facts['processors']['count']) + 1), | |||
| Integer[0] $api_service_worker_count = 1, | |||
There was a problem hiding this comment.
Note to self: this matches the default according to https://docs.gunicorn.org/en/latest/settings.html#workers
No description provided.