This repository has been archived by the owner on Oct 24, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 0
i718 Add auxiliary worker to run different queues #723
Merged
bkiahstroud
merged 18 commits into
main
from
i718-separate-fast-lane-import-queue-and-worker
Feb 23, 2024
Merged
i718 Add auxiliary worker to run different queues #723
bkiahstroud
merged 18 commits into
main
from
i718-separate-fast-lane-import-queue-and-worker
Feb 23, 2024
Commits on Feb 9, 2024
-
add auxiliary worker to run different queues
Add a second worker that runs all GoodJob queues. The "base" worker will run all queues except the :auxiliary queue. This, combined with the high priority assigned to all jobs in the :auxiliary queue, effectively builds a fast lane; all jobs run in the :auxiliary queue will be executed before all other jobs by the auxiliary worker. The fact that the base worker does not run any jobs in the :auxiliary queue means we can have this fast lane without putting every other job on hold for, potentially, long periods of time. P.S. The reason we use `before_enqueue` in ApplicationJob is because GoodJob does not support setting a default priority per queue.
Configuration menu - View commit details
-
Copy full SHA for c5b6999 - Browse repository at this point
Copy the full SHA c5b6999View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9cf9a7f - Browse repository at this point
Copy the full SHA 9cf9a7fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5988af2 - Browse repository at this point
Copy the full SHA 5988af2View commit details -
Configuration menu - View commit details
-
Copy full SHA for e9cc816 - Browse repository at this point
Copy the full SHA e9cc816View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5f55100 - Browse repository at this point
Copy the full SHA 5f55100View commit details -
set GOOD_JOB_QUEUES on each worker specifically
This resolves the "duplicate name" warning when deploying. However, it may remove all other ENV vars from the base worker, so this change may not stick around
Configuration menu - View commit details
-
Copy full SHA for f1e57ff - Browse repository at this point
Copy the full SHA f1e57ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4258d94 - Browse repository at this point
Copy the full SHA 4258d94View commit details
Commits on Feb 10, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 16e1bc3 - Browse repository at this point
Copy the full SHA 16e1bc3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 98cf7c1 - Browse repository at this point
Copy the full SHA 98cf7c1View commit details
Commits on Feb 12, 2024
-
explicitly duplicate extraEnvVars
This is an attempt to resolve this helm upgrade error: > The order in patch list: ... doesn't match $setElementOrder list: ...
Configuration menu - View commit details
-
Copy full SHA for 4afc1df - Browse repository at this point
Copy the full SHA 4afc1dfView commit details
Commits on Feb 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f1aa344 - Browse repository at this point
Copy the full SHA f1aa344View commit details
Commits on Feb 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e769ef2 - Browse repository at this point
Copy the full SHA e769ef2View commit details
Commits on Feb 20, 2024
-
use unique var for auxiliary worker
Attempting to merge/override the same ENV variable in different deployments ended up being very difficult. This is perhaps less elegant, but simpler
Configuration menu - View commit details
-
Copy full SHA for a1fb775 - Browse repository at this point
Copy the full SHA a1fb775View commit details -
Configuration menu - View commit details
-
Copy full SHA for d984f6d - Browse repository at this point
Copy the full SHA d984f6dView commit details
Commits on Feb 21, 2024
-
use ENV variables to configure worker queues
Attempting to use the --queues flag didn't work, but using the ENV variable does
Configuration menu - View commit details
-
Copy full SHA for c8fbed6 - Browse repository at this point
Copy the full SHA c8fbed6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9ffd497 - Browse repository at this point
Copy the full SHA 9ffd497View commit details
Commits on Feb 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c3e3028 - Browse repository at this point
Copy the full SHA c3e3028View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d23406 - Browse repository at this point
Copy the full SHA 0d23406View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.