Skip to content
This repository has been archived by the owner on Oct 24, 2024. It is now read-only.

i718 Add auxiliary worker to run different queues #723

Merged
merged 18 commits into from
Feb 23, 2024

Commits on Feb 9, 2024

  1. add auxiliary worker to run different queues

    Add a second worker that runs all GoodJob queues. The "base" worker will
    run all queues except the :auxiliary queue.
    
    This, combined with the high priority assigned to all jobs in the
    :auxiliary queue, effectively builds a fast lane; all jobs run in the
    :auxiliary queue will be executed before all other jobs by the auxiliary
    worker.
    
    The fact that the base worker does not run any jobs in the :auxiliary
    queue means we can have this fast lane without putting every other job
    on hold for, potentially, long periods of time.
    
    P.S. The reason we use `before_enqueue` in ApplicationJob is because
    GoodJob does not support setting a default priority per queue.
    bkiahstroud committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    c5b6999 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9cf9a7f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5988af2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e9cc816 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5f55100 View commit details
    Browse the repository at this point in the history
  6. set GOOD_JOB_QUEUES on each worker specifically

    This resolves the "duplicate name" warning when deploying. However, it
    may remove all other ENV vars from the base worker, so this change may
    not stick around
    bkiahstroud committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    f1e57ff View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4258d94 View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2024

  1. Configuration menu
    Copy the full SHA
    16e1bc3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    98cf7c1 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. explicitly duplicate extraEnvVars

    This is an attempt to resolve this helm upgrade error:
    > The order in patch list: ... doesn't match $setElementOrder list: ...
    bkiahstroud committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    4afc1df View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. Configuration menu
    Copy the full SHA
    f1aa344 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. Configuration menu
    Copy the full SHA
    e769ef2 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. use unique var for auxiliary worker

    Attempting to merge/override the same ENV variable in different
    deployments ended up being very difficult. This is perhaps less elegant,
    but simpler
    bkiahstroud committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    a1fb775 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d984f6d View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. use ENV variables to configure worker queues

    Attempting to use the --queues flag didn't work, but using the ENV
    variable does
    bkiahstroud committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    c8fbed6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9ffd497 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. Configuration menu
    Copy the full SHA
    c3e3028 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0d23406 View commit details
    Browse the repository at this point in the history