Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: prepare embedder for Production #9517

Merged
merged 44 commits into from
Mar 29, 2024
Merged

feat: prepare embedder for Production #9517

merged 44 commits into from
Mar 29, 2024

Commits on Mar 7, 2024

  1. feat: support ad-hoc metadata inserts 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    d86eb2d View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. feat: triggers from metadata to queue 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    8628e3e View commit details
    Browse the repository at this point in the history

  2. feat: move job queue to pg 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    285f69b View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. begin retry

    @mattkrick
    mattkrick committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    0b024dd View commit details
    Browse the repository at this point in the history

  2. feat: support retries after queue goes dry 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    ae6126f View commit details
    Browse the repository at this point in the history

  3. chore: separate abstract models into their own files 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    9fb9c4f View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. feat: support recursive text splitting for chunks 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    20f5d96 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. validate discussions to only include ended meetings 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    eff8eb9 View commit details
    Browse the repository at this point in the history

  2. support historical info 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    7ec3d6a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into feat/embedder1

    @mattkrick
    mattkrick committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    49c3eae View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. feat: support listening to jobs from app 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    46dafac View commit details
    Browse the repository at this point in the history

  2. feat: support calls from app

    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    47e83d9 View commit details
    Browse the repository at this point in the history

  3. merge master

    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    7cee59e View commit details
    Browse the repository at this point in the history

  4. fix migration conflict

    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    5c96c41 View commit details
    Browse the repository at this point in the history

  5. fix: import history 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    49b349b View commit details
    Browse the repository at this point in the history

  6. fix: dataloader mem leak 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    bf9a379 View commit details
    Browse the repository at this point in the history

  7. feat: handle stalled jobs

    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    f7ccdc6 View commit details
    Browse the repository at this point in the history

  8. self-review 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    b573083 View commit details
    Browse the repository at this point in the history

  9. remove redlock for non-historical jobs 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    ba906e0 View commit details
    Browse the repository at this point in the history

  10. feat: clean comments 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    10953b5 View commit details
    Browse the repository at this point in the history

  11. remove pubsub 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    7953939 View commit details
    Browse the repository at this point in the history

  12. fix lint errors 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    c2b6753 View commit details
    Browse the repository at this point in the history

  13. fix lint 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    8852ac2 View commit details
    Browse the repository at this point in the history

  14. cast to any for CI 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    2ba07c1 View commit details
    Browse the repository at this point in the history

  15. build embeddings table in CI for the typings 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    7bcd083 View commit details
    Browse the repository at this point in the history

  16. codecheck after server starts 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    368b34c View commit details
    Browse the repository at this point in the history

  17. use pgvector in CI 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    1158523 View commit details
    Browse the repository at this point in the history

  18. POSTGRES_USE_PGVECTOR='true' 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    ddfc151 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2024

  1. lazy Kysely Codegen 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    07e0d12 View commit details
    Browse the repository at this point in the history

  2. fix: release-please and CI pgvector image bump 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    8360b95 View commit details
    Browse the repository at this point in the history

  3. chore: rename files for clarity 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 20, 2024
    Configuration menu
    Copy the full SHA
    e74754d View commit details
    Browse the repository at this point in the history

Commits on Mar 21, 2024

  1. rename yaml to yml 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    e7991d3 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. feat: support priority 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    ef1d8c4 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. feat: custom text splitter 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    59b0647 View commit details
    Browse the repository at this point in the history

  2. feat: add language to metadata table 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    3faa442 View commit details
    Browse the repository at this point in the history

  3. feat: support multiple workers 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    2ab9f61 View commit details
    Browse the repository at this point in the history

  4. feat: set workers via env var 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    7fc4136 View commit details
    Browse the repository at this point in the history

  5. fix: handle shutdown and stalled jobs 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    ea32be7 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. update readme for parabol-ubi 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    bc1cf74 View commit details
    Browse the repository at this point in the history

  2. remove unused trigger logic 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    7d82b28 View commit details
    Browse the repository at this point in the history

  3. turn on dev servers 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    b609f3e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into feat/embedder1

    @mattkrick
    mattkrick committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    8679d2c View commit details
    Browse the repository at this point in the history

  5. fix: rename migration 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    0c80dd6 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. Merge branch 'master' into feat/embedder1 

    Signed-off-by: Matt Krick <matt.krick@gmail.com>
    @mattkrick
    mattkrick committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    826a044 View commit details
    Browse the repository at this point in the history