Code

feat: Implement storage job limiter#2123

Code

Merged

Matovidlo merged 27 commits intomainkeboola/keboola-as-code:mainfrom mv-PSGO-783-implement-storage-job-rate-limiterkeboola/keboola-as-code:mv-PSGO-783-implement-storage-job-rate-limiterCopy head branch name to clipboardNov 20, 2024

+3,094-67

Commits

Commits on Nov 11, 2024

• fix: Add correct datadog tag env. New teardown and setup timeouts

  Matovidlo

  committed
  8bf131a

• feat: Add configuration options for job and sink limit

  Matovidlo

  committed
  1db958c

• feat: Add new plugin for sink delete

  Show description for 0f04f52
  Matovidlo

  committed
  0f04f52

• feat: Add support for storage job repository

  Matovidlo

  committed
  31f143e

• feat: Add support for keboola storage job

  Matovidlo

  committed
  ad8eb9b

• feat: Add support for deleting newly created jobs entities

  Show description for e2759c8
  Matovidlo

  committed
  e2759c8

• feat: Add new condition and mirroring of jobs

  Show description for 658dad9
  Matovidlo

  committed
  658dad9

• feat: Start metadata cleanup to unthrottle the sink

  Show description for 284d3d8
  Matovidlo

  committed
  284d3d8

• fix: Remove sink repository, as it is not needed and present in deps

  Matovidlo

  committed
  38959a4

• fix: Linter gci

  Matovidlo

  committed
  c009b9b

• fix: Add missing attribute in keboolafile

  Matovidlo

  committed
  2703814

Commits on Nov 12, 2024

• fix: Add new context attributes instead of logging whole object

  Matovidlo

  committed
  9fd9a6b

• fix: Comment was copied from keboolasink

  Matovidlo

  committed
  b72a0f7

• fix: Remove active prefix from job schema

  Matovidlo

  committed
  1fc049a

• fix: Change sinkLimit -> jobLimit

  Matovidlo

  committed
  8b406cd

• fix: Add ListAll test, fix lint and config test

  Matovidlo

  committed
  bacd1f0

Commits on Nov 18, 2024

• feat: Move job repository under keboola bridge

  Show description for 6116042
  Matovidlo

  committed
  6116042

• fix: Make configurable keboola bridge mirroring using exported function

  Show description for 798bada
  Matovidlo

  committed
  798bada

• fix: Linter issue

  Matovidlo

  committed
  d3a711d

Commits on Nov 19, 2024

• fix: Typo in comment

  Matovidlo

  committed
  defdd2c

• fix: Use context from Start of coordinator in bridge

  Show description for 6cd186a
  Matovidlo

  committed
  6cd186a

• fix: Change naming and move throttle under file package in plugin

  Matovidlo

  committed
  0ef0afe

• fix: Add smaller interval to metadata cleanup so the jobs are cleared frequently

  Matovidlo

  committed
  da8707a

• feat: Remove token from job and use exported function on top of bridge

  Show description for 41c0053
  Matovidlo

  committed
  41c0053

• fix: Change default behaviour of CanAcceptNewFile. Returns by default true

  Matovidlo

  committed
  a376096

Commits on Nov 20, 2024

• fix: Move cleanup of job under bridge module

  Show description for 0412bce
  Matovidlo

  committed
  0412bce

• fix: Race condition on span with defer in errgrp

  Matovidlo

  committed
  665e97a