Skip to content
This repository has been archived by the owner on Jan 11, 2024. It is now read-only.

[DATA-7040] DataHub upgrade to 0.10.4 #9

Merged
merged 124 commits into from
Jul 6, 2023
Merged

[DATA-7040] DataHub upgrade to 0.10.4 #9

merged 124 commits into from
Jul 6, 2023

Conversation

sb-sebkim
Copy link

gabe-lyons and others added 30 commits June 30, 2022 10:06
* feat(helm): add pod annotations to jobs

* feat(helm): add pod annotation to cron jobs.

* docs(helm): Add podAnnotation documentation and default values.

* feat(helm) chart version bump.
* <feat>(datahub-frontend): Allow lifecycle hooks

This PR adds a lifecycle node to the datahub-frontend deployment template.
It can be used to execute lifecycle hooks, e.g. postStart actions, like
replacing the default user.props file.

* Bump chart version to 0.2.86

Co-authored-by: Pedro Silva <pedro.cls93@gmail.com>
* <feat>(datahub-upgrade): Restore Indices Resources

This PR adds the ability for end-users to specify resource requests and limits
for the datahub upgrade job 'restore indices'. This is needed for situations
where the restore indices job will OOM due to a large backfill of data. I've
seen this happening with our deployment of datahub and am unable to tune
the resources for the restore indices job because the current requests
and limits are hard-coded.
* fix(gms): remove unused JMX sidecar
in favour of the already included JVM agent

* Update Chart.yaml

* Update Chart.yaml
…es needed in ingestion recipes (acryldata#169)

* Mount a customer defined k8s secret for ssl secrets needed in ingestion recipes

* Bump chart versions

* Address comment

* Update readme

* Address Pedro's comment
…ryldata#170)

* Add kafka-exporter to expose prometheus metrics for kafka cluster

* Kafka-exporter: Updated values.yaml to support tls/sasl authentication while connecting kafka cluster

* Kafka-exporter: Updated values.yaml to remove default values and correct intendation

* Add kafka-exporter to expose prometheus metrics for kafka cluster

* Kafka-exporter: Updated values.yaml to support tls/sasl authentication while connecting kafka cluster

* Kafka-exporter: Updated values.yaml to remove default values and correct intendation

* Updated chart version
…ces (acryldata#181)

* feat(frontend): add service monitoring

* feat(gms): add service monitoring

* gms: servicemonitor

* feat(mae): enable service monitoring

* update READMEs

* fix service ports

* bump version

* Add missing default value

* Update charts/datahub/Chart.yaml

* delete jmx config and rename port to http
…t boot (acryldata#180)

* fix(auth-secret): Make template use correct retrieval method

`datahub-auth-secret` yaml was incorrectly using the `index` template function which is for list variables. For dictionaries as is the case with the `$secret.data` object, the correct method is: https://helm.sh/docs/chart_template_guide/function_list/#get

Tested locally, that this works against a running cluster.

* Updates encryption secret to use get helm function

* feat(secrets): Allow users to specify their own secret values at first boot
* fix(datahub-frontend): Remove unused env var

* Bump chart version
KonstantinVishnivetskii and others added 20 commits May 18, 2023 15:40
* Values for PSQL database name, elastic prefix
---------

Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
…#310)

* feat: Add ability to specify extraPodLabels per deployment

* Update Chart.yaml

---------

Co-authored-by: jorrick <jorrick.sleijster@adyen.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
* fix(datahub): use common labels for (Cron)Jobs

* chore: update version

---------

Co-authored-by: Matthijs van der Loos <matthijs.vanderloos@utopiamusic.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
* fix(datahub): add missing global values to subchart values

* chore: update versions

---------

Co-authored-by: Matthijs van der Loos <matthijs.vanderloos@utopiamusic.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
…ta#323)

* chore(secrets): use configurable refs instead of fixed names

* Update Chart.yaml

---------

Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
@sb-sebkim sb-sebkim requested a review from a team July 5, 2023 03:18
@sendbird-sehwankim
Copy link

sendbird-sehwankim commented Jul 5, 2023

@sb-sebkim Can you check the lint-test failures?

@@ -76,8 +76,6 @@ You should get a result similar to below.
```
NAME READY STATUS RESTARTS AGE
elasticsearch-master-0 1/1 Running 0 62m
elasticsearch-master-1 1/1 Running 0 62m
elasticsearch-master-2 1/1 Running 0 62m

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see elasticsearch-master-0 and elasticsearch-master-1 running on the stg cluster. Are they supposed to be up and running?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. They are supposed to be up and running 3 replicas in production and 2 replicas in staging.

@sb-sebkim sb-sebkim merged commit 3421dfd into master Jul 6, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.