Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add Kafka topics from upstream projects (Sentry and Snuba) for version 24.9.0 #1647

Merged
merged 1 commit into from
Dec 23, 2024

Conversation

patsevanton
Copy link
Contributor

@patsevanton patsevanton commented Dec 23, 2024

This pull request introduces new Kafka topics and updates existing ones based on upstream commits from Sentry and Snuba version 24.9.0.

Topic from files:
https://github.com/getsentry/snuba/blob/24.9.0/snuba/utils/streams/topics.py
https://github.com/getsentry/sentry/blob/24.9.0/src/sentry/conf/server.py

The following changes have been made:

  • New Topics Added:
    • outcomes-dlq
    • outcomes-billing-dlq
    • scheduled-subscriptions-generic-metrics-gauges
    • snuba-generic-metrics-gauges-commit-log
    • ingest-attachments-dlq
    • ingest-feedback-events
    • ingest-feedback-events-dlq
    • ingest-generic-metrics-dlq
    • ingest-transactions-dlq
    • ingest-events-dlq
    • ingest-metrics-dlq
    • monitors-clock-tasks
    • monitors-clock-tick
    • snuba-profile-chunks
    • buffered-segments
    • buffered-segments-dlq
    • uptime-configs
    • uptime-results

Upstream Commits:

@patsevanton
Copy link
Contributor Author

patsevanton commented Dec 23, 2024

Check local install

k get pod -n test
NAME                                                              READY   STATUS    RESTARTS      AGE
sentry-billing-metrics-consumer-f6db4bc5c-4gxv6                   1/1     Running   0             3m20s
sentry-clickhouse-0                                               1/1     Running   0             21m
sentry-cron-5f5f668fb6-66v6f                                      1/1     Running   3 (18m ago)   21m
sentry-generic-metrics-consumer-58d967864f-224q4                  1/1     Running   0             3m20s
sentry-ingest-consumer-attachments-66bbdcc7d5-56bcs               1/1     Running   0             3m19s
sentry-ingest-consumer-events-846bd78898-kkxjz                    1/1     Running   0             3m18s
sentry-ingest-consumer-transactions-96bf4d646-nmzgw               1/1     Running   0             3m17s
sentry-ingest-monitors-97dc8d5cc-jsjr9                            1/1     Running   0             3m16s
sentry-ingest-occurrences-9cf7947bf-s8ghg                         1/1     Running   0             3m15s
sentry-ingest-replay-recordings-5489644645-klxc5                  1/1     Running   0             3m14s
sentry-issue-occurrence-consumer-7bdf7c4545-s4kqh                 1/1     Running   0             2m59s
sentry-kafka-controller-0                                         1/1     Running   0             21m
sentry-kafka-controller-1                                         1/1     Running   0             21m
sentry-kafka-controller-2                                         1/1     Running   0             21m
sentry-metrics-consumer-68d5cd6c6f-p52kw                          1/1     Running   0             3m14s
sentry-nginx-78665d4559-2hkwf                                     1/1     Running   0             21m
sentry-post-process-forward-errors-86cf66d8f4-gtwg7               1/1     Running   0             3m13s
sentry-post-process-forward-issue-platform-6f59bbb877-9w6vk       1/1     Running   0             3m12s
sentry-post-process-forward-transactions-7f64d9998f-sfgbh         1/1     Running   0             3m11s
sentry-rabbitmq-0                                                 1/1     Running   0             21m
sentry-relay-67b8c8fdd7-vlvbl                                     1/1     Running   0             2m53s
sentry-sentry-postgresql-0                                        1/1     Running   0             21m
sentry-sentry-redis-master-0                                      1/1     Running   0             21m
sentry-sentry-redis-replicas-0                                    1/1     Running   1 (18m ago)   21m
sentry-snuba-api-db46488d-mt75w                                   1/1     Running   0             21m
sentry-snuba-consumer-c9df7f879-7x8ks                             1/1     Running   0             3m10s
sentry-snuba-generic-metrics-counters-consumer-575f88dd49-cb8bv   1/1     Running   0             3m6s
sentry-snuba-generic-metrics-distributions-consumer-5496ff24wgd   1/1     Running   0             3m5s
sentry-snuba-generic-metrics-sets-consumer-8d994b9df-jvqfs        1/1     Running   0             3m5s
sentry-snuba-group-attributes-consumer-69d9f486d7-ktdfb           1/1     Running   0             3m4s
sentry-snuba-metrics-consumer-69c8f7d46d-bdmbf                    1/1     Running   0             3m3s
sentry-snuba-outcomes-billing-consumer-59d99c7cd6-59vd2           1/1     Running   0             3m2s
sentry-snuba-outcomes-consumer-5fbfb78c6d-psqmj                   1/1     Running   0             2m58s
sentry-snuba-replacer-948c45964-66zd9                             1/1     Running   0             2m57s
sentry-snuba-replays-consumer-779bbb945d-pvgxk                    1/1     Running   0             3m1s
sentry-snuba-spans-consumer-f94b8698c-shjbn                       1/1     Running   0             3m1s
sentry-snuba-subscription-consumer-events-679d684787-hl9hn        1/1     Running   0             2m56s
sentry-snuba-subscription-consumer-metrics-565bf88996-kgp89       1/1     Running   0             2m55s
sentry-snuba-subscription-consumer-transactions-7cc6574dc7kzd7n   1/1     Running   0             2m54s
sentry-snuba-transactions-consumer-69bd895d89-l4v4g               1/1     Running   0             3m
sentry-subscription-consumer-events-77bdb5b7d9-8pv5h              1/1     Running   0             3m9s
sentry-subscription-consumer-generic-metrics-78d9756698-wfkfw     1/1     Running   0             3m8s
sentry-subscription-consumer-metrics-764b9bb6cd-mzg49             1/1     Running   0             3m7s
sentry-subscription-consumer-transactions-85548bf7c7-wcd5m        1/1     Running   0             3m7s
sentry-web-66bb445cdb-hktxd                                       1/1     Running   4 (18m ago)   21m
sentry-worker-7f9c7d6d55-5dd9r                                    1/1     Running   4 (18m ago)   21m
sentry-zookeeper-clickhouse-0                                     1/1     Running   0             21m

@Mokto Mokto merged commit cac64cf into sentry-kubernetes:develop Dec 23, 2024
2 of 3 checks passed
@Mokto Mokto mentioned this pull request Dec 23, 2024
@patsevanton patsevanton deleted the new-topics branch December 25, 2024 01:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants