Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add flag to avoid kafka and gRPC data dupplication in Bookkeeping #657

Merged
merged 3 commits into from
Aug 19, 2024
Merged

Add flag to avoid kafka and gRPC data dupplication in Bookkeeping #657

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
83821c2
Add flag to disable kafka sending gRPC requests on enviornment update
martinboulais Jul 11, 2024
744ba48
Condition applies also on run
martinboulais Jul 16, 2024
94fb66d
Update readout-dataflow.yaml
martinboulais Aug 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions workflows/readout-dataflow.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1386,6 +1386,7 @@ defaults:
# Other variables
###############################
bookkeeping_enabled: "true"
bookkeeping_consuming_kafka: "false"
ccdb_enabled: "false"
dpl_workflow: none
dpl_command: none
Expand Down Expand Up @@ -2098,6 +2099,7 @@ roles:
enabled: "{{bookkeeping_enabled == 'true'}}"
roles:
- name: startrun
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.StartOfRun()
trigger: before_START_ACTIVITY-100
Expand All @@ -2110,84 +2112,98 @@ roles:
timeout: 10s
critical: false
- name: updaterunstart
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateRunStart()
trigger: after_START_ACTIVITY+100
timeout: 10s
critical: false
- name: updaterunstop
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateRunStop()
trigger: after_STOP_ACTIVITY+100
timeout: 10s
critical: false
- name: updaterungoerror
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateRunStop()
trigger: after_GO_ERROR+100
timeout: 10s
critical: false
- name: updaterundestroy
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateRunStop()
trigger: DESTROY
timeout: 10s
critical: false
- name: startenv
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.CreateEnv()
trigger: before_DEPLOY
timeout: 10s
critical: false
- name: deploy
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_DEPLOY+100
timeout: 10s
critical: false
- name: configure
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_CONFIGURE+100
timeout: 10s
critical: false
- name: reset
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_RESET+100
timeout: 10s
critical: false
- name: start
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_START_ACTIVITY+100
timeout: 10s
critical: false
- name: stop
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_STOP_ACTIVITY+100
timeout: 10s
critical: false
- name: exit
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_EXIT
timeout: 10s
critical: false
- name: goerror
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_GO_ERROR+100
timeout: 10s
critical: false
- name: recover
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: after_RECOVER+100
timeout: 10s
critical: false
- name: destroy
enabled: "{{ bookkeeping_consuming_kafka != 'true' }}"
call:
func: bookkeeping.UpdateEnv()
trigger: DESTROY
Expand Down
Loading