Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update default value for job_name in DataflowConfiguration #40645

Merged
merged 2 commits into from
Jul 16, 2024

Conversation

e-galan
Copy link
Contributor

@e-galan e-galan commented Jul 8, 2024

Fix the default value setting for the job_name in DataflowConfiguration class.

The previous default value attempted to use Airflow templating features, which didn't work because the default value was never calculated on the DAG level. This caused some of the system tests to fail.

This PR should address #40515
fixes: #40515


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added area:providers area:system-tests provider:google Google (including GCP) related issues labels Jul 8, 2024
@e-galan e-galan closed this Jul 8, 2024
@e-galan e-galan reopened this Jul 8, 2024
@e-galan e-galan marked this pull request as draft July 8, 2024 08:21
@e-galan e-galan changed the title Update default job_name value in DataflowConfiguration, fix dataflow_native_java test Update default value for job_name in DataflowConfiguration Jul 9, 2024
@e-galan e-galan marked this pull request as ready for review July 9, 2024 07:51
@e-galan e-galan marked this pull request as draft July 11, 2024 11:40
@e-galan e-galan marked this pull request as ready for review July 11, 2024 12:23
@e-galan e-galan marked this pull request as draft July 11, 2024 12:45
@e-galan e-galan force-pushed the fix-apache-beam-dict-config branch from 02722d6 to 5815ebc Compare July 11, 2024 15:02
@e-galan e-galan marked this pull request as ready for review July 11, 2024 15:04
@e-galan
Copy link
Contributor Author

e-galan commented Jul 16, 2024

Hi @potiuk , @eladkal ! Could you have a look at the PR?

@eladkal eladkal merged commit 519b0d0 into apache:main Jul 16, 2024
51 checks passed
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
)

Co-authored-by: Ryan Hatter <25823361+RNHTTR@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:providers area:system-tests provider:google Google (including GCP) related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

BeamRunJavaPipelineOperator fails without job_name set
4 participants