(fix): HybridExecutor tasks of other executor rescheduled in kubernetes executor #42175
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pavansharma36
requested review from
jedcunningham and
hussein-awala
as code owners
boring-cyborg
bot
added
area:providers
provider:cncf-kubernetes
uranusjr
reviewed
Sep 11, 2024
airflow/providers/cncf/kubernetes/executors/kubernetes_executor.py
Outdated
Show resolved
Hide resolved
eladkal
changed the title
o-nikolas
reviewed
Oct 4, 2024
airflow/providers/cncf/kubernetes/executors/kubernetes_executor.py
Outdated
Show resolved
Hide resolved
airflow/providers/cncf/kubernetes/executors/kubernetes_executor.py
Outdated
Show resolved
Hide resolved
o-nikolas
approved these changes
Oct 9, 2024
|
Needs another rebase :( |
…27.2 and pre-commit-hooks to v5.0.0 (apache#42809)
Previously we were getting 'PytestDeprecationWarning: The configuration option "asyncio_default_fixture_loop_scope" is unset.' This sets it to the new default, and makes the warning go away.
* feat: allow customizing podManagementPolicy * fix: adjust schema and identation * ci: adjust lint --------- Co-authored-by: Arakaki, Everton <everton.arakaki@rabobank.nl>
Previously it worked in general, but did not in certain test scenarios where we did not initialize the database. This is one solution.
related to apache#41816 Adds a warning log to indicate failure if length of task_key>100.
There was a problem with CI image builds when cache has been disabled - they still used "pre-cached" main version (unlike PROD builds). This PR synchronizes the behaviour between CI and PROD builds. For removing dependencies, you need to set both: * `disable docker cache` label * incerase DEPENDENCIES_EPOCH_NUMBER in `Dockerfile.ci` Comments and documentation in both places has been updated to reflect it. Since documentation for labels has been updated, Part of this PR is to improve the description of possible labels that could be used during the build. The description grew from a small number of labels to a "wall of text" that was difficult to read. This PR reformats it in the form of table that makes it far easier to see actions that the maintainer can do and what labels should be set for each of them.
* delete dag_run init * delete dag_run init * add delete dag run endpoint * add tests for delete dag run
* Make datStats dag_id parameter optional with pagination * move pagination out of sql query * tidy --------- Co-authored-by: Michael Smith-Chandler <mjsmithandler@gmail.com>
…ords (apache#42860) * Change directory used by simple auth manager to store generated passwords * Update airflow/auth/managers/simple/simple_auth_manager.py Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com> --------- Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>
* quarantined flaky mssql integration tests * disable mssql from ci integration checks
apache#42982) - To let GCP Beam Sensor operators 'sense' the pipeline changes, by having dataflow job_id been xcom_push as soon as it available. Related issue: apache#30007. Co-authored-by: Oleg Kachur <kachur@google.com>
Periodically check for backfills that should be marked as complete.
pavansharma36
requested review from
bolkedebruin,
ephraimbuddy,
dstandish,
potiuk,
ashb,
eladkal,
mobuchowski,
mik-laj,
jscheffl,
josh-fell,
bbovenzi,
pierrejeambrun,
ryanahamilton and
XD-DENG
as code owners
|
I think I messed up something, Will create new PR, |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes: #42151