Skip to content

Conversation

@jedcunningham
Copy link
Member

Sometimes, somehow, the end of log mark can be missing, and when that
happens the streaming log reader enters an infinite loop. Instead, if
the task is in a non-running state and we stop receiving log lines but
never get the end of log mark, we assume we won't and stop trying. We do
tell emit that we are stopping though.

Backport of #50715.

Sometimes, somehow, the end of log mark can be missing, and when that
happens the streaming log reader enters an infinite loop. Instead, if
the task is in a non-running state and we stop receiving log lines but
never get the end of log mark, we assume we won't and stop trying. We do
tell emit that we are stopping though.
@potiuk
Copy link
Member

potiuk commented Jun 19, 2025

Nice... But tests failing... Some of them seem to be coming from the chnge ( I think there are few to fix in the branch though)

@jedcunningham jedcunningham merged commit 2b8818a into apache:v2-11-test Jun 20, 2025
59 checks passed
@jedcunningham jedcunningham deleted the handle_missind_end_of_log branch June 20, 2025 16:11
@jedcunningham jedcunningham added this to the Airflow 2.11.1 milestone Jun 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants