Skip to content

Conversation

@notatallshaw-gts
Copy link
Contributor

@notatallshaw-gts notatallshaw-gts commented Dec 4, 2025

closes: #58911

Prior PR that does not fully fix issue I am having: #43840

@notatallshaw-gts notatallshaw-gts force-pushed the handle-mid-line-chunking-when-writing-docker-stream-to-logs branch 2 times, most recently from a5525ab to 96b70fd Compare December 5, 2025 18:09
…8911)

When when streaming logs from a Docker container the chunks that are
sent back do not have to correspond to lines, there could be multiple
chunks from a single line. We therefore have to handle buffering the
output until we have a whole line to log, fixes apache#58911
@notatallshaw-gts notatallshaw-gts force-pushed the handle-mid-line-chunking-when-writing-docker-stream-to-logs branch from 96b70fd to 1cfe9df Compare December 5, 2025 19:24
@notatallshaw-gts
Copy link
Contributor Author

@potiuk This is very low priority, but if at some point in the future you could review or ping someone else more appropriate to review I would be very appreciative.

I am running with this patch locally.

Copy link
Member

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@potiuk potiuk merged commit 0bf581e into apache:main Dec 7, 2025
80 checks passed
amoghrajesh pushed a commit to astronomer/airflow that referenced this pull request Dec 8, 2025
…9071)

* Handle mid-line chunking when writing docker stream to logs (apache#58911)

When when streaming logs from a Docker container the chunks that are
sent back do not have to correspond to lines, there could be multiple
chunks from a single line. We therefore have to handle buffering the
output until we have a whole line to log, fixes apache#58911

* Add test for mid-line chunks and update existing tests to match correct expectations
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Exceptions become a mess in logs using a Python 3.11 docker operator - part 2

2 participants