Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bpo-41682: skip test_sendfile_close_peer_in_the_middle_of_receiving in test_asyncio #30801

Merged
merged 3 commits into from
Jan 22, 2022

Conversation

sobolevn
Copy link
Member

@sobolevn sobolevn commented Jan 22, 2022

It is failing way too often:
Снимок экрана 2022-01-22 в 22 26 45

Most of the commits above failed due to this single test.
I don't know how to fix it, but at least we can decrease the noise.

https://bugs.python.org/issue41682

@sobolevn sobolevn added skip news tests Tests in the Lib/test dir labels Jan 22, 2022
@erlend-aasland
Copy link
Contributor

erlend-aasland commented Jan 22, 2022

If I remember correctly, all failures are on Windows. Perhaps we can skip on Windows only? I generally don't feel comfortable with just skipping a flakey test; it tends to lead to the issue being forgotten and possibly hiding real bugs. OTOH, the noise level on the CI is unbearable at the moment.

@@ -456,6 +456,8 @@ def test_sendfile_ssl_close_peer_after_receiving(self):
# themselves).
@unittest.skipIf(sys.platform.startswith('sunos'),
"Doesn't work on Solaris")
@unittest.skipIf(sys.platform == "win32",
"It is flaky on Windows and needs to be fixed") # TODO: bpo-41682
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nitpick: I'd probably include the bug number in the skip message in case that's all the viewer sees.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest to not include it in the skip message. Otherwise, https://bugs.python.org/issue41682 will be spammed with pull requests unrelated to the change, if a CI job fails with this message. The bot which mentions PR in bpo searchs for "bpo-xxx" anyway in a PR :-(

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ouch!

Copy link
Member

@vstinner vstinner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. I would prefer to fix it, but well, since Septembre 2020, no one was available to investigate this bug, whereas this bug annoys anyone paying attention to Python CIs for 1 year and a half.

But please don't close https://bugs.python.org/issue41682 until the real issue is fixed.

@vstinner vstinner merged commit 1ded8ed into python:main Jan 22, 2022
@vstinner vstinner added needs backport to 3.9 only security fixes needs backport to 3.10 only security fixes labels Jan 22, 2022
@miss-islington
Copy link
Contributor

Thanks @sobolevn for the PR, and @vstinner for merging it 🌮🎉.. I'm working now to backport this PR to: 3.9.
🐍🍒⛏🤖

@miss-islington
Copy link
Contributor

Thanks @sobolevn for the PR, and @vstinner for merging it 🌮🎉.. I'm working now to backport this PR to: 3.10.
🐍🍒⛏🤖

miss-islington pushed a commit to miss-islington/cpython that referenced this pull request Jan 22, 2022
…nGH-30801)

(cherry picked from commit 1ded8ed)

Co-authored-by: Nikita Sobolev <mail@sobolevn.me>
@bedevere-bot
Copy link

GH-30811 is a backport of this pull request to the 3.9 branch.

@bedevere-bot bedevere-bot removed the needs backport to 3.9 only security fixes label Jan 22, 2022
miss-islington pushed a commit to miss-islington/cpython that referenced this pull request Jan 22, 2022
…nGH-30801)

(cherry picked from commit 1ded8ed)

Co-authored-by: Nikita Sobolev <mail@sobolevn.me>
@bedevere-bot bedevere-bot removed the needs backport to 3.10 only security fixes label Jan 22, 2022
@bedevere-bot
Copy link

GH-30812 is a backport of this pull request to the 3.10 branch.

@gvanrossum
Copy link
Member

Can someone please try to figure out what caused that test to fail, and why it got worse recently?

@vstinner
Copy link
Member

Can someone please try to figure out what caused that test to fail, and why it got worse recently?

I also noticed that the step started to fail more recently recently. Maybe a CI updated Windows. I saw an announcement that Azure Pipelines or GitHub Actions (oops, I don't recall anymore) is being upgrade incrementally to Windows Server 2022, for example.

About the bug itself, it has been reported in September 2020 and so far, no one was available to investigate the issue: https://bugs.python.org/issue41682

miss-islington added a commit that referenced this pull request Jan 23, 2022
)

(cherry picked from commit 1ded8ed)

Co-authored-by: Nikita Sobolev <mail@sobolevn.me>
vstinner pushed a commit that referenced this pull request Jan 23, 2022
) (GH-30812)

(cherry picked from commit 1ded8ed)

Co-authored-by: Nikita Sobolev <mail@sobolevn.me>

Co-authored-by: Nikita Sobolev <mail@sobolevn.me>
@vstinner
Copy link
Member

I also noticed that the step started to fail more recently recently. Maybe a CI updated Windows. I saw an announcement that Azure Pipelines or GitHub Actions (oops, I don't recall anymore) is being upgrade incrementally to Windows Server 2022, for example.

@zooba modified the config yesterday to request explicitly Windows 2022 for the Windows jobs of the Azure Pipelines: commit 70c1646.

My PR #30817 confirms that Windows Server 2022 is now used on Azure Pipelines for the Windows jobs.

So maybe the test fails more frequently or always fails on Windows Server 2022.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skip news tests Tests in the Lib/test dir
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants