Skip to content

Skip Templates.Mvc.Tests in Helix on Debian12 and Mariner #56291

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

SteveSandersonMS
Copy link
Member

These tests have been failing on Debian and Mariner for months. This has continued through many build ops rotations without progress.

To bring the build closer to a stable state, skipping them on those OSes until a better fix can be identified.

@dotnet-issue-labeler dotnet-issue-labeler bot added the area-mvc Includes: MVC, Actions and Controllers, Localization, CORS, most templates label Jun 18, 2024
@SteveSandersonMS SteveSandersonMS marked this pull request as draft June 18, 2024 10:51
Comment on lines +24 to +30
<!-- These tests fail in Helix in Debian and Mariner due to error -901 -->
<!-- Disabling on those OSes until a better fix can be identified -->
<SkipHelixQueues>
$(HelixQueueDebian12);
$(HelixQueueMariner);
$(SkipHelixQueues)
</SkipHelixQueues>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to skip the whole assembly? Or can we just skip the individual failing tests?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nope, this was just an experiment. Thanks for pointing it out though.

Since then I made another PR with a more narrow skip condition which has now been merged: #56292

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update: no, the above comment is incorrect.

Yes we do need to skip the whole assembly since there isn't an individual failing test. It's an unknown timeout problem.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to skip the whole assembly? Or can we just skip the individual failing tests?

TBH, I think we should probably skip the entire test assembly. I know that is a bit heavy handed but, from looking at a few of the recent test process crashes, there's no correlation between particular tests and expected failures. It's all over the board.

@SteveSandersonMS
Copy link
Member Author

SteveSandersonMS commented Jun 20, 2024

Superseded by #56292

Update: actually no that's not true, I remembered now (with thanks to @BrennanConroy) the two PRs are addessing unrelated problems.

Copy link
Member

@captainsafia captainsafia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! I think we should skip these tests and focus our diagnosis efforts on getting local repros working for this failure.

For whatever reason, these test builds aren't producing dump files correctly so outside of the logs were not getting any additional signal from the failures.

Edit: Actually, I wonder if there is a way for us to quarantine an entire test assembly...

@SteveSandersonMS SteveSandersonMS merged commit b7e96bc into main Jun 25, 2024
27 checks passed
@SteveSandersonMS SteveSandersonMS deleted the stevesa/disable-mvc-template-tests-on-some-helix-oses branch June 25, 2024 17:11
@SteveSandersonMS
Copy link
Member Author

Filed #56450 to track undoing this.

@mkArtakMSFT
Copy link
Member

/backport to release/8.0

Copy link
Contributor

Started backporting to release/8.0: https://github.com/dotnet/aspnetcore/actions/runs/10080675797

Copy link
Contributor

@mkArtakMSFT backporting to release/8.0 failed, the patch most likely resulted in conflicts:

$ git am --3way --ignore-whitespace --keep-non-patch changes.patch

Applying: Skip Templates.Mvc.Tests in Helix on Debian12 and Mariner
Using index info to reconstruct a base tree...
M	src/ProjectTemplates/test/Templates.Mvc.Tests/Templates.Mvc.Tests.csproj
Falling back to patching base and 3-way merge...
Auto-merging src/ProjectTemplates/test/Templates.Mvc.Tests/Templates.Mvc.Tests.csproj
CONFLICT (content): Merge conflict in src/ProjectTemplates/test/Templates.Mvc.Tests/Templates.Mvc.Tests.csproj
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
hint: When you have resolved this problem, run "git am --continue".
hint: If you prefer to skip this patch, run "git am --skip" instead.
hint: To restore the original branch and stop patching, run "git am --abort".
hint: Disable this message with "git config advice.mergeConflict false"
Patch failed at 0001 Skip Templates.Mvc.Tests in Helix on Debian12 and Mariner
Error: The process '/usr/bin/git' failed with exit code 128

Please backport manually!

Copy link
Contributor

@mkArtakMSFT an error occurred while backporting to release/8.0, please check the run log for details!

Error: git am failed, most likely due to a merge conflict.

BrennanConroy added a commit that referenced this pull request Jul 25, 2024
This one was missed in #56291 and no-one updated it since :/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-mvc Includes: MVC, Actions and Controllers, Localization, CORS, most templates
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants