[Xamarin.Android.Build.Tests] Import tests from last regression test job #5101
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
These two suites are still running on a larger set of devices as part of https://dev.azure.com/devdiv/DevDiv/_release?definitionId=476&view=mine&_a=releases. We can revisit the need to run these on both emulators and devices in a future PR.
The 'DotNetIgnore' category should be used to filter out tests which are incompatible with One .NET
src/Xamarin.Android.Build.Tasks/Tests/Xamarin.Android.Build.Tests/AotTests.cs
Outdated
Show resolved
Hide resolved
Member
Author
|
Full test run queued: https://dev.azure.com/devdiv/DevDiv/_build/results?buildId=4063251&view=results |
jonathanpeppers
approved these changes
Sep 14, 2020
Member
jonathanpeppers
left a comment
jonathanpeppers
left a comment
There was a problem hiding this comment.
This looks good, if the build ends up green. 👍
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Context: https://github.com/xamarin/QualityAssurance/pull/3646
CI and Xamarin.Android.Build.Tests have been updated to reflect the
third round of regression test auditing. The Xamarin.Android YAML
pipeline no longer contains QA test jobs, and the following regression
test categories have been removed:
RuntimeTests- Still runs on multiple devices on the external test job.Hello- Still runs on multiple devices on the external test job.RegressionDeviceTests- Obsolete tests removed, some missing coverage migrated.FastDevDeviceTests- Obsolete tests removed, some missing coverage migrated.BuildPerformance- Missing coverage migrated.AotSupport- Obsolete tests removed, some missing coverage migrated.The
dotnettest categories have been removed as they are no longerused as far as I can tell. The
DotNetIgnorecategory is the preferredway to filter tests that aren't compatible with One .NET.
AndroidUpdateResourceTest.RepetitiveBuildhas been removed, as itappeared to be a duplicate of
IncrementalBuildTest.BasicApplicationRepetitiveBuild.BuildTest.BuildReleaseApplicationhas also been removed as it isimplicitly covered by other release configuration tests.