Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Re-enable API and Generator diff. #11187

Merged
merged 23 commits into from
Apr 29, 2021
Merged

[CI] Re-enable API and Generator diff. #11187

merged 23 commits into from
Apr 29, 2021

Conversation

mandel-macaque
Copy link
Member

Use the jenkins script as a base to get the PAI & generator from stable
diff back to the CI. Comment is not perfect, but does provide the
required information. The comment can be improve in a later commit since
this is getting too large.

Use the jenkins script as a base to get the PAI & generator from stable
diff back to the CI. Comment is not perfect, but does provide the
required information. The comment can be improve in a later commit since
this is getting too large.
@mandel-macaque mandel-macaque added the not-notes-worthy Ignore for release notes label Apr 10, 2021
@mandel-macaque
Copy link
Member Author

Sample commit from the tests: c846033#commitcomment-49333692

We should get a similar one here nevertheless.

@vs-mobiletools-engineering-service2
Copy link
Collaborator

❌ Tests failed on Build ❌

Tests failed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change) ✅ Generator Diff (no change)

Test results

1 tests failed, 97 tests passed.

Failed tests

  • introspection/watchOS 32-bits - simulator/Debug (watchOS 5.0): LaunchFailure

Pipeline on Agent XAMBOT-1106'

Copy link
Contributor

@spouliot spouliot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ API Diff (from PR only) (no change) ✅ Generator Diff (no change)

The output^ would be nicer on separate lines

✅ API Diff (from PR only) (no change)
✅ Generator Diff (no change)

@mandel-macaque
Copy link
Member Author

@spouliot I know: "The comment can be improve in a later commit since
this is getting too large." ;)

@vs-mobiletools-engineering-service2
Copy link
Collaborator

❌ Tests failed on Build ❌

Tests failed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

Test results

4 tests failed, 94 tests passed.

Failed tests

  • link all/Mac Catalyst/Debug: Failed (Tests run: 95 Passed: 91 Inconclusive: 0 Failed: 1 Ignored: 3)
  • monotouch-test/tvOS - simulator/Debug: TimedOut
  • fsharp/tvOS - simulator/Debug: TimedOut
  • introspection/watchOS 32-bits - simulator/Debug (watchOS 5.0): LaunchFailure

Pipeline on Agent XAMBOT-1104.BigSur

Copy link
Contributor

@spouliot spouliot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mandel-macaque do a small binding change in a commit

that will make API diff and generator diff generate something (non empty)

and then revert it - that will make the reports empty again

and proving the PR works as intended :)

@vs-mobiletools-engineering-service2
Copy link
Collaborator

❌ Tests failed on Build ❌

Tests failed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

Test results

1 tests failed, 98 tests passed.

Failed tests

  • introspection/watchOS 32-bits - simulator/Debug (watchOS 5.0): LaunchFailure

Pipeline on Agent XAMBOT-1118'
Merge e008649 into e8f4373

# set the env vars that are required for the compare to work. XAM_TOP is not set because
# the yaml takes care of that.
export WORKSPACE="$BUILD_ARTIFACTSTAGINGDIRECTORY"
echo "GH PR: $ghprbPullId"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're not calling compare.sh here.

@@ -0,0 +1,4 @@
# set the env vars that are required for the compare to work. XAM_TOP is not set because
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe start with #!/bin/bash -e?

@vs-mobiletools-engineering-service2
Copy link
Collaborator

✅ Tests passed on Build. ✅

Tests passed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

🎉 All 102 tests passed 🎉

Pipeline on Agent XAMBOT-1110'
Merge fbbd145 into 25715b8

@vs-mobiletools-engineering-service2
Copy link
Collaborator

✅ Tests passed on Build. ✅

Tests passed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

🎉 All 102 tests passed 🎉

Pipeline on Agent XAMBOT-1109'
Merge c6ec827 into 965ab98

@dalexsoto
Copy link
Member

Do not merge label per Manuel's request

@vs-mobiletools-engineering-service2
Copy link
Collaborator

❌ Tests failed on Build ❌

Tests failed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

Test results

1 tests failed, 103 tests passed.

Failed tests

  • link all/Mac Catalyst/Debug: TimedOut (Execution timed out after 1200 seconds.
    No test log file was produced)

Pipeline on Agent XAMBOT-1103
Merge 8643e1f into a1a5c01

@mandel-macaque
Copy link
Member Author

@spouliot success: #11244 (comment) there are two improvements I want to do, but we are good to land AFAIK

@vs-mobiletools-engineering-service2
Copy link
Collaborator

✅ Tests passed on Build. ✅

Tests passed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

🎉 All 104 tests passed 🎉

Pipeline on Agent XAMBOT-1103.BigSur
Merge ab64519 into 426d6d6

@mandel-macaque mandel-macaque merged commit 993c744 into main Apr 29, 2021
@mandel-macaque mandel-macaque deleted the error-api-changes branch April 29, 2021 21:53
@mandel-macaque
Copy link
Member Author

/sudo xcode12.5

@mandel-macaque
Copy link
Member Author

/sudo backport xcode12.5

@mandel-macaque
Copy link
Member Author

/sudo backport d16-10

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Backport Job to branch xcode12.5 Created! The magic is happening here

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Backport Job to branch d16-10 Created! The magic is happening here

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Oh no! Backport failed! Please see https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=4708923 for more details.

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Oh no! Backport failed! Please see https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=4708926 for more details.

mandel-macaque added a commit to mandel-macaque/xamarin-macios that referenced this pull request Apr 30, 2021
Use the jenkins script as a base to get the PAI & generator from stable
diff back to the CI. Comment is not perfect, but does provide the
required information. The comment can be improve in a later commit since
this is getting too large.
mandel-macaque added a commit to mandel-macaque/xamarin-macios that referenced this pull request Apr 30, 2021
Use the jenkins script as a base to get the PAI & generator from stable
diff back to the CI. Comment is not perfect, but does provide the
required information. The comment can be improve in a later commit since
this is getting too large.
@mandel-macaque
Copy link
Member Author

/sudo backport release/6.0.1xx-preview4

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Backport Job to branch release/6.0.1xx-preview4 Created! The magic is happening here

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Hooray! Backport succeeded! Please see https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=4711179 for more details.

mandel-macaque added a commit that referenced this pull request Apr 30, 2021
Use the jenkins script as a base to get the PAI & generator from stable
diff back to the CI. Comment is not perfect, but does provide the
required information. The comment can be improve in a later commit since
this is getting too large.
mandel-macaque added a commit that referenced this pull request Apr 30, 2021
Use the jenkins script as a base to get the PAI & generator from stable
diff back to the CI. Comment is not perfect, but does provide the
required information. The comment can be improve in a later commit since
this is getting too large.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
do-not-merge Do not merge this pull request not-notes-worthy Ignore for release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants