Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tests] Fix intro tests on older macOS #11736

Merged
merged 4 commits into from
Jun 4, 2021
Merged

Conversation

mandel-macaque
Copy link
Member

No description provided.

@mandel-macaque mandel-macaque added the not-notes-worthy Ignore for release notes label May 28, 2021
@mandel-macaque
Copy link
Member Author

I have tested all of this on:

  • Mojave
  • Catalina
  • High Sierra
  • Big Sur

case "MLFeatureValue":
case "MLSequence":
if (Mac.CheckSystemVersion (10, 15)) // Fail on Catalina, pass in older OS
return true;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that's skipping OS <= 10.15
if it pass on older you need a different check, like

// Fail on Catalina, pass in older OS	
if (Mac.CheckSystemVersion (10, 14))
	break;
if (Mac.CheckSystemVersion (10, 15)) 
	return true;
// 11.x
break;

return TestRuntime.IsVM; // skip only on vms
case "NSMenuView":
return TestRuntime.IsVM || IntPtr.Size != 8; // skip on vms or 64b
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we don't support 32bits for macOS anymore, you can always skip NSMenuView


case "MetalPerformanceShaders.MPSPredicate":
if (Mac.CheckSystemVersion (10, 15)) // Fails on Catalina: Could not initialize an instance of the type 'MetalPerformanceShaders.MPSPredicate': the native 'init' method returned nil.
return true;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

does it work on earlier macOS ?
if so see my other comment

@vs-mobiletools-engineering-service2
Copy link
Collaborator

❌ [PR Build] Tests failed on Build ❌

Tests failed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

GitHub pages

Results can be found in the following github pages (it might take some time to publish):

Test results

1 tests failed, 80 tests passed.

Failed tests

  • introspection/Mac Modern/Debug: Failed (Test run failed.
    Tests run: 37 Passed: 35 Inconclusive: 0 Failed: 1 Ignored: 1)

Pipeline on Agent XAMBOT-1098.BigSur
Merge 1907f3d into dc30bdf

@vs-mobiletools-engineering-service2
Copy link
Collaborator

✅ [PR Build] Tests passed on Build. ✅

Tests passed on Build.

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

GitHub pages

Results can be found in the following github pages (it might take some time to publish):

🎉 All 81 tests passed 🎉

Pipeline on Agent XAMBOT-1099.BigSur
Merge f5a6a59 into 0864407

@vs-mobiletools-engineering-service2
Copy link
Collaborator

❌ [PR Build] Tests failed on Build ❌

Tests failed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

GitHub pages

Results can be found in the following github pages (it might take some time to publish):

Test results

19 tests failed, 62 tests passed.

Failed tests

  • monotouch-test/iOS Unified 64-bits - simulator/Debug: TimedOut
  • monotouch-test/iOS Unified 64-bits - simulator/Debug (LinkSdk): TimedOut
  • monotouch-test/iOS Unified 64-bits - simulator/Debug (static registrar): TimedOut
  • monotouch-test/iOS Unified 64-bits - simulator/Release (all optimizations): TimedOut
  • fsharp/iOS Unified 64-bits - simulator/Debug: TimedOut
  • framework-test/iOS Unified 64-bits - simulator/Debug: TimedOut
  • xcframework-test/iOS Unified 64-bits - simulator/Debug: TimedOut
  • interdependent-binding-projects/iOS Unified 64-bits - simulator/Debug: TimedOut
  • introspection/iOS Unified 64-bits - simulator/Debug: TimedOut
  • dont link/iOS Unified 64-bits - simulator/Debug: TimedOut
  • dont link/iOS Unified 64-bits - simulator/Release: TimedOut
  • link all/iOS Unified 64-bits - simulator/Debug: TimedOut
  • link all/iOS Unified 64-bits - simulator/Release: TimedOut
  • link sdk/iOS Unified 64-bits - simulator/Debug: TimedOut
  • link sdk/iOS Unified 64-bits - simulator/Release: TimedOut
  • mono-native-compat/iOS Unified 64-bits - simulator/Debug: TimedOut
  • mono-native-compat/iOS Unified Today Extension 64-bits - simulator/Debug: TimedOut
  • mono-native-unified/iOS Unified 64-bits - simulator/Debug: TimedOut
  • mono-native-unified/iOS Unified Today Extension 64-bits - simulator/Debug: TimedOut

Pipeline on Agent XAMBOT-1099.BigSur'
Merge ccf90b5 into 7fb037c

@vs-mobiletools-engineering-service2
Copy link
Collaborator

✅ [PR Build] Tests passed on Build. ✅

Tests passed on Build.

API diff

✅ API Diff from stable

View API diff

API & Generator diff

API Diff (from PR only) (no change)
Generator Diff (no change)

GitHub pages

Results can be found in the following github pages (it might take some time to publish):

🎉 All 81 tests passed 🎉

Pipeline on Agent XAMBOT-1101.BigSur
Merge e956905 into 4e53d83

@mandel-macaque mandel-macaque merged commit 5261242 into main Jun 4, 2021
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

* changing the label requirement for the tests

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

* changing the label requirement for the tests

* more debugging 2

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

* changing the label requirement for the tests

* more debugging 2

* try more debugging

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

* changing the label requirement for the tests

* more debugging 2

* try more debugging

* changing to create new branch

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

* changing the label requirement for the tests

* more debugging 2

* try more debugging

* changing to create new branch

* forgot to update the depends on

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

* changing the label requirement for the tests

* more debugging 2

* try more debugging

* changing to create new branch

* forgot to update the depends on

* adding soft-fail

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
tj-devel709 added a commit that referenced this pull request Jun 4, 2021
* [Tests] Fix intro tests on older macOS (#11736)


Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>

* Seeing if pushing to this lego branch will create a PR inside AutomatingLocalizationGHATest

* [Actions] Remove broken action. (#11819)

Actions that are triggered from forks do not have access to the secrets
making the action fail most of the time. We have moved to a github
action in the static page repo that will clean results of closed PRs
everyday. We remove this action because is broken and not needed.

* try again

* let's get the lego firing again

* fire lego #3

* see if test gha occurs

* trying after changing gha name

* changing the branch (#11826)

Co-authored-by: tj_devel709 <antlambe@microsoft.com>

* after changing the GHA in main

* perhaps the action was not updated yet

* after merge main

* wrong label

* fire

* adding sync to this branch

* fixing env variable

* conditionals in the wrong place

* add debugging

* more debugging

* changing the label requirement for the tests

* more debugging 2

* try more debugging

* changing to create new branch

* forgot to update the depends on

* adding soft-fail

* soft-fail -> soft_fail

Co-authored-by: Manuel de la Pena <mandel@microsoft.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: tj_devel709 <antlambe@microsoft.com>
Co-authored-by: TJ Lambert <50846373+tj-devel709@users.noreply.github.com>
@mandel-macaque mandel-macaque deleted the fix-intro-mac-os-x branch December 7, 2021 20:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
not-notes-worthy Ignore for release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants