Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[mono] Tests failing System.Globalization.Calendars.IOS.Tests on ios-like platforms #90497

Closed
ivanpovazan opened this issue Aug 13, 2023 · 2 comments
Labels
area-System.Globalization blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab os-ios Apple iOS
Milestone

Comments

@ivanpovazan
Copy link
Member

ivanpovazan commented Aug 13, 2023

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=371961

Affected pipelines:

  • runtime-extra-platforms

Build error legs:

  • net8.0-maccatalyst-Release-arm64-Mono_Release-OSX.1200.Arm64.Open
  • net8.0-maccatalyst-Release-x64-Mono_Release-OSX.1200.Amd64.Open
  • net8.0-tvos-Release-arm64-Mono_Release-OSX.13.Amd64.AppleTV.Open
  • net8.0-iossimulator-Release-x64-Mono_Release-OSX.1200.Amd64.Open
  • net8.0-tvossimulator-Release-x64-Mono_Release-OSX.1200.Amd64.Open

Work items failing:

  • System.Globalization.Calendars.IOS.Tests

Crash log example:

[FAIL] System.Globalization.Tests.JapaneseCalendarTests.GetEra_Invalid_ThrowsArgumentOutOfRangeException   Test name: System.Globalization.Tests.JapaneseCalendarTests.GetEra_Invalid_ThrowsArgumentOutOfRangeException
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]    Assembly:  [System.Globalization.Calendars.IOS.Tests, Version=8.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51]
   Exception messages: Assert.All() Failure: 1 out of 1 items in the collection did not pass.
[0]: Item: 9/7/68 12:00:00 AM
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]      Xunit.Sdk.ThrowsException: Assert.Throws() Failure
     Expected: typeof(System.ArgumentOutOfRangeException)
     Actual:   (No exception was thrown)
        at Xunit.Assert.Throws(Type exceptionType, Exception exception) in /_/src/xunit.assert/Asserts/ExceptionAsserts.cs:line 226
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at Xunit.Assert.Throws[ArgumentOutOfRangeException](Func`1 testCode) in /_/src/xunit.assert/Asserts/ExceptionAsserts.cs:line 48
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at System.Globalization.Tests.CalendarTestBase.<>c__DisplayClass48_0.<GetEra_Invalid_ThrowsArgumentOutOfRangeException>b__0(DateTime dt)
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at Xunit.Assert.<>c__DisplayClass11_0`1[[System.DateTime, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].<All>b__0(DateTime item, Int32 index) in /_/src/xunit.assert/Asserts/CollectionAsserts.cs:line 34
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at Xunit.Assert.All[DateTime](IEnumerable`1 collection, Action`2 action) in /_/src/xunit.assert/Asserts/CollectionAsserts.cs:line 61   Exception stack traces:    at System.Globalization.Tests.CalendarTestBase.GetEra_Invalid_ThrowsArgumentOutOfRangeException()
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Pull request: #90023

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "[FAIL] System.Globalization.Tests.JapaneseCalendarTests.GetEra_Invalid_ThrowsArgumentOutOfRangeException",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=371961
Error message validated: [FAIL] System.Globalization.Tests.JapaneseCalendarTests.GetEra_Invalid_ThrowsArgumentOutOfRangeException
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 8/13/2023 7:37:32 PM UTC

Report

Build Definition Test Pull Request
372849 dotnet/runtime System.Globalization.Calendars.IOS.Tests.WorkItemExecution #90519
372550 dotnet/runtime System.Globalization.Calendars.IOS.Tests.WorkItemExecution
372445 dotnet/runtime System.Globalization.Calendars.IOS.Tests.WorkItemExecution #90270
372307 dotnet/runtime System.Globalization.Calendars.IOS.Tests.WorkItemExecution
372186 dotnet/runtime System.Globalization.Calendars.IOS.Tests.WorkItemExecution
372071 dotnet/runtime System.Globalization.Calendars.IOS.Tests.WorkItemExecution
371961 dotnet/runtime System.Globalization.Calendars.IOS.Tests.WorkItemExecution #90023

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 7 7
@ivanpovazan ivanpovazan added blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' os-ios Apple iOS Known Build Error Use this to report build issues in the .NET Helix tab labels Aug 13, 2023
@ivanpovazan ivanpovazan added this to the 8.0.0 milestone Aug 13, 2023
@ghost
Copy link

ghost commented Aug 13, 2023

Tagging subscribers to 'os-ios': @steveisok, @akoeplinger, @kotlarmilos
See info in area-owners.md if you want to be subscribed.

Issue Details

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=371961

Affected pipelines:

  • runtime-extra-platforms

Build error legs:

  • net8.0-maccatalyst-Release-arm64-Mono_Release-OSX.1200.Arm64.Open
  • net8.0-maccatalyst-Release-x64-Mono_Release-OSX.1200.Amd64.Open
  • net8.0-tvos-Release-arm64-Mono_Release-OSX.13.Amd64.AppleTV.Open
  • net8.0-iossimulator-Release-x64-Mono_Release-OSX.1200.Amd64.Open
  • net8.0-tvossimulator-Release-x64-Mono_Release-OSX.1200.Amd64.Open

Work items failing:

  • System.Globalization.Calendars.IOS.Tests

Crash log example:

[FAIL] System.Globalization.Tests.JapaneseCalendarTests.GetEra_Invalid_ThrowsArgumentOutOfRangeException   Test name: System.Globalization.Tests.JapaneseCalendarTests.GetEra_Invalid_ThrowsArgumentOutOfRangeException
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]    Assembly:  [System.Globalization.Calendars.IOS.Tests, Version=8.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51]
   Exception messages: Assert.All() Failure: 1 out of 1 items in the collection did not pass.
[0]: Item: 9/7/68 12:00:00 AM
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]      Xunit.Sdk.ThrowsException: Assert.Throws() Failure
     Expected: typeof(System.ArgumentOutOfRangeException)
     Actual:   (No exception was thrown)
        at Xunit.Assert.Throws(Type exceptionType, Exception exception) in /_/src/xunit.assert/Asserts/ExceptionAsserts.cs:line 226
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at Xunit.Assert.Throws[ArgumentOutOfRangeException](Func`1 testCode) in /_/src/xunit.assert/Asserts/ExceptionAsserts.cs:line 48
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at System.Globalization.Tests.CalendarTestBase.<>c__DisplayClass48_0.<GetEra_Invalid_ThrowsArgumentOutOfRangeException>b__0(DateTime dt)
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at Xunit.Assert.<>c__DisplayClass11_0`1[[System.DateTime, System.Private.CoreLib, Version=8.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].<All>b__0(DateTime item, Int32 index) in /_/src/xunit.assert/Asserts/CollectionAsserts.cs:line 34
2023-08-11 15:51:13.586 Df System.Globalization.Calendars.IOS.Tests[89155:3cbb9a]         at Xunit.Assert.All[DateTime](IEnumerable`1 collection, Action`2 action) in /_/src/xunit.assert/Asserts/CollectionAsserts.cs:line 61   Exception stack traces:    at System.Globalization.Tests.CalendarTestBase.GetEra_Invalid_ThrowsArgumentOutOfRangeException()
   at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

Pull request: #90023

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "[FAIL] System.Globalization.Tests.JapaneseCalendarTests.GetEra_Invalid_ThrowsArgumentOutOfRangeException",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}
Author: ivanpovazan
Assignees: -
Labels:

blocking-clean-ci, os-ios, Known Build Error

Milestone: 8.0.0

@mdh1418
Copy link
Member

mdh1418 commented Aug 15, 2023

I believe this should be fixed by #90515
Looking at the tvos lane https://helix.dot.net/api/jobs/3c99382b-fad6-45d8-994b-f42abe817a4a/workitems/System.Globalization.Calendars.Tests?api-version=2019-06-17 the GetEra_Invalid_ThrowsArgumentOutOfRangeException is passing

@mdh1418 mdh1418 closed this as completed Aug 15, 2023
@ghost ghost locked as resolved and limited conversation to collaborators Sep 14, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-System.Globalization blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab os-ios Apple iOS
Projects
None yet
Development

No branches or pull requests

2 participants