[Perf] Windows/arm64: 5 Regressions on 1/15/2023 10:11:50 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	2eca2d319bf8d1247edf38facfdd501e0e2f0030
Compare	51a8dd5323721b363e61069575511f783e7ea6d3
Diff	Diff

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterInt32 - Duration of single invocation	9.61 ns	19.61 ns	2.04	0.11	False
FormatterInt64 - Duration of single invocation	9.61 ns	19.56 ns	2.04	0.09	False
FormatterInt32 - Duration of single invocation	1.56 ns	2.61 ns	1.67	0.67	False
FormatterInt64 - Duration of single invocation	44.53 ns	59.28 ns	1.33	0.04	False
FormatterInt32 - Duration of single invocation	20.73 ns	33.16 ns	1.60	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 12345)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.612743086065763 > 10.087500215865175.
IsChangePoint: Marked as a change because one of 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -108.42492564011535 (T) = (0 -19.25528713101772) / Math.Sqrt((0.029183442326246305 / (31)) + (0.08548722067558617 / (12))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (12) - 2, .025) and -1.0230506405576463 = (9.517946187303583 - 19.25528713101772) / 9.517946187303583 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.55835916247563 > 9.904151439489565.
IsChangePoint: Marked as a change because one of 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -135.2137110915094 (T) = (0 -19.2289044767067) / Math.Sqrt((0.03296451036525167 / (31)) + (0.04972602500843335 / (12))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (12) - 2, .025) and -1.030131993588728 = (9.471750870107298 - 19.2289044767067) / 9.471750870107298 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.6073193842664755 > 1.6430315492172063.
IsChangePoint: Marked as a change because one of 10/10/2022 3:36:43 PM, 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -7.219815895997228 (T) = (0 -2.514162743820369) / Math.Sqrt((0.08744409944099413 / (31)) + (0.2077620067953083 / (12))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (12) - 2, .025) and -0.687691963619603 = (1.4897047553797846 - 2.514162743820369) / 1.4897047553797846 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 9223372036854775807)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.280478118201955 > 47.26740183358842.
IsChangePoint: Marked as a change because one of 10/10/2022 11:56:05 PM, 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -102.12379839808794 (T) = (0 -59.34709193246521) / Math.Sqrt((0.1677474002308198 / (31)) + (0.17048104342190432 / (12))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (12) - 2, .025) and -0.31755908297505414 = (45.04321111616431 - 59.34709193246521) / 45.04321111616431 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.15993939597187 > 21.750757743155706.
IsChangePoint: Marked as a change because one of 1/15/2023 4:47:52 PM, 1/19/2023 1:09:52 AM falls between 1/10/2023 12:53:48 PM and 1/19/2023 1:09:52 AM.
IsRegressionStdDev: Marked as regression because -104.11450957788043 (T) = (0 -33.65308042187556) / Math.Sqrt((0.030939266582181636 / (31)) + (0.17434069816568531 / (12))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (12) - 2, .025) and -0.6273343403106559 = (20.679880949019505 - 33.65308042187556) / 20.679880949019505 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[cincuranet]

dotnet/runtime#80745