[Perf] Windows/x64: 5 Regressions on 10/6/2022 2:13:23 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	01cc57335aa6dacd28c928940642d0dc05c2bf32
Compare	d462be072d71d98534da318d3418465f788ecea1
Diff	Diff

Regressions in System.Globalization.Tests.Perf_DateTimeCultureInfo

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	194.19 ns	210.47 ns	1.08	0.07	False
ToString - Duration of single invocation	187.62 ns	207.80 ns	1.11	0.09	False
ToString - Duration of single invocation	195.20 ns	208.90 ns	1.07	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.Perf_DateTimeCultureInfo*'

Related Issues

Regressions

• [Perf] Windows/x64: 14 Regressions on 10/6/2022 2:13:23 PM
• [Perf] Windows/x86: 5 Regressions on 10/6/2022 2:13:23 PM
• [Perf] Alpine/x64: 1 Regression on 10/6/2022 2:13:23 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: fr)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 210.46560893095906 > 203.9897864236446.
IsChangePoint: Marked as a change because one of 7/31/2022 12:39:41 PM, 9/13/2022 12:23:36 PM, 10/1/2022 2:31:50 PM, 10/6/2022 11:18:47 AM, 10/11/2022 2:16:14 AM falls between 10/2/2022 5:38:34 AM and 10/11/2022 2:16:14 AM.
IsRegressionStdDev: Marked as regression because -18.044270805564285 (T) = (0 -210.5363895306895) / Math.Sqrt((59.16698447742792 / (45)) + (0.22375518468746255 / (10))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (10) - 2, .025) and -0.11001130831522411 = (189.67049069999274 - 210.5363895306895) / 189.67049069999274 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: )

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 207.80460215601198 > 196.85485405723975.
IsChangePoint: Marked as a change because one of 8/15/2022 4:29:54 PM, 9/9/2022 3:12:19 AM, 9/13/2022 12:23:36 PM, 10/5/2022 3:28:28 PM, 10/11/2022 2:16:14 AM falls between 10/2/2022 5:38:34 AM and 10/11/2022 2:16:14 AM.
IsRegressionStdDev: Marked as regression because -5.779015063403081 (T) = (0 -209.2307572376272) / Math.Sqrt((53.10458941339459 / (40)) + (246.58220992993773 / (15))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (15) - 2, .025) and -0.1317596988888793 = (184.87206908237002 - 209.2307572376272) / 184.87206908237002 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ja)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 208.89898238655147 > 204.85787790760844.
IsChangePoint: Marked as a change because one of 7/31/2022 12:39:41 PM, 9/13/2022 12:23:36 PM, 10/1/2022 2:31:50 PM, 10/6/2022 11:18:47 AM, 10/11/2022 2:16:14 AM falls between 10/2/2022 5:38:34 AM and 10/11/2022 2:16:14 AM.
IsRegressionStdDev: Marked as regression because -17.06975438213625 (T) = (0 -210.68306914381304) / Math.Sqrt((47.94691626607332 / (45)) + (1.7093960104525272 / (10))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (10) - 2, .025) and -0.09901110100922426 = (191.70240314255454 - 210.68306914381304) / 191.70240314255454 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	01cc57335aa6dacd28c928940642d0dc05c2bf32
Compare	d462be072d71d98534da318d3418465f788ecea1
Diff	Diff

Regressions in System.Threading.Channels.Tests.UnboundedChannelPerfTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryWriteThenTryRead - Duration of single invocation	24.81 ns	27.97 ns	1.13	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'

Related Issues

Regressions

• [Perf] Windows/x64: 14 Regressions on 10/6/2022 2:13:23 PM
• [Perf] Windows/x86: 5 Regressions on 10/6/2022 2:13:23 PM
• [Perf] Alpine/x64: 1 Regression on 10/6/2022 2:13:23 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 27.967318139473658 > 25.85076348902049.
IsChangePoint: Marked as a change because one of 9/29/2022 5:24:34 PM, 10/6/2022 11:18:47 AM, 10/11/2022 2:16:14 AM falls between 10/2/2022 5:38:34 AM and 10/11/2022 2:16:14 AM.
IsRegressionStdDev: Marked as regression because -5.287690699456895 (T) = (0 -27.025813163954535) / Math.Sqrt((1.0014488572094766 / (45)) + (0.6052278024811094 / (11))) is less than -2.0048792881871513 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (11) - 2, .025) and -0.057516758078730884 = (25.55591952325591 - 27.025813163954535) / 25.55591952325591 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.19042
Baseline	01cc57335aa6dacd28c928940642d0dc05c2bf32
Compare	d462be072d71d98534da318d3418465f788ecea1
Diff	Diff

Regressions in Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ForEach_Array - Duration of single invocation	3.82 ns	5.76 ns	1.51	0.14	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark*'

Related Issues

Regressions

• [Perf] Windows/x64: 14 Regressions on 10/6/2022 2:13:23 PM
• [Perf] Windows/x86: 5 Regressions on 10/6/2022 2:13:23 PM
• [Perf] Alpine/x64: 1 Regression on 10/6/2022 2:13:23 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.ForEach_Array

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 5.759813537652099 > 3.999967353137931.
IsChangePoint: Marked as a change because one of 9/29/2022 5:24:34 PM, 10/6/2022 11:18:47 AM, 10/11/2022 2:16:14 AM falls between 10/2/2022 5:38:34 AM and 10/11/2022 2:16:14 AM.
IsRegressionStdDev: Marked as regression because -18.12187774509571 (T) = (0 -5.933236934587552) / Math.Sqrt((0.10657869587000462 / (45)) + (0.06835137401448338 / (11))) is less than -2.0048792881871513 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (45) + (11) - 2, .025) and -0.39460356268725044 = (4.2544254821455105 - 5.933236934587552) / 4.2544254821455105 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository