[Perf] Linux/arm64: 2158 Regressions on 1/6/2023 2:21:07 AM #11536

performanceautofiler · 2023-01-11T05:24:38Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
GetConverter - Duration of single invocation	644.61 ns	871.65 ns	1.35	0.40	False
GetConverter - Duration of single invocation	642.35 ns	863.57 ns	1.34	0.38	False
GetConverter - Duration of single invocation	663.66 ns	854.69 ns	1.29	0.39	False
GetConverter - Duration of single invocation	928.18 ns	1.07 μs	1.15	0.40	False
GetConverter - Duration of single invocation	695.87 ns	837.48 ns	1.20	0.36	False
GetConverter - Duration of single invocation	718.07 ns	815.34 ns	1.14	0.38	False
GetConverter - Duration of single invocation	426.80 ns	560.68 ns	1.31	0.42	False
GetConverter - Duration of single invocation	350.07 ns	502.14 ns	1.43	0.43	False
GetConverter - Duration of single invocation	919.20 ns	1.15 μs	1.25	0.40	False
GetConverter - Duration of single invocation	422.54 ns	606.70 ns	1.44	0.43	False
GetConverter - Duration of single invocation	477.20 ns	561.71 ns	1.18	0.37	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.ComponentModel.Tests.Perf_TypeDescriptorTests*'

Payloads

Baseline
Compare

Histogram

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.Enum))

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 871.6467839054586 > 674.3013920130566.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -21.527689179030972 (T) = (0 -845.2304648776568) / Math.Sqrt((791.9466825601032 / (21)) + (634.8907341710772 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3022945298015715 = (649.0317248022559 - 845.2304648776568) / 649.0317248022559 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(int))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 863.5737343942586 > 675.0002689472325.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -19.89942592332894 (T) = (0 -860.2830840288974) / Math.Sqrt((555.362627697096 / (21)) + (1111.62906030217 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3123013806654391 = (655.5529824960382 - 860.2830840288974) / 655.5529824960382 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.Guid))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 854.6913994536106 > 694.6000221835164.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -26.499720323842933 (T) = (0 -853.5025444029379) / Math.Sqrt((453.3928816906829 / (21)) + (521.584422788951 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3126368383725513 = (650.2198623810813 - 853.5025444029379) / 650.2198623810813 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.SomeEnum))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0662050748082719 > 912.0497205855969.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -15.209869303185206 (T) = (0 -1130.9730479763052) / Math.Sqrt((2540.273772816824 / (21)) + (2395.9099447435315 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.29844466619325216 = (871.0213668881739 - 1130.9730479763052) / 871.0213668881739 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(int?))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 837.4789789587268 > 713.3046960099939.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -19.970750119078275 (T) = (0 -851.6808968599751) / Math.Sqrt((897.8501043521685 / (21)) + (647.8352291488357 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.28410850821008254 = (663.2468295433476 - 851.6808968599751) / 663.2468295433476 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.SomeValueType?))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 815.3421257191823 > 703.5039023223472.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -21.181636826159018 (T) = (0 -832.4604272790126) / Math.Sqrt((967.4962063293524 / (21)) + (340.6535010921261 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.271452320119778 = (654.7319267155768 - 832.4604272790126) / 654.7319267155768 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassWithNoConverter))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 560.6836450155083 > 471.33896703701055.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -20.480044042857408 (T) = (0 -582.4159871492266) / Math.Sqrt((363.34205219834985 / (21)) + (309.32028608666764 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2832221468780928 = (453.86996208424745 - 582.4159871492266) / 453.86996208424745 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.IDerived))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 502.1433727929373 > 375.4011056521884.
IsChangePoint: Marked as a change because one of 12/11/2022 2:11:02 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -24.38629278682392 (T) = (0 -483.3773888994253) / Math.Sqrt((144.70907924178218 / (21)) + (238.88938616146683 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.32787632255399096 = (364.02289933878336 - 483.3773888994253) / 364.02289933878336 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.DerivedClass))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1453883145942747 > 979.1227697001975.
IsChangePoint: Marked as a change because one of 12/9/2022 1:45:57 AM, 12/29/2022 3:42:58 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -15.619845676269872 (T) = (0 -1155.0413264978813) / Math.Sqrt((2185.3203482587414 / (21)) + (1048.9383698302258 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.22088409686318275 = (946.0695978148366 - 1155.0413264978813) / 946.0695978148366 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(string))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 606.7009844087858 > 467.0249767627427.
IsChangePoint: Marked as a change because one of 12/9/2022 1:11:26 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -24.71656926501532 (T) = (0 -594.0592261894566) / Math.Sqrt((289.31833487399956 / (21)) + (308.0973574685929 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.33135839192189287 = (446.2053416975858 - 594.0592261894566) / 446.2053416975858 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.ComponentModel.Tests.ClassIDerived))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 561.7060465870908 > 476.2114354046958.
IsChangePoint: Marked as a change because one of 12/8/2022 6:01:13 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -23.08407162089236 (T) = (0 -574.3819964596721) / Math.Sqrt((392.62184098462205 / (21)) + (173.8283866850109 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.28894404809176216 = (445.62213333466656 - 574.3819964596721) / 445.62213333466656 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

The text was updated successfully, but these errors were encountered:

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Json.Tests.Perf_Segment

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ReadMultiSegmentSequence - Duration of single invocation	13.30 μs	20.05 μs	1.51	0.01	False
ReadSingleSegmentSequenceByN - Duration of single invocation	13.23 μs	19.89 μs	1.50	0.01	False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation	13.47 μs	21.94 μs	1.63	0.01	False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation	131.79 μs	216.14 μs	1.64	0.02	False
ReadSingleSegmentSequenceByN - Duration of single invocation	1.33 ms	1.97 ms	1.49	0.01	False
ReadSingleSegmentSequence - Duration of single invocation	13.22 μs	19.84 μs	1.50	0.01	False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation	1.33 ms	2.17 ms	1.63	0.02	False
ReadSingleSegmentSequence - Duration of single invocation	1.31 ms	1.98 ms	1.51	0.01	False
ReadSingleSegmentSequenceByN - Duration of single invocation	130.14 μs	194.07 μs	1.49	0.01	False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation	13.61 μs	22.24 μs	1.63	0.02	False
ReadMultiSegmentSequence - Duration of single invocation	14.51 μs	23.61 μs	1.63	0.01	False
ReadMultiSegmentSequence - Duration of single invocation	1.45 ms	2.35 ms	1.63	0.01	False
ReadMultiSegmentSequence - Duration of single invocation	1.43 ms	2.32 ms	1.62	0.01	False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation	1.35 ms	2.19 ms	1.63	0.01	False
ReadSingleSegmentSequence - Duration of single invocation	130.35 μs	194.32 μs	1.49	0.04	False
ReadSingleSegmentSequenceByN - Duration of single invocation	13.13 μs	19.84 μs	1.51	0.01	False
ReadMultiSegmentSequenceUsingSpan - Duration of single invocation	132.55 μs	218.32 μs	1.65	0.01	False
ReadSingleSegmentSequenceByN - Duration of single invocation	1.34 ms	1.98 ms	1.47	0.01	False
ReadMultiSegmentSequence - Duration of single invocation	140.86 μs	228.72 μs	1.62	0.01	False
ReadMultiSegmentSequence - Duration of single invocation	142.88 μs	230.05 μs	1.61	0.01	False
ReadSingleSegmentSequenceByN - Duration of single invocation	132.62 μs	198.85 μs	1.50	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Segment*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json4KB)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.05179020700637 > 13.962653266763905.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -217.73457894485912 (T) = (0 -19944.51655577445) / Math.Sqrt((9996.928403273914 / (21)) + (6221.936755754028 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.49524595661404935 = (13338.619287049174 - 19944.51655577445) / 13338.619287049174 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.88644475941517 > 13.903558027783395.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -189.73099872454978 (T) = (0 -20001.167359116553) / Math.Sqrt((11280.158876927571 / (21)) + (10027.129020000586 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5056452554233557 = (13284.116751321111 - 20001.167359116553) / 13284.116751321111 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.940110378681627 > 14.24616351173867.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -259.3464792887817 (T) = (0 -21875.67403100655) / Math.Sqrt((16324.388018406451 / (21)) + (3565.0389178009095 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6151272563692368 = (13544.241758499256 - 21875.67403100655) / 13544.241758499256 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json40KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 216.14172602739725 > 138.10853811825982.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -239.1495723396819 (T) = (0 -214291.60449344633) / Math.Sqrt((1199694.9998831865 / (21)) + (850669.9273145547 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6212207579145996 = (132179.16403259776 - 214291.60449344633) / 132179.16403259776 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9734660020833334 > 1.3928393788020834.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -211.24037445689305 (T) = (0 -1982244.0237856081) / Math.Sqrt((85265860.47889756 / (21)) + (78100514.75346646 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4944368482067808 = (1326415.382599915 - 1982244.0237856081) / 1326415.382599915 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.844480089662447 > 13.880458925049547.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -218.1812282059725 (T) = (0 -19868.43917323849) / Math.Sqrt((9837.040175256174 / (21)) + (6277.992948000548 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4981499402469478 = (13261.98308959881 - 19868.43917323849) / 13261.98308959881 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 8192, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.1679278208333335 > 1.3996404019791666.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -225.9399535679069 (T) = (0 -2157314.013699777) / Math.Sqrt((107785459.81741878 / (21)) + (111433859.06055655 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6101856189579714 = (1339792.1260133218 - 2157314.013699777) / 1339792.1260133218 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9839560088541666 > 1.3821044633593749.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -162.63300763905036 (T) = (0 -1969478.114243197) / Math.Sqrt((226393816.995681 / (21)) + (71729905.65170242 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.49101670422582316 = (1320896.0762554328 - 1969478.114243197) / 1320896.0762554328 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json40KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 194.06709352954147 > 136.3719308961777.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -167.31664734917243 (T) = (0 -196228.4078614817) / Math.Sqrt((1329774.057945638 / (21)) + (1273310.1982364936 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.503546403000965 = (130510.37697927024 - 196228.4078614817) / 130510.37697927024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.237619001116073 > 14.50140462902704.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -221.3261716277037 (T) = (0 -22156.551376739488) / Math.Sqrt((15185.899110004742 / (21)) + (10291.911074578928 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6167131937559469 = (13704.688909765995 - 22156.551376739488) / 13704.688909765995 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.609475339879154 > 15.265649012440994.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -321.39400992908816 (T) = (0 -23430.417835922297) / Math.Sqrt((5137.0463724511155 / (21)) + (7274.8286522790195 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6108421246541109 = (14545.44643284233 - 23430.417835922297) / 14545.44643284233 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.3532333255952382 > 1.5135888100852273.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -348.4482186318647 (T) = (0 -2334397.837424703) / Math.Sqrt((59050496.101819396 / (21)) + (53771652.07292564 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6260246914771751 = (1435647.2258142652 - 2334397.837424703) / 1435647.2258142652 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.317401645408163 > 1.4973947045312497.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -460.8337177360483 (T) = (0 -2314529.820845246) / Math.Sqrt((20443515.090499096 / (21)) + (38599497.266199544 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6248704714978363 = (1424439.5854591834 - 2314529.820845246) / 1424439.5854591834 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.1942296765625002 > 1.4129859564843752.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -172.16919878674187 (T) = (0 -2185219.693076371) / Math.Sqrt((102484821.01171705 / (21)) + (259767019.79700407 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6165817316049232 = (1351753.3016452629 - 2185219.693076371) / 1351753.3016452629 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequence(TestCase: Json40KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 194.32315787037035 > 136.08285360278927.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -182.12962330433047 (T) = (0 -194835.90138564055) / Math.Sqrt((1155733.7558286393 / (21)) + (985290.5786590577 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4948613192419298 = (130337.10811678854 - 194835.90138564055) / 130337.10811678854 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 8192, TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.835687181933846 > 13.817540363445712.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -191.41698962340394 (T) = (0 -19901.800480164162) / Math.Sqrt((7174.73085631977 / (21)) + (12396.786175730664 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5081279903514462 = (13196.36039347453 - 19901.800480164162) / 13196.36039347453 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequenceUsingSpan(segmentSize: 4096, TestCase: Json40KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 218.32299594907408 > 139.02603790020567.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -225.25817429402167 (T) = (0 -216261.02234458804) / Math.Sqrt((955737.3526735405 / (21)) + (1273994.8527746832 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6256069760718382 = (133034.0146959551 - 216261.02234458804) / 133034.0146959551 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.9800831161458334 > 1.400740612578125.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -175.54147882745713 (T) = (0 -1992058.2385735544) / Math.Sqrt((86987159.23406735 / (21)) + (137560248.4864252 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4910685118148826 = (1335993.767415075 - 1992058.2385735544) / 1335993.767415075 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json40KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 228.7219004830918 > 147.87764158906955.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -438.71034455593843 (T) = (0 -228992.7190603687) / Math.Sqrt((325694.52775819314 / (21)) + (350873.0713814378 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6283819098939206 = (140625.92913187435 - 228992.7190603687) / 140625.92913187435 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 4096, TestCase: Json40KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 230.05102686651583 > 149.86013101420454.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -365.9439890926763 (T) = (0 -231090.11926535034) / Math.Sqrt((459845.2454151561 / (21)) + (523421.0995238739 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6275270591388461 = (141988.49596247223 - 231090.11926535034) / 141988.49596247223 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Segment.ReadSingleSegmentSequenceByN(numberOfBytes: 4096, TestCase: Json40KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 198.8522930040687 > 138.88419429440046.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -130.7664041979499 (T) = (0 -197403.2917513144) / Math.Sqrt((1337882.9268764032 / (21)) + (2686839.0575929983 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.503583816058525 = (131288.5185667832 - 197403.2917513144) / 131288.5185667832 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in ByteMark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
BenchFourier - Duration of single invocation	427.95 ms	683.04 ms	1.60	0.03	False
BenchAssignRectangular - Duration of single invocation	1.92 secs	2.88 secs	1.51	0.01	False
BenchLUDecomp - Duration of single invocation	1.77 secs	4.66 secs	2.64	0.00	False
BenchNeuralJagged - Duration of single invocation	1.22 secs	2.24 secs	1.84	0.00	False
BenchIDEAEncryption - Duration of single invocation	673.09 ms	1.88 secs	2.79	0.00	False
BenchNeural - Duration of single invocation	1.18 secs	1.87 secs	1.58	0.00	False
BenchNumericSortRectangular - Duration of single invocation	824.64 ms	2.39 secs	2.90	0.01	False
BenchNumericSortJagged - Duration of single invocation	875.71 ms	2.48 secs	2.83	0.00	False
BenchEmFloatClass - Duration of single invocation	394.44 ms	1.22 secs	3.09	0.00	False
BenchEmFloat - Duration of single invocation	1.96 secs	6.06 secs	3.09	0.00	False
BenchAssignJagged - Duration of single invocation	1.62 secs	2.64 secs	1.64	0.00	False
BenchStringSort - Duration of single invocation	2.11 secs	2.96 secs	1.41	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'ByteMark*'

Payloads

Baseline
Compare

Histogram

ByteMark.BenchFourier

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 683.0355489333333 > 448.7768218875.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -17.892010995266638 (T) = (0 -726994954.757823) / Math.Sqrt((40434365482.42056 / (21)) + (3921439190460172.5 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7003806277546325 = (427548363.52012914 - 726994954.757823) / 427548363.52012914 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchAssignRectangular

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.8830359175333333 > 2.0054236778099996.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -232.2678196494372 (T) = (0 -2892466412.357849) / Math.Sqrt((31373616223032.742 / (21)) + (232102960701635.38 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5183170295448115 = (1905047731.1876063 - 2892466412.357849) / 1905047731.1876063 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchLUDecomp

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.663821565066667 > 1.8563508946150002.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -738.8104186043134 (T) = (0 -4684160786.534903) / Math.Sqrt((6963739798219.795 / (21)) + (213452888151004.22 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6492186494502734 = (1768129175.5615907 - 4684160786.534903) / 1768129175.5615907 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchNeuralJagged

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.240679728923077 > 1.2772067646800003.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -627.8781191297634 (T) = (0 -2247831593.6431975) / Math.Sqrt((2103477316752.5464 / (21)) + (36320451943947.64 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8467581047127749 = (1217177056.3274724 - 2247831593.6431975) / 1217177056.3274724 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchIDEAEncryption

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.8802587363333332 > 706.7729476150001.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -423.5983284388753 (T) = (0 -1877092025.9677262) / Math.Sqrt((180651899977.80197 / (21)) + (112907540664746.44 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7871152017292353 = (673489213.7946451 - 1877092025.9677262) / 673489213.7946451 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchNeural

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.8699729128333333 > 1.23890232711.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -565.8600920859872 (T) = (0 -1876011615.771324) / Math.Sqrt((13094862837017.273 / (21)) + (12410025338731.402 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5889352242022894 = (1180672180.4617043 - 1876011615.771324) / 1180672180.4617043 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchNumericSortRectangular

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.3882145921666664 > 865.8890767701923.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -844.2693587003529 (T) = (0 -2393463889.613135) / Math.Sqrt((615847156171.2582 / (21)) + (47940859781243.97 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.903038348402945 = (824468574.7709315 - 2393463889.613135) / 824468574.7709315 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchNumericSortJagged

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.4785508588333336 > 919.7092907150002.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -336.2042127773754 (T) = (0 -2532095265.0006804) / Math.Sqrt((23450052604817.457 / (21)) + (323725918651649.75 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.887801152034823 = (876824660.5956568 - 2532095265.0006804) / 876824660.5956568 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchEmFloatClass

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2203388169285714 > 415.23698084.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1411.9559611901088 (T) = (0 -1220769901.3148873) / Math.Sqrt((1918210091767.0066 / (21)) + (3511998460501.14 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.0920801501980226 = (394805387.3172423 - 1220769901.3148873) / 394805387.3172423 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchEmFloat

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.061069192600001 > 2.05053197846.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -803.012434665738 (T) = (0 -6043073064.241052) / Math.Sqrt((26902748248874.836 / (21)) + (345275185138368 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.094345365553846 = (1952940719.3884525 - 6043073064.241052) / 1952940719.3884525 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchAssignJagged

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.642208855 > 1.6785204553250002.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -140.27762688552522 (T) = (0 -2629478422.344453) / Math.Sqrt((32814935870045.492 / (21)) + (738303536632982 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6477424925605624 = (1595806647.1043606 - 2629478422.344453) / 1595806647.1043606 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchStringSort

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.9612103039333335 > 2.2205858528350007.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -72.02441899867463 (T) = (0 -2963056544.6375723) / Math.Sqrt((2322125929538067 / (21)) + (328859460360659.06 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.39169178100342655 = (2129104004.9839 - 2963056544.6375723) / 2129104004.9839 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Xml.Linq.Perf_XName

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
CreateElement - Duration of single invocation	118.78 ns	159.79 ns	1.35	0.16	False
CreateElementWithNamespaceImplicitOperator - Duration of single invocation	259.13 ns	369.28 ns	1.43	0.11	False
NonEmptyNameSpaceToString - Duration of single invocation	48.74 ns	79.02 ns	1.62	0.24	False
CreateElementWithNamespace - Duration of single invocation	238.32 ns	340.77 ns	1.43	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Linq.Perf_XName*'

Payloads

Baseline
Compare

Histogram

System.Xml.Linq.Perf_XName.CreateElement

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 159.78557662072217 > 124.47309485947802.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -40.19555622344893 (T) = (0 -159.44136960127477) / Math.Sqrt((11.21458019933052 / (21)) + (6.445653776636974 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3358260327968906 = (119.35788469958459 - 159.44136960127477) / 119.35788469958459 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XName.CreateElementWithNamespaceImplicitOperator

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 369.2826209631672 > 268.92927461433027.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -43.611686380060796 (T) = (0 -361.0799004567865) / Math.Sqrt((33.22514627809186 / (21)) + (60.17957296023364 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.41421952447723387 = (255.32096976971073 - 361.0799004567865) / 255.32096976971073 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XName.NonEmptyNameSpaceToString

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 79.02112097864884 > 51.379747541572996.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -59.26513007781823 (T) = (0 -80.14630822220705) / Math.Sqrt((2.2954866091149446 / (21)) + (1.9597133561756244 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5852993598868383 = (50.555945615172675 - 80.14630822220705) / 50.555945615172675 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XName.CreateElementWithNamespace

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 340.7738110815468 > 253.63408300364537.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -47.87918544967392 (T) = (0 -343.87017824639145) / Math.Sqrt((26.766045929774787 / (21)) + (45.2632327218721 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4196801184029822 = (242.2166611963375 - 343.87017824639145) / 242.2166611963375 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString - Duration of single invocation	46.64 ns	198.39 ns	4.25	0.06	False
TryParse - Duration of single invocation	54.43 ns	87.52 ns	1.61	0.12	False
Parse - Duration of single invocation	56.87 ns	91.92 ns	1.62	0.15	False
TryFormat - Duration of single invocation	19.64 ns	101.38 ns	5.16	0.03	False
TryFormat - Duration of single invocation	35.02 ns	211.18 ns	6.03	0.01	False
ParseSpan - Duration of single invocation	57.46 ns	95.71 ns	1.67	0.23	False
TryParseSpan - Duration of single invocation	53.25 ns	86.52 ns	1.62	0.22	False
Parse - Duration of single invocation	32.09 ns	47.19 ns	1.47	0.34	False
ParseSpan - Duration of single invocation	33.15 ns	50.83 ns	1.53	0.25	False
TryFormat - Duration of single invocation	52.14 ns	311.68 ns	5.98	0.02	False
ToString - Duration of single invocation	27.53 ns	86.78 ns	3.15	0.24	False
TryParseSpan - Duration of single invocation	28.48 ns	41.37 ns	1.45	0.50	False
TryParseSpan - Duration of single invocation	53.66 ns	85.83 ns	1.60	0.23	False
TryParse - Duration of single invocation	54.58 ns	88.34 ns	1.62	0.11	False
TryParse - Duration of single invocation	28.25 ns	44.78 ns	1.59	0.37	False
ParseSpan - Duration of single invocation	57.77 ns	96.21 ns	1.67	0.28	False
ToString - Duration of single invocation	58.92 ns	282.00 ns	4.79	0.23	False
Parse - Duration of single invocation	54.75 ns	92.12 ns	1.68	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Int64.ToString(value: 9223372036854775807)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 198.3856064378848 > 49.58433225805003.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -416.27955305960757 (T) = (0 -196.7521108603024) / Math.Sqrt((0.35535488890536077 / (21)) + (1.5751522026724176 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.1872550969178057 = (46.98832679316088 - 196.7521108603024) / 46.98832679316088 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryParse(value: "9223372036854775807")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 87.51619543438251 > 56.401227360079496.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -92.54009314633193 (T) = (0 -85.95761506272105) / Math.Sqrt((0.958303861089014 / (21)) + (1.1192089481710812 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6168289005860168 = (53.16432371512277 - 85.95761506272105) / 53.16432371512277 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.Parse(value: "-9223372036854775808")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 91.9216903350223 > 59.42747631814491.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -88.99047047122126 (T) = (0 -92.8689781455037) / Math.Sqrt((2.718467070344178 / (21)) + (0.6666686118886976 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6756678797522013 = (55.42206738440151 - 92.8689781455037) / 55.42206738440151 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryFormat(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.37515197996537 > 20.658156492684597.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -128.06081076561304 (T) = (0 -104.12926009795706) / Math.Sqrt((0.10274502184685015 / (21)) + (5.992278441185513 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.240458537922748 = (19.870257410572428 - 104.12926009795706) / 19.870257410572428 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryFormat(value: 9223372036854775807)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 211.1816800292062 > 36.842332736766075.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -372.9470893326076 (T) = (0 -211.80058170717072) / Math.Sqrt((0.05073517753665994 / (21)) + (3.1052004490944936 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.016254782907018 = (35.20472276355788 - 211.80058170717072) / 35.20472276355788 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ParseSpan(value: "-9223372036854775808")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 95.70554690112407 > 60.27808818866398.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -72.0452367959405 (T) = (0 -97.3849343827359) / Math.Sqrt((5.086232982552856 / (21)) + (0.8000278470406724 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.680002362616822 = (57.96714132654326 - 97.3849343827359) / 57.96714132654326 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryParseSpan(value: "-9223372036854775808")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.51855167053091 > 56.91368259818956.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -117.61207324790217 (T) = (0 -88.12447669345521) / Math.Sqrt((0.6833431904123354 / (21)) + (0.72335723928487 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6320866079604613 = (53.994975673245705 - 88.12447669345521) / 53.994975673245705 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.Parse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.19466098386985 > 33.41472121473973.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -41.09904012929182 (T) = (0 -47.843246299299736) / Math.Sqrt((2.720285154939745 / (21)) + (0.5235908287053692 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5407934402976483 = (31.05104490194185 - 47.843246299299736) / 31.05104490194185 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ParseSpan(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.83487883113268 > 34.73481977367526.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -35.98657015752525 (T) = (0 -51.277195609868436) / Math.Sqrt((4.492063421116964 / (21)) + (0.48899499409582703 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5386613937279625 = (33.325847921374645 - 51.277195609868436) / 33.325847921374645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryFormat(value: -9223372036854775808)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 311.6803974121996 > 54.722440410453856.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -507.51545447306387 (T) = (0 -307.7360910315514) / Math.Sqrt((0.17247387259111974 / (21)) + (3.435192982757987 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.899179190507407 = (52.165916832419875 - 307.7360910315514) / 52.165916832419875 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ToString(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.78466826973401 > 27.997005999844827.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -163.28424671568578 (T) = (0 -85.27522633408383) / Math.Sqrt((1.3198263563936006 / (21)) + (0.961206790443708 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.2719997808497125 = (26.06211248337508 - 85.27522633408383) / 26.06211248337508 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryParseSpan(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.367852257096196 > 31.23179709810372.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -33.6793173676102 (T) = (0 -42.24567182317787) / Math.Sqrt((1.2640646878912078 / (21)) + (1.1095542439359145 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4239033243951438 = (29.66891859819437 - 42.24567182317787) / 29.66891859819437 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryParseSpan(value: "9223372036854775807")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.83214406909089 > 55.42219809166546.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -98.74714497637777 (T) = (0 -87.09229856020796) / Math.Sqrt((0.913238867864924 / (21)) + (1.0182365055904752 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.630070797516562 = (53.42853739413921 - 87.09229856020796) / 53.42853739413921 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryParse(value: "-9223372036854775808")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 88.34317124282055 > 55.75201125248574.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -73.02680772295012 (T) = (0 -87.76466138266203) / Math.Sqrt((1.475637690115518 / (21)) + (2.0653172870400724 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6348249350555221 = (53.68444015057879 - 87.76466138266203) / 53.68444015057879 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryParse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.78431062554568 > 30.47844794549019.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.16311412158067 (T) = (0 -42.2619634069054) / Math.Sqrt((2.159158355791466 / (21)) + (1.2750403044010754 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4364781299512372 = (29.420540783548184 - 42.2619634069054) / 29.420540783548184 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ParseSpan(value: "9223372036854775807")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 96.20879938180624 > 65.22599004212978.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -46.23846075974547 (T) = (0 -96.64572297109639) / Math.Sqrt((8.731594195869663 / (21)) + (3.4551370292332333 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6378435635236439 = (59.00790840071046 - 96.64572297109639) / 59.00790840071046 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ToString(value: -9223372036854775808)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 281.99977756289275 > 63.08285749220559.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -385.14237722262163 (T) = (0 -285.0853136018463) / Math.Sqrt((2.00253739565835 / (21)) + (3.4479079592074866 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.753773864796475 = (59.97031447225808 - 285.0853136018463) / 59.97031447225808 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.Parse(value: "9223372036854775807")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 92.11768560109114 > 58.34219006189943.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -95.66517272529096 (T) = (0 -92.17863727443157) / Math.Sqrt((2.00210690214718 / (21)) + (0.7521455326018063 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6685859357699944 = (55.24356600302659 - 92.17863727443157) / 55.24356600302659 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
FormatterDecimal - Duration of single invocation	58.22 ns	226.27 ns	3.89	0.05	False
FormatterUInt32 - Duration of single invocation	5.90 ns	20.27 ns	3.44	0.03	False
FormatterInt64 - Duration of single invocation	45.55 ns	165.70 ns	3.64	0.16	False
FormatterUInt64 - Duration of single invocation	5.87 ns	20.74 ns	3.53	0.02	False
FormatterUInt32 - Duration of single invocation	17.29 ns	94.62 ns	5.47	0.45	False
FormatterUInt32 - Duration of single invocation	25.23 ns	106.73 ns	4.23	0.18	False
FormatterDouble - Duration of single invocation	329.58 ns	856.81 ns	2.60	0.03	False
FormatterInt32 - Duration of single invocation	25.56 ns	113.06 ns	4.42	0.13	False
FormatterDateTimeOffsetNow - Duration of single invocation	35.70 ns	324.00 ns	9.07	0.17	False
FormatterInt32 - Duration of single invocation	6.43 ns	19.09 ns	2.97	0.03	False
FormatterInt32 - Duration of single invocation	17.69 ns	92.35 ns	5.22	0.40	False
FormatterUInt64 - Duration of single invocation	19.42 ns	90.68 ns	4.67	0.41	False
FormatterUInt64 - Duration of single invocation	48.20 ns	165.38 ns	3.43	0.22	False
FormatterInt32 - Duration of single invocation	28.07 ns	100.81 ns	3.59	0.18	False
FormatterDouble - Duration of single invocation	209.34 ns	559.16 ns	2.67	0.05	False
FormatterDouble - Duration of single invocation	328.66 ns	865.11 ns	2.63	0.01	False
FormatterInt64 - Duration of single invocation	17.67 ns	96.15 ns	5.44	0.38	False
FormatterInt64 - Duration of single invocation	46.80 ns	155.35 ns	3.32	0.19	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 226.26579640254937 > 60.97120802835273.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -154.98061993930082 (T) = (0 -231.2045173519634) / Math.Sqrt((1.0891550227210114 / (21)) + (16.667413423087943 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9549936353264354 = (58.45888481003342 - 231.2045173519634) / 58.45888481003342 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.270052938989043 > 6.1597239111815165.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -200.21995296700857 (T) = (0 -20.388843672053962) / Math.Sqrt((0.003836277121399969 / (21)) + (0.07073660221152414 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.4546458514251475 = (5.9018621731205645 - 20.388843672053962) / 5.9018621731205645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 9223372036854775807)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 165.70079840733004 > 47.532265645465074.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -200.217229203544 (T) = (0 -162.6917709847712) / Math.Sqrt((0.9620662640085771 / (21)) + (4.137885732639933 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.559210153108655 = (45.7100772323529 - 162.6917709847712) / 45.7100772323529 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.74445041437576 > 6.171501644872785.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -208.7268421663282 (T) = (0 -20.37434891564081) / Math.Sqrt((0.0027641286829725763 / (21)) + (0.06557017644183152 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.458885961838822 = (5.8904367303307525 - 20.37434891564081) / 5.8904367303307525 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 94.61681042408277 > 18.159502845906715.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -188.6123733830807 (T) = (0 -93.34191945341226) / Math.Sqrt((0.9038889736175733 / (21)) + (1.6299458306747354 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.179122160507976 = (18.02272982961598 - 93.34191945341226) / 18.02272982961598 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 4294967295)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 106.72748808701576 > 26.5889355177841.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -229.87646808931038 (T) = (0 -107.52445594297545) / Math.Sqrt((1.5574205138489279 / (21)) + (0.7286899613964631 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.158309299892898 = (25.857734042473673 - 107.52445594297545) / 25.857734042473673 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: -1.7976931348623157E+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 856.8094662547792 > 345.62705675654263.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -221.11670931443948 (T) = (0 -859.1238313218762) / Math.Sqrt((4.092125606690185 / (21)) + (77.41286026900175 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.602708458101807 = (330.0883849082535 - 859.1238313218762) / 330.0883849082535 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 113.0646048039803 > 26.814438373952797.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -159.88836677796886 (T) = (0 -110.9403629611105) / Math.Sqrt((0.9168500217439111 / (21)) + (3.3200941035034486 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.2322262209136747 = (26.21324030669611 - 110.9403629611105) / 26.21324030669611 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value: 12/30/2017 3:45:22 AM -08:00)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 324.00055867912846 > 37.51958507704437.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -209.66159114360303 (T) = (0 -317.63073285710294) / Math.Sqrt((0.9427032872044858 / (21)) + (24.60108373062089 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -7.780320296048922 = (36.17530137255179 - 317.63073285710294) / 36.17530137255179 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.094436082824775 > 6.678792235902036.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -81.61257513376773 (T) = (0 -20.165991158714174) / Math.Sqrt((0.0022842077320557965 / (21)) + (0.3979295608061583 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.160618146650688 = (6.380394664279235 - 20.165991158714174) / 6.380394664279235 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 92.3478727447437 > 18.59211539240904.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -140.42567166244817 (T) = (0 -96.65241781060107) / Math.Sqrt((0.9301644522396675 / (21)) + (3.725869922552392 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.249177211607847 = (18.412870039302025 - 96.65241781060107) / 18.412870039302025 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 90.6783985073223 > 20.283393428873442.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -236.86848146643214 (T) = (0 -90.76176757219136) / Math.Sqrt((0.9596170804714628 / (21)) + (0.6848411705587072 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.069711391244026 = (17.90274841462324 - 90.76176757219136) / 17.90274841462324 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 18446744073709551615)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 165.38022517417247 > 50.38460443844677.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -277.07003726675543 (T) = (0 -164.76959553502988) / Math.Sqrt((2.8223949832374426 / (21)) + (0.570721725578321 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.375868832472093 = (48.80805615139135 - 164.76959553502988) / 48.80805615139135 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 100.8078182454106 > 27.73033498202523.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -173.99981994311443 (T) = (0 -99.4451897809448) / Math.Sqrt((0.8029348189052298 / (21)) + (1.8926450739686622 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.685289954071697 = (26.984359716681904 - 99.4451897809448) / 26.984359716681904 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 559.1562984039532 > 218.47695091783234.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -135.48756981640125 (T) = (0 -586.914984857979) / Math.Sqrt((5.207858871842032 / (21)) + (106.10497450450023 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8235204847773756 = (207.8663810028122 - 586.914984857979) / 207.8663810028122 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 1.7976931348623157E+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 865.1148950261139 > 341.5986351235767.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -132.38063612013457 (T) = (0 -862.6009391413415) / Math.Sqrt((6.324700837353572 / (21)) + (224.67231951707274 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6352543849945222 = (327.3311844401445 - 862.6009391413415) / 327.3311844401445 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 96.15428916998353 > 18.616592150434425.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -239.26266281522572 (T) = (0 -96.67851920096678) / Math.Sqrt((0.5593214086528587 / (21)) + (1.1347613507849819 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.32306942877261 = (18.16217513121163 - 96.67851920096678) / 18.16217513121163 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt64(value: -9223372036854775808)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 155.34623341881155 > 49.11363867519901.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -169.66317293831236 (T) = (0 -154.03735368448596) / Math.Sqrt((2.0846493248250093 / (21)) + (4.130425627524277 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.242870677785786 = (47.50030728627816 - 154.03735368448596) / 47.50030728627816 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Collections.Concurrent.IsEmpty<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Stack - Duration of single invocation	1.51 ns	8.83 ns	5.84	0.35	False
Bag - Duration of single invocation	30.87 ns	54.57 ns	1.77	0.29	False
Bag - Duration of single invocation	30.76 ns	48.11 ns	1.56	0.27	False
Stack - Duration of single invocation	1.48 ns	8.84 ns	5.97	0.33	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.IsEmpty<String>.Stack(Size: 0)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.830743754398776 > 1.583005748458528.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -197.2334065593479 (T) = (0 -8.715924616172613) / Math.Sqrt((6.454054372146672E-05 / (21)) + (0.01867219360878702 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.7927805784654485 = (1.5046184639849638 - 8.715924616172613) / 1.5046184639849638 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Concurrent.IsEmpty&lt;String&gt;.Bag(Size: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.57330757589564 > 33.75412399014526.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -36.65137428792753 (T) = (0 -56.10511134305013) / Math.Sqrt((0.9102744075012525 / (21)) + (5.494692005811815 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7582862648526324 = (31.908974360186157 - 56.10511134305013) / 31.908974360186157 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Concurrent.IsEmpty&lt;String&gt;.Bag(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.10515653429259 > 32.272015321261854.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -43.216290966377194 (T) = (0 -49.82302382062917) / Math.Sqrt((0.9455108058303056 / (21)) + (2.399103180777352 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6764232082130893 = (29.719836600052716 - 49.82302382062917) / 29.719836600052716 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Concurrent.IsEmpty&lt;String&gt;.Stack(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.836336365279776 > 1.566706331461893.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -82.8441250461387 (T) = (0 -8.81295149032443) / Math.Sqrt((0.00016816823660742246 / (21)) + (0.10912263422282946 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.894191751371286 = (1.4951925322541624 - 8.81295149032443) / 1.4951925322541624 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Memory.ReadOnlySequence

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Slice_StartPosition_And_EndPosition - Duration of single invocation	22.50 ns	34.33 ns	1.53	0.02	False
Slice_Repeat - Duration of single invocation	332.06 ns	357.10 ns	1.08	0.01	False
Slice_StartPosition_And_Length - Duration of single invocation	67.63 ns	73.27 ns	1.08	0.00	False
Slice_Repeat_StartPosition_And_EndPosition - Duration of single invocation	106.80 ns	168.85 ns	1.58	0.03	False
Slice_Start_And_Length - Duration of single invocation	62.03 ns	65.55 ns	1.06	0.01	False
Slice_StartPosition_And_Length - Duration of single invocation	73.58 ns	80.68 ns	1.10	0.02	False
Slice_Start - Duration of single invocation	16.70 ns	21.68 ns	1.30	0.04	False
Slice_Repeat_StartPosition_And_EndPosition - Duration of single invocation	130.12 ns	195.89 ns	1.51	0.02	False
Slice_Start_And_EndPosition - Duration of single invocation	71.97 ns	77.54 ns	1.08	0.02	False
Slice_StartPosition_And_EndPosition - Duration of single invocation	17.74 ns	27.84 ns	1.57	0.06	False
Slice_StartPosition - Duration of single invocation	20.88 ns	35.80 ns	1.71	0.07	False
Slice_Start - Duration of single invocation	16.84 ns	21.45 ns	1.27	0.02	False
Slice_Start_And_EndPosition - Duration of single invocation	64.74 ns	71.65 ns	1.11	0.01	False
Slice_StartPosition - Duration of single invocation	16.94 ns	32.00 ns	1.89	0.14	False
Slice_Start_And_Length - Duration of single invocation	72.63 ns	78.42 ns	1.08	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'

Payloads

Baseline
Compare

Histogram

System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Multiple)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.33218840256031 > 24.07461743938027.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -135.7726665300887 (T) = (0 -34.366606022022594) / Math.Sqrt((0.07741809058600943 / (21)) + (0.04940478090546848 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5050939869372091 = (22.83352821836523 - 34.366606022022594) / 22.83352821836523 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Repeat(Segment: Multiple)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 357.0985681589818 > 349.1967320218454.
IsChangePoint: Marked as a change because one of 11/24/2022 8:21:24 PM, 12/5/2022 9:44:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -49.65354627881071 (T) = (0 -356.79466702340807) / Math.Sqrt((1.1212631894378853 / (21)) + (2.7525277510007156 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.07478708905101088 = (331.96776427454284 - 356.79466702340807) / 331.96776427454284 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Single)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 73.26839488694958 > 70.81965337260073.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -25.49211838339253 (T) = (0 -73.75021130237765) / Math.Sqrt((0.8798103813411 / (21)) + (0.19367796049383956 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.08884939980633978 = (67.73224223248384 - 73.75021130237765) / 67.73224223248384 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Single)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 168.85051818604143 > 113.37263932262749.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -183.75242090277982 (T) = (0 -167.63103215072627) / Math.Sqrt((1.3223133201505899 / (21)) + (0.6076747288475026 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5564552725025743 = (107.70051354010175 - 167.63103215072627) / 107.70051354010175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment: Single)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 65.55061722673187 > 65.13612899912144.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -20.576683164715586 (T) = (0 -65.68161959798711) / Math.Sqrt((0.5021977995916567 / (21)) + (0.11113490841763889 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.05922293063426993 = (62.009250081714626 - 65.68161959798711) / 62.009250081714626 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Multiple)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 80.68103150742964 > 77.02921130351433.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -59.43906371426992 (T) = (0 -80.44027165410455) / Math.Sqrt((0.15576721421099277 / (21)) + (0.09602640300962305 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.09683951970746293 = (73.33823244767721 - 80.44027165410455) / 73.33823244767721 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Start(Segment: Multiple)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.680488063212454 > 17.459171795148944.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -58.02289353529993 (T) = (0 -21.579219768297417) / Math.Sqrt((0.09802738997475609 / (21)) + (0.02980187684355911 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2848063069403156 = (16.795698816023837 - 21.579219768297417) / 16.795698816023837 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Multiple)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 195.88533466251013 > 136.76586524119364.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -84.2556215340597 (T) = (0 -190.12465158285477) / Math.Sqrt((0.24816645636348245 / (21)) + (6.818334441714518 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4556000077898766 = (130.6160006632126 - 190.12465158285477) / 130.6160006632126 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Multiple)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 77.5448999687162 > 75.03735629518351.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -41.2341120739241 (T) = (0 -77.27901261150899) / Math.Sqrt((0.14964357598351313 / (21)) + (0.19107453896936727 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.08331238006146802 = (71.33585292094983 - 77.27901261150899) / 71.33585292094983 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Single)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.83586527513501 > 18.728970208228695.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -60.7118487277853 (T) = (0 -28.33290399624014) / Math.Sqrt((0.20892325999408706 / (21)) + (0.2836671953093713 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5934866835244313 = (17.780446042745822 - 28.33290399624014) / 17.780446042745822 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_StartPosition(Segment: Multiple)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.79973988726379 > 21.533435650687036.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -95.26455572441573 (T) = (0 -35.83369770342564) / Math.Sqrt((0.23675016323035228 / (21)) + (0.2017283560878925 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7423177218557854 = (20.56668382231588 - 35.83369770342564) / 20.56668382231588 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Start(Segment: Single)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.449610208296146 > 17.593927037607415.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -100.99443915498368 (T) = (0 -21.479860881016712) / Math.Sqrt((0.010202003806897886 / (21)) + (0.02322491643605161 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2783590903226809 = (16.80268169063108 - 21.479860881016712) / 16.80268169063108 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Single)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 71.65210354692061 > 67.52867777456477.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.23679343728654 (T) = (0 -71.16873492018058) / Math.Sqrt((0.19063464528179813 / (21)) + (0.42671061610253425 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.10580198304867612 = (64.35938442068051 - 71.16873492018058) / 64.35938442068051 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_StartPosition(Segment: Single)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.99771532396696 > 18.160810907788832.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.02354513321869 (T) = (0 -31.906582080315683) / Math.Sqrt((0.8311141317421266 / (21)) + (0.034293447111503714 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8178817276016649 = (17.551517018882247 - 31.906582080315683) / 17.551517018882247 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.ReadOnlySequence.Slice_Start_And_Length(Segment: Multiple)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 78.4241654839893 > 75.32020113677997.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -43.90948955880761 (T) = (0 -78.25771114282699) / Math.Sqrt((0.11652350615316509 / (21)) + (0.23321672679239322 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.09124273662649195 = (71.71430197533847 - 78.25771114282699) / 71.71430197533847 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Xml.Linq.Perf_XElement

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
CreateElement - Duration of single invocation	165.61 ns	206.08 ns	1.24	0.24	False
CreateElementsWithNamespace - Duration of single invocation	383.97 ns	482.61 ns	1.26	0.13	False
GetElementWithNamespace - Duration of single invocation	277.62 ns	361.94 ns	1.30	0.11	False
GetValue - Duration of single invocation	124.80 ns	145.34 ns	1.16	0.28	False
CreateWithElements - Duration of single invocation	228.28 ns	298.30 ns	1.31	0.10	False
CreateElementWithNamespace - Duration of single invocation	305.99 ns	401.47 ns	1.31	0.12	False
GetElement - Duration of single invocation	138.47 ns	191.95 ns	1.39	0.23	False
GetAttribute - Duration of single invocation	123.75 ns	160.76 ns	1.30	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Linq.Perf_XElement*'

Payloads

Baseline
Compare

Histogram

System.Xml.Linq.Perf_XElement.CreateElement

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 206.08086321113615 > 179.7189406152925.
IsChangePoint: Marked as a change because one of 12/1/2022 7:29:59 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -26.012791863128157 (T) = (0 -209.63177140246808) / Math.Sqrt((26.32933850814673 / (21)) + (7.665798676502077 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.19982234987613168 = (174.71900854664878 - 209.63177140246808) / 174.71900854664878 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XElement.CreateElementsWithNamespace

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 482.60875778241996 > 391.79575868386604.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -51.85329416131073 (T) = (0 -490.3657157467147) / Math.Sqrt((33.710838477796884 / (21)) + (46.599094817892286 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.30698481723637533 = (375.1885326285542 - 490.3657157467147) / 375.1885326285542 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XElement.GetElementWithNamespace

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 361.9382629315077 > 290.78822953368996.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -45.18161934549865 (T) = (0 -364.1010338303619) / Math.Sqrt((28.76389610995223 / (21)) + (30.99487198751149 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.30703566491999323 = (278.5700831297893 - 364.1010338303619) / 278.5700831297893 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XElement.GetValue

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 145.338978453362 > 132.11095632104568.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -23.528670478517817 (T) = (0 -145.10655386304964) / Math.Sqrt((18.98007350044076 / (21)) + (0.7460041658179909 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.18853953470277146 = (122.08811707667572 - 145.10655386304964) / 122.08811707667572 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XElement.CreateWithElements

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 298.30361068349754 > 241.33277085700976.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -44.77919007994652 (T) = (0 -287.247840193358) / Math.Sqrt((4.544283498701481 / (21)) + (19.03557866506511 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.24332941549565537 = (231.03116246859338 - 287.247840193358) / 231.03116246859338 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XElement.CreateElementWithNamespace

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 401.4661362476096 > 323.5865135219326.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -35.843357076553396 (T) = (0 -408.42888624061413) / Math.Sqrt((55.66725488383717 / (21)) + (65.30463671790909 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.31123924355566607 = (311.4831166378793 - 408.42888624061413) / 311.4831166378793 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XElement.GetElement

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 191.9540581742181 > 148.1167753675269.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -31.983685282023746 (T) = (0 -190.72840216711634) / Math.Sqrt((17.056474267080294 / (21)) + (23.288913595588028 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3584251312746244 = (140.40405891795737 - 190.72840216711634) / 140.40405891795737 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Xml.Linq.Perf_XElement.GetAttribute

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 160.7633739307797 > 130.10867858769979.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -36.940171148615484 (T) = (0 -163.04034630623877) / Math.Sqrt((8.137282550190887 / (21)) + (9.024699582466152 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2990044622569861 = (125.51176769859624 - 163.04034630623877) / 125.51176769859624 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConditionalSelectBenchmark - Duration of single invocation	50.63 ns	57.30 ns	1.13	0.16	False
EqualsBenchmark - Duration of single invocation	6.82 ns	8.61 ns	1.26	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Byte>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.30207744268056 > 53.230921238480235.
IsChangePoint: Marked as a change because one of 10/26/2022 2:40:44 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -5.771753500389444 (T) = (0 -58.46174717719381) / Math.Sqrt((3.340002697665942 / (21)) + (10.213018512620692 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1026123269629319 = (53.021126054542286 - 58.46174717719381) / 53.021126054542286 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;.EqualsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.605219767950304 > 7.151748648119212.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -22.08826248121988 (T) = (0 -8.71054659421604) / Math.Sqrt((0.00250573250150399 / (21)) + (0.10276790086007442 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.28044122798441196 = (6.802769548374838 - 8.71054659421604) / 6.802769548374838 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Collections.CtorFromCollection<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Dictionary - Duration of single invocation	14.22 μs	15.91 μs	1.12	0.33	False
ImmutableQueue - Duration of single invocation	15.42 μs	20.34 μs	1.32	0.23	False
ImmutableStack - Duration of single invocation	20.02 μs	21.02 μs	1.05	0.37	False
LinkedList - Duration of single invocation	35.41 μs	40.62 μs	1.15	0.37	False
ImmutableSortedDictionary - Duration of single invocation	1.00 ms	1.20 ms	1.20	0.36	False
SortedDictionary - Duration of single invocation	945.04 μs	1.07 ms	1.13	0.33	False
SortedList - Duration of single invocation	1.06 ms	1.36 ms	1.28	0.31	False
ImmutableDictionary - Duration of single invocation	305.61 μs	361.49 μs	1.18	0.00	False
SortedSet - Duration of single invocation	1.04 ms	1.23 ms	1.19	0.34	False
HashSet - Duration of single invocation	39.52 μs	46.36 μs	1.17	0.11	False
ImmutableSortedSet - Duration of single invocation	1.05 ms	1.29 ms	1.23	0.36	False
ImmutableHashSet - Duration of single invocation	269.42 μs	307.01 μs	1.14	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CtorFromCollection<String>.Dictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.912786043360432 > 14.52695362937304.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -13.045819656610966 (T) = (0 -16032.971572979268) / Math.Sqrt((344496.2526286552 / (21)) + (39646.99578834673 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.12721135015435106 = (14223.571800251873 - 16032.971572979268) / 14223.571800251873 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.ImmutableQueue(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.344265745501286 > 16.161666193590925.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.775609590789182 (T) = (0 -19400.56020974089) / Math.Sqrt((284746.18406633486 / (21)) + (1458628.8879274689 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2630702826600832 = (15359.84218461892 - 19400.56020974089) / 15359.84218461892 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.ImmutableStack(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.024510789591748 > 20.826443919126657.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -8.076983073880848 (T) = (0 -23028.555497083926) / Math.Sqrt((564695.9743761331 / (21)) + (2075070.8278286248 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1720170148697672 = (19648.652882093887 - 23028.555497083926) / 19648.652882093887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.LinkedList(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.62333579447323 > 37.032492195727215.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.6114386234606 (T) = (0 -40090.834609852325) / Math.Sqrt((1554996.857099472 / (21)) + (2037157.4457764605 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1570209065978051 = (34650.05202692366 - 40090.834609852325) / 34650.05202692366 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.ImmutableSortedDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2039314791666669 > 1.0730413659765625.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -9.976990918781134 (T) = (0 -1145831.7476417234) / Math.Sqrt((903362613.3070316 / (21)) + (1680696682.8611042 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.12509858112705902 = (1018427.8665553867 - 1145831.7476417234) / 1018427.8665553867 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.SortedDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0699739480555552 > 988.6219442003676.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -6.63956368364172 (T) = (0 -1058607.886172502) / Math.Sqrt((2834884948.5441046 / (21)) + (416271800.0846186 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.08754594475297191 = (973391.4151212776 - 1058607.886172502) / 973391.4151212776 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.SortedList(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3591386342147438 > 1.1296857971874998.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -15.631108400143745 (T) = (0 -1307851.06441967) / Math.Sqrt((2146281640.4989974 / (21)) + (967912523.6559571 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.18545906056458134 = (1103244.395295101 - 1307851.06441967) / 1103244.395295101 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.ImmutableDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 361.48815321969687 > 321.2416073402149.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -57.39800034263948 (T) = (0 -366506.0132171175) / Math.Sqrt((11828884.733538648 / (21)) + (8091590.913312511 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2009184180477426 = (305188.1024632158 - 366506.0132171175) / 305188.1024632158 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.SortedSet(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2282410727564104 > 1.0666812220019533.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -12.744853870839192 (T) = (0 -1239835.7103803821) / Math.Sqrt((2998375240.978745 / (21)) + (1680822860.9533763 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.19998148842494426 = (1033212.3639738386 - 1239835.7103803821) / 1033212.3639738386 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.HashSet(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.363609982565514 > 40.99393362429764.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -19.266607984100514 (T) = (0 -44883.18163664592) / Math.Sqrt((1008086.8207670661 / (21)) + (536050.1120003585 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.14429393714212221 = (39223.47237873322 - 44883.18163664592) / 39223.47237873322 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.ImmutableSortedSet(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2905346618589746 > 1.1321751789687502.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -18.468406304006066 (T) = (0 -1291565.855076149) / Math.Sqrt((2367604954.28615 / (21)) + (340614421.90085846 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.20107521715004706 = (1075341.3580048895 - 1291565.855076149) / 1075341.3580048895 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CtorFromCollection&lt;String&gt;.ImmutableHashSet(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 307.0120943627451 > 286.20600320043104.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -42.170466365912546 (T) = (0 -308498.5207827138) / Math.Sqrt((7279208.141379272 / (21)) + (5994653.274885345 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.13678326796942614 = (271378.4847781652 - 308498.5207827138) / 271378.4847781652 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Tests.Perf_DateTime

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString - Duration of single invocation	321.28 ns	557.07 ns	1.73	0.03	False
ToString - Duration of single invocation	57.38 ns	120.03 ns	2.09	0.03	False
ParseR - Duration of single invocation	107.96 ns	189.69 ns	1.76	0.01	False
GetNow - Duration of single invocation	137.13 ns	359.47 ns	2.62	0.03	False
ParseO - Duration of single invocation	113.25 ns	194.16 ns	1.71	0.01	False
ToString - Duration of single invocation	316.62 ns	576.39 ns	1.82	0.01	False
ToString - Duration of single invocation	321.76 ns	563.40 ns	1.75	0.03	False
op_Subtraction - Duration of single invocation	2.10 ns	5.56 ns	2.65	0.06	False
ToString - Duration of single invocation	80.44 ns	165.39 ns	2.06	0.03	False
Year - Duration of single invocation	5.31 ns	7.56 ns	1.42	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_DateTime.ToString(format: "G")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 557.0704895732094 > 335.0925566430812.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -164.31995008458364 (T) = (0 -559.4661343387904) / Math.Sqrt((9.877281417399528 / (21)) + (23.757273961918518 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7617725910774432 = (317.55865494345045 - 559.4661343387904) / 317.55865494345045 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.ToString(format: "r")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 120.03162144866472 > 59.90205820162157.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -253.8635629142187 (T) = (0 -120.36446188387467) / Math.Sqrt((1.1379081292032187 / (21)) + (0.10726838429040253 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.103155630358033 = (57.230411362084645 - 120.36446188387467) / 57.230411362084645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.ParseR

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 189.69199275139124 > 113.42118593252049.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -159.40672476359296 (T) = (0 -191.30803370915572) / Math.Sqrt((0.6896772290810875 / (21)) + (3.351275140029294 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.769105873600853 = (108.13826157264728 - 191.30803370915572) / 108.13826157264728 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.GetNow

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 359.47237759267585 > 143.06377566899567.
IsChangePoint: Marked as a change because one of 11/5/2022 3:05:12 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -183.99305221983346 (T) = (0 -355.9453318882155) / Math.Sqrt((0.8224864410667021 / (21)) + (19.435363505231063 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.614913350240081 = (136.12127218499816 - 355.9453318882155) / 136.12127218499816 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.ParseO

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 194.16325051010125 > 117.50570747664443.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -259.1532443015897 (T) = (0 -193.28337182616696) / Math.Sqrt((0.2555318309668225 / (21)) + (1.2040949547223743 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7244635891684604 = (112.0831851946312 - 193.28337182616696) / 112.0831851946312 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.ToString(format: "s")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 576.3921093352682 > 329.2457834986717.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -231.19255999957244 (T) = (0 -573.8075449453552) / Math.Sqrt((6.610966259078848 / (21)) + (13.101594615279005 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8201052181919409 = (315.26064493972774 - 573.8075449453552) / 315.26064493972774 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.ToString(format: null)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 563.4032209253181 > 334.4021031499678.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -131.02072577112435 (T) = (0 -567.9471814521802) / Math.Sqrt((31.44581560741252 / (21)) + (29.96289152241313 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7856768693110562 = (318.05708592243997 - 567.9471814521802) / 318.05708592243997 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.op_Subtraction

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.555833296620895 > 2.2665836487355624.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -349.450590600275 (T) = (0 -5.545044788993329) / Math.Sqrt((0.0012696612355070091 / (21)) + (0.00046627089746282863 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5656880371779143 = (2.161231103954676 - 5.545044788993329) / 2.161231103954676 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.ToString(format: "o")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 165.3856387448382 > 85.207241689276.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -258.8023739673569 (T) = (0 -166.03986390423424) / Math.Sqrt((1.2560934073811842 / (21)) + (0.6580886782662614 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0384366860643235 = (81.45451121408772 - 166.03986390423424) / 81.45451121408772 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.Year

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.56167259957668 > 5.316994345894654.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.910041556264822 (T) = (0 -7.626363784703523) / Math.Sqrt((0.011321643681041969 / (21)) + (0.10549044998690559 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4899693654601809 = (5.118470192404326 - 7.626363784703523) / 5.118470192404326 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Collections.ContainsKeyTrue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Dictionary - Duration of single invocation	27.90 μs	39.94 μs	1.43	0.06	False
ConcurrentDictionary - Duration of single invocation	34.49 μs	69.79 μs	2.02	0.15	False
ImmutableSortedDictionary - Duration of single invocation	798.37 μs	871.41 μs	1.09	0.31	False
SortedList - Duration of single invocation	696.02 μs	838.98 μs	1.21	0.33	False
ImmutableDictionary - Duration of single invocation	74.55 μs	114.08 μs	1.53	0.21	False
IDictionary - Duration of single invocation	30.21 μs	42.09 μs	1.39	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;String, String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsKeyTrue<String, String>.Dictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.94350060586735 > 29.295148395164883.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.722622445466396 (T) = (0 -39409.00809748102) / Math.Sqrt((86634.93791860389 / (21)) + (1970098.127173991 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.40260791780427324 = (28096.952539077527 - 39409.00809748102) / 28096.952539077527 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyTrue&lt;String, String&gt;.ConcurrentDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.79084369419641 > 35.75137236277175.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -123.42394586110305 (T) = (0 -69780.40260125646) / Math.Sqrt((1226934.9430767635 / (21)) + (356963.48867979884 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0508464099178285 = (34025.172369710686 - 69780.40260125646) / 34025.172369710686 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyTrue&lt;String, String&gt;.ImmutableSortedDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 871.4148155701753 > 848.335543125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -10.245845512897375 (T) = (0 -882294.7704595692) / Math.Sqrt((630239614.6750271 / (21)) + (368340660.0446936 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.09547110928314326 = (805402.135193622 - 882294.7704595692) / 805402.135193622 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyTrue&lt;String, String&gt;.SortedList(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 838.982485745614 > 750.1105019787552.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -9.920171697788494 (T) = (0 -807092.7913796725) / Math.Sqrt((1033766522.3255326 / (21)) + (341566172.93330604 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.11789885614067887 = (721973.0004608808 - 807092.7913796725) / 721973.0004608808 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyTrue&lt;String, String&gt;.ImmutableDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 114.08134920924574 > 76.36398912621797.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -73.08780383087665 (T) = (0 -114973.59006463103) / Math.Sqrt((5106121.052862278 / (21)) + (1056255.0007815652 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5596042120453193 = (73719.7227198115 - 114973.59006463103) / 73719.7227198115 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyTrue&lt;String, String&gt;.IDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.08589712141577 > 31.68776591986993.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -47.17210348750723 (T) = (0 -42344.9763766527) / Math.Sqrt((121117.38787440043 / (21)) + (811222.2906796286 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3911805753550677 = (30438.159593944227 - 42344.9763766527) / 30438.159593944227 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in Exceptions.Handling

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ThrowAndCatch - Duration of single invocation	3.03 μs	7.11 μs	2.35	0.38	False
ThrowAndCatchWhenFinally - Duration of single invocation	3.01 μs	6.24 μs	2.07	0.32	False
ThrowAndCatchDeepRecursive - Duration of single invocation	11.46 μs	14.80 μs	1.29	0.05	False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation	10.75 μs	14.88 μs	1.38	0.39	False
CatchAndRethrowDeep - Duration of single invocation	40.99 μs	46.07 μs	1.12	0.22	False
ThrowAndCatch_ManyCatchBlocks - Duration of single invocation	3.70 μs	6.63 μs	1.79	0.44	False
MultipleNestedTryCatch_LastCatches - Duration of single invocation	3.50 μs	6.88 μs	1.96	0.45	False
TryAndFinallyDeep - Duration of single invocation	13.59 μs	15.21 μs	1.12	0.29	False
TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation	12.42 μs	16.26 μs	1.31	0.32	False
ThrowAndCatchWhen - Duration of single invocation	3.05 μs	6.11 μs	2.00	0.32	False
MultipleNestedTryFinally - Duration of single invocation	3.41 μs	6.64 μs	1.95	0.39	False
ThrowAndCatchFinally - Duration of single invocation	3.49 μs	6.46 μs	1.85	0.35	False
MultipleNestedTryCatch_FirstCatches - Duration of single invocation	3.04 μs	6.14 μs	2.02	0.41	False
ThrowAndCatchDeep - Duration of single invocation	10.61 μs	13.86 μs	1.31	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Exceptions.Handling*'

Payloads

Baseline
Compare

Histogram

Exceptions.Handling.ThrowAndCatch(kind: Hardware)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.106720458939946 > 3.281017609748123.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.94388847675314 (T) = (0 -6574.366707905942) / Math.Sqrt((19344.220822804193 / (21)) + (118058.77217801593 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0578691563266738 = (3194.744761927081 - 6574.366707905942) / 3194.744761927081 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhenFinally(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.238740635216828 > 3.289761179020493.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -51.325930216539994 (T) = (0 -6472.673467974632) / Math.Sqrt((15955.411398089436 / (21)) + (48038.35667911918 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0548808499221412 = (3149.9020822642246 - 6472.673467974632) / 3149.9020822642246 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeepRecursive(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.799285291531385 > 12.06699234557968.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -35.195027057433585 (T) = (0 -15325.971711537753) / Math.Sqrt((24082.237813237643 / (21)) + (146618.10734518527 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.32897583516984624 = (11532.167332131407 - 15325.971711537753) / 11532.167332131407 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: ReflectionHardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.878362507944075 > 11.251024457003176.
IsChangePoint: Marked as a change because one of 11/18/2022 1:00:00 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.023074131693345 (T) = (0 -15165.133301179449) / Math.Sqrt((148168.54219930986 / (21)) + (252773.64670231246 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.39347720120209506 = (10882.943250235538 - 15165.133301179449) / 10882.943250235538 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.CatchAndRethrowDeep(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.07058553450226 > 44.30426854449274.
IsChangePoint: Marked as a change because one of 1/6/2023 2:21:07 AM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -8.583156303042607 (T) = (0 -46447.71070469701) / Math.Sqrt((1696793.0401418908 / (22)) + (1493389.4437147214 / (13))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (13) - 2, .025) and -0.08810655441837119 = (42686.73000460405 - 46447.71070469701) / 42686.73000460405 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatch_ManyCatchBlocks(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.632883171848381 > 3.8700026926145457.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -30.681100478505012 (T) = (0 -7118.6189020195) / Math.Sqrt((27378.983389254263 / (21)) + (151427.51811135185 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9029120062923967 = (3740.9080811305107 - 7118.6189020195) / 3740.9080811305107 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryCatch_LastCatches(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.881607049728221 > 4.186281204415399.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.216357810215246 (T) = (0 -7064.35674162068) / Math.Sqrt((50013.99166108931 / (21)) + (146657.99852865463 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8830616382622648 = (3751.5270865694233 - 7064.35674162068) / 3751.5270865694233 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndFinallyDeep(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.205354186932555 > 14.641834437131616.
IsChangePoint: Marked as a change because one of 1/6/2023 2:21:07 AM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -8.580829485687419 (T) = (0 -15204.919671513257) / Math.Sqrt((189063.39153196994 / (22)) + (131941.08537556222 / (13))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (13) - 2, .025) and -0.0837312354566509 = (14030.157269672469 - 15204.919671513257) / 14030.157269672469 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.260349815656188 > 12.871657117047004.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.4704249519028 (T) = (0 -16324.653688054965) / Math.Sqrt((132566.5848633984 / (21)) + (148609.57711992227 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3069798156755924 = (12490.364037960731 - 16324.653688054965) / 12490.364037960731 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchWhen(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.113892054870513 > 3.246626230123534.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -36.966418679359336 (T) = (0 -6534.774966098655) / Math.Sqrt((14214.985927692478 / (21)) + (110185.18378901499 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.096377178672346 = (3117.1752071052333 - 6534.774966098655) / 3117.1752071052333 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryFinally(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.644386506768083 > 3.5820613699443804.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -67.84302643091512 (T) = (0 -6777.188285453339) / Math.Sqrt((9129.620687697468 / (21)) + (26857.810645799203 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9440234701227179 = (3486.165876909667 - 6777.188285453339) / 3486.165876909667 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchFinally(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.46191279033596 > 3.409068269673919.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -39.020204345848434 (T) = (0 -6697.667809991292) / Math.Sqrt((19673.816348430235 / (21)) + (97169.80655133171 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0707554916911146 = (3234.4078462501325 - 6697.667809991292) / 3234.4078462501325 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.MultipleNestedTryCatch_FirstCatches(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.135403062803902 > 3.353623939040918.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.073174648663006 (T) = (0 -6575.296816080797) / Math.Sqrt((15254.987813926564 / (21)) + (124376.70706092304 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0325494668749664 = (3234.999651049221 - 6575.296816080797) / 3234.999651049221 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Exceptions.Handling.ThrowAndCatchDeep(kind: Hardware)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.864100737061875 > 11.23949370961542.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -37.122320206197344 (T) = (0 -14126.735609243246) / Math.Sqrt((45751.87082722508 / (21)) + (86738.14959010256 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.31660864355769014 = (10729.639121212598 - 14126.735609243246) / 10729.639121212598 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Tests.Perf_StringBuilder

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
AppendLine_Strings - Duration of single invocation	597.12 ns	947.79 ns	1.59	0.06	False
ToString_SingleSegment - Duration of single invocation	44.32 ns	132.81 ns	3.00	0.25	False
Append_Char_Capacity - Duration of single invocation	487.51 ns	539.46 ns	1.11	0.01	False
ToString_SingleSegment - Duration of single invocation	70.76 μs	148.62 μs	2.10	0.19	False
ctor_string - Duration of single invocation	93.58 ns	186.49 ns	1.99	0.27	False
Append_Char - Duration of single invocation	745.99 ns	839.51 ns	1.13	0.02	False
Append_ValueTypes_Interpolated - Duration of single invocation	7.29 μs	11.96 μs	1.64	0.06	False
Insert_Strings - Duration of single invocation	1.30 μs	2.52 μs	1.94	0.03	False
Append_Memory - Duration of single invocation	1.05 μs	2.64 μs	2.51	0.07	False
Append_Strings - Duration of single invocation	530.18 ns	858.48 ns	1.62	0.12	False
Append_NonEmptySpan - Duration of single invocation	963.16 ns	2.44 μs	2.53	0.06	False
Append_Char_Capacity - Duration of single invocation	465.17 μs	502.36 μs	1.08	0.02	False
ToString_MultipleSegments - Duration of single invocation	55.60 ns	136.28 ns	2.45	0.14	False
ToString_MultipleSegments - Duration of single invocation	71.39 μs	148.70 μs	2.08	0.19	False
Append_ValueTypes - Duration of single invocation	5.41 μs	9.30 μs	1.72	0.03	False
ctor_string - Duration of single invocation	69.95 μs	148.32 μs	2.12	0.28	False
Append_Strings - Duration of single invocation	352.00 μs	532.08 μs	1.51	0.41	False
Append_Primitives - Duration of single invocation	1.97 μs	4.85 μs	2.46	0.04	False
Insert_Primitives - Duration of single invocation	56.14 μs	99.01 μs	1.76	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

Payloads

Baseline
Compare

Histogram

System.Text.Tests.Perf_StringBuilder.AppendLine_Strings

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 947.791264184397 > 621.1850308663837.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -66.50742385690764 (T) = (0 -959.9208811768183) / Math.Sqrt((141.96754999375486 / (21)) + (318.64755312022237 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6037031877614191 = (598.5651762136577 - 959.9208811768183) / 598.5651762136577 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 132.80724262444963 > 46.1680320295366.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -227.79389395341838 (T) = (0 -133.5491773490167) / Math.Sqrt((1.3113367578010062 / (21)) + (1.2789343759017047 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.0204278794334725 = (44.215317392072905 - 133.5491773490167) / 44.215317392072905 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 539.458057152814 > 511.5209344153981.
IsChangePoint: Marked as a change because one of 11/25/2022 10:05:08 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -32.869074918537656 (T) = (0 -526.4030401481657) / Math.Sqrt((5.874207698173164 / (21)) + (15.735758673876573 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.079888890386148 = (487.460371927647 - 526.4030401481657) / 487.460371927647 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 148.6229750917891 > 74.62308841419899.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -98.92140091676217 (T) = (0 -149034.24895131815) / Math.Sqrt((1892396.4644372887 / (21)) + (7483222.065634047 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.103423925812459 = (70853.16807630818 - 149034.24895131815) / 70853.16807630818 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ctor_string(length: 100)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 186.48907319843238 > 97.10290116139001.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -75.19406015625252 (T) = (0 -192.65755841223782) / Math.Sqrt((11.26525881616503 / (21)) + (16.455696077949373 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0435601077607524 = (94.27545472266236 - 192.65755841223782) / 94.27545472266236 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 839.5112785147485 > 785.5545454532833.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -15.533564693932117 (T) = (0 -841.9331975652327) / Math.Sqrt((654.2055239250124 / (21)) + (34.100498556968134 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.11972952049294233 = (751.9076546223284 - 841.9331975652327) / 751.9076546223284 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_ValueTypes_Interpolated

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.957361454406641 > 7.675668247047603.
IsChangePoint: Marked as a change because one of 12/5/2022 9:44:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -72.53469839805173 (T) = (0 -11771.08133679271) / Math.Sqrt((37267.38504077415 / (21)) + (27416.205818317983 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6038265931700795 = (7339.372839258335 - 11771.08133679271) / 7339.372839258335 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Insert_Strings

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.518361663191103 > 1.3113453951661609.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -186.4985171452914 (T) = (0 -2503.4587133876194) / Math.Sqrt((659.376792285973 / (21)) + (196.73241577837828 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0089834127169486 = (1246.1320972291865 - 2503.4587133876194) / 1246.1320972291865 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Memory

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.64424362454894 > 1045.5392306730012.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -166.15609885964219 (T) = (0 -2638.3839004136235) / Math.Sqrt((1206.043742955458 / (21)) + (534.935894367542 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6033800437043375 = (1013.4455423801586 - 2638.3839004136235) / 1013.4455423801586 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 858.4827250236283 > 553.2002789437714.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -99.45277662387028 (T) = (0 -857.4774537702688) / Math.Sqrt((123.13977354200617 / (21)) + (69.94390701024619 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6186797289459266 = (529.7387978835395 - 857.4774537702688) / 529.7387978835395 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_NonEmptySpan

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.437933372083859 > 992.395157252798.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -151.90108939572994 (T) = (0 -2486.999760120964) / Math.Sqrt((723.0934987653748 / (21)) + (916.5201893750699 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5672042306968665 = (968.7580483013884 - 2486.999760120964) / 968.7580483013884 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 502.3553489583333 > 486.90628694852944.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 11/25/2022 10:05:08 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -71.36287322551371 (T) = (0 -498900.0703112735) / Math.Sqrt((2888040.392157266 / (21)) + (1294397.1610211534 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.07364932599023485 = (464676.9277772649 - 498900.0703112735) / 464676.9277772649 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 136.283560007262 > 57.66015791804622.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -262.5441633872985 (T) = (0 -137.84103598503998) / Math.Sqrt((1.2623055013831075 / (21)) + (0.5302798820393829 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.476607559835283 = (55.65719745852979 - 137.84103598503998) / 55.65719745852979 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 148.7009103320029 > 74.84136193438914.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -194.1600460624399 (T) = (0 -148966.11202406825) / Math.Sqrt((1066704.6648102317 / (21)) + (1517329.2721620798 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0833749110533397 = (71502.30677816506 - 148966.11202406825) / 71502.30677816506 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_ValueTypes

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.29504436305953 > 5.68203744445725.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -93.69506409681337 (T) = (0 -9399.484744021074) / Math.Sqrt((2799.848102613034 / (21)) + (23202.74031161589 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7295437841825942 = (5434.661342478472 - 9399.484744021074) / 5434.661342478472 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.ctor_string(length: 100000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 148.3194919893191 > 75.80916721471716.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -100.01209168826702 (T) = (0 -148245.42835709135) / Math.Sqrt((10559789.0852645 / (21)) + (921662.1971189189 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0356272904502772 = (72825.42784357136 - 148245.42835709135) / 72825.42784357136 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 532.0789205128204 > 326.40116415629717.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -49.83868888832729 (T) = (0 -525998.3171469215) / Math.Sqrt((321931853.0156311 / (21)) + (23345373.53374487 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6410649121350462 = (320522.5541399158 - 525998.3171469215) / 320522.5541399158 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Append_Primitives

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.8514269251626905 > 2.057283635445032.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -159.44863230753074 (T) = (0 -4878.3081729761325) / Math.Sqrt((5488.224649255263 / (21)) + (794.3646536022768 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3977278143435838 = (2034.5546078221755 - 4878.3081729761325) / 2034.5546078221755 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_StringBuilder.Insert_Primitives

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 99.01364013713082 > 58.85283729368795.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -264.33651533587533 (T) = (0 -99096.70403246349) / Math.Sqrt((231163.35831866608 / (21)) + (208515.16406680943 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.752238219869803 = (56554.35597097448 - 99096.70403246349) / 56554.35597097448 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Tests.Perf_Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
GetString - Duration of single invocation	585.10 ns	2.15 μs	3.67	0.03	False
GetBytes - Duration of single invocation	49.50 ns	115.93 ns	2.34	0.09	False
GetByteCount - Duration of single invocation	12.22 ns	17.50 ns	1.43	0.20	False
GetByteCount - Duration of single invocation	11.71 ns	18.72 ns	1.60	0.21	False
GetBytes - Duration of single invocation	55.59 ns	108.18 ns	1.95	0.18	False
GetEncoder - Duration of single invocation	28.42 ns	36.25 ns	1.28	0.57	False
GetByteCount - Duration of single invocation	144.57 ns	1.47 μs	10.14	0.01	False
GetBytes - Duration of single invocation	412.84 ns	1.28 μs	3.10	0.01	False
GetString - Duration of single invocation	47.23 ns	125.60 ns	2.66	0.18	False
GetChars - Duration of single invocation	495.90 ns	1.41 μs	2.84	0.08	False
GetChars - Duration of single invocation	60.35 ns	113.22 ns	1.88	0.23	False
GetString - Duration of single invocation	50.49 ns	101.27 ns	2.01	0.06	False
GetChars - Duration of single invocation	566.04 ns	2.15 μs	3.80	0.04	False
GetBytes - Duration of single invocation	548.97 ns	2.73 μs	4.97	0.01	False
GetChars - Duration of single invocation	70.49 ns	183.43 ns	2.60	0.16	False
GetByteCount - Duration of single invocation	20.92 ns	82.36 ns	3.94	0.03	False
GetString - Duration of single invocation	509.86 ns	1.39 μs	2.73	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_Encoding*'

Payloads

Baseline
Compare

Histogram

System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "utf-8")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.150035106472166 > 603.1367474308329.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -942.4828374276973 (T) = (0 -2144.484570086894) / Math.Sqrt((21.821031307129623 / (21)) + (24.26657654614221 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.7282777039348445 = (575.1944303461069 - 2144.484570086894) / 575.1944303461069 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 16, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 115.9340346813402 > 50.639570627898095.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -109.78493492380258 (T) = (0 -117.64480599391557) / Math.Sqrt((2.4020542880699502 / (21)) + (3.904388832782845 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4108804972043643 = (48.79744397548342 - 117.64480599391557) / 48.79744397548342 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.503788555642743 > 12.867036542516516.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -75.06063206515374 (T) = (0 -17.475606677626235) / Math.Sqrt((0.09972179233853458 / (21)) + (0.009024356864372137 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.46077469070834415 = (11.963245796072863 - 17.475606677626235) / 11.963245796072863 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 16, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.71970755180105 > 12.286245839939458.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -47.07923618240953 (T) = (0 -17.51024214408252) / Math.Sqrt((0.08690265529414788 / (21)) + (0.14314393263059133 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4754116893220759 = (11.868038101370981 - 17.51024214408252) / 11.868038101370981 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 16, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 108.18169743491694 > 57.68133808043691.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -80.87959543281943 (T) = (0 -107.19988496571327) / Math.Sqrt((1.0299467435071243 / (21)) + (5.172876152852923 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9535167340014 = (54.87533487677636 - 107.19988496571327) / 54.87533487677636 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetEncoder(size: 16, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.25339311217866 > 30.83659331449798.
IsChangePoint: Marked as a change because one of 1/6/2023 8:14:14 AM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -7.254933493357379 (T) = (0 -35.37683362272178) / Math.Sqrt((2.763417983885451 / (23)) + (4.2794251243678625 / (12))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (12) - 2, .025) and -0.16496004592470706 = (30.367422253216258 - 35.37683362272178) / 30.367422253216258 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 512, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.4657256971970556 > 152.0201497058636.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1806.8496244416629 (T) = (0 -1470.642553459934) / Math.Sqrt((0.09587658734422304 / (21)) + (7.47653379495485 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -9.170248452523033 = (144.60242149690032 - 1470.642553459934) / 144.60242149690032 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.2778927256816255 > 428.67133498116317.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -791.0073870146873 (T) = (0 -1273.6191981273585) / Math.Sqrt((5.374308211876307 / (21)) + (13.176183449866532 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.1203111681150744 = (408.1705732241857 - 1273.6191981273585) / 408.1705732241857 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 125.59929931865304 > 48.412919739259266.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -302.29344885500876 (T) = (0 -125.42850025900155) / Math.Sqrt((0.9766220333421257 / (21)) + (0.3052847438069375 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.70206738799966 = (46.41945675228191 - 125.42850025900155) / 46.41945675228191 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.406419856894729 > 515.9245712334421.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -231.0413756597982 (T) = (0 -1404.4583047480387) / Math.Sqrt((275.02361045865655 / (21)) + (33.02661601938802 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8306736221242919 = (496.1569196006626 - 1404.4583047480387) / 496.1569196006626 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 113.22033493388047 > 63.83844451782045.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -93.80601267424312 (T) = (0 -113.89345701333559) / Math.Sqrt((1.359834305269294 / (21)) + (3.493053651849835 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8577555382465457 = (61.30702057862503 - 113.89345701333559) / 61.30702057862503 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.27122992830557 > 53.74422644085417.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -224.35047778156334 (T) = (0 -102.25315147793637) / Math.Sqrt((0.0634161467155528 / (21)) + (0.6840712238210968 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9990282943564244 = (51.15142780450548 - 102.25315147793637) / 51.15142780450548 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetChars(size: 512, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.1512383967191235 > 600.0516577459064.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -999.5335729656274 (T) = (0 -2150.081623243441) / Math.Sqrt((19.91431462349727 / (21)) + (21.624088493874133 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.7593251705761 = (571.9328671198588 - 2150.081623243441) / 571.9328671198588 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetBytes(size: 512, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.727094085163866 > 572.5266045414363.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1097.903235536986 (T) = (0 -2745.3186170822364) / Math.Sqrt((9.64716709009706 / (21)) + (49.70183213702479 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.019774820190188 = (546.9007506153877 - 2745.3186170822364) / 546.9007506153877 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 183.43259088931526 > 73.54347992145708.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -102.93335793991723 (T) = (0 -183.30224943321926) / Math.Sqrt((1.9258446193398542 / (21)) + (15.574652677730121 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.605646354209744 = (70.34809199532077 - 183.30224943321926) / 70.34809199532077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetByteCount(size: 16, encName: "utf-8")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 82.3560811525016 > 22.045770555511318.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -937.700341964759 (T) = (0 -82.33415963536264) / Math.Sqrt((0.021670769896391117 / (21)) + (0.045391858691502925 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.915144808613519 = (21.029658840261355 - 82.33415963536264) / 21.029658840261355 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetString(size: 512, encName: "ascii")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3914032550231148 > 536.0642178059462.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -288.9590177105331 (T) = (0 -1386.6488680173181) / Math.Sqrt((96.03621346343391 / (21)) + (64.68695171182368 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7162812684297095 = (510.49531730524507 - 1386.6488680173181) / 510.49531730524507 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Tests.Perf_Double

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToStringWithFormat - Duration of single invocation	279.28 ns	731.16 ns	2.62	0.01	False
ToStringWithCultureInfo - Duration of single invocation	168.35 ns	458.93 ns	2.73	0.03	False
TryParse - Duration of single invocation	181.84 ns	362.70 ns	1.99	0.00	False
ToStringWithFormat - Duration of single invocation	283.76 ns	733.77 ns	2.59	0.02	False
ToString - Duration of single invocation	180.86 ns	492.59 ns	2.72	0.06	False
ToStringWithFormat - Duration of single invocation	177.61 ns	494.68 ns	2.79	0.06	False
ToStringWithFormat - Duration of single invocation	198.17 ns	492.42 ns	2.48	0.02	False
ToStringWithFormat - Duration of single invocation	173.36 ns	484.95 ns	2.80	0.05	False
ToStringWithFormat - Duration of single invocation	556.24 ns	1.53 μs	2.75	0.01	False
ToStringWithFormat - Duration of single invocation	262.01 ns	592.89 ns	2.26	0.00	False
ToString - Duration of single invocation	276.41 ns	720.52 ns	2.61	0.02	False
IsNaN - Duration of single invocation	668.20 μs	2.76 ms	4.13	0.00	False
ToStringWithFormat - Duration of single invocation	196.47 ns	508.13 ns	2.59	0.02	False
ToStringWithCultureInfo - Duration of single invocation	270.61 ns	714.77 ns	2.64	0.02	False
ToStringWithFormat - Duration of single invocation	276.62 ns	740.11 ns	2.68	0.01	False
ToStringWithFormat - Duration of single invocation	371.84 ns	1.01 μs	2.72	0.00	False
Parse - Duration of single invocation	183.19 ns	359.88 ns	1.96	0.00	False
ToStringWithFormat - Duration of single invocation	261.95 ns	586.65 ns	2.24	0.01	False
Parse - Duration of single invocation	186.03 ns	362.36 ns	1.95	0.01	False
ToStringWithCultureInfo - Duration of single invocation	269.25 ns	704.26 ns	2.62	0.03	False
Parse - Duration of single invocation	93.93 ns	195.62 ns	2.08	0.17	False
TryParse - Duration of single invocation	93.03 ns	198.67 ns	2.14	0.03	False
ToStringWithFormat - Duration of single invocation	284.94 ns	734.72 ns	2.58	0.02	False
ToString - Duration of single invocation	281.26 ns	741.71 ns	2.64	0.02	False
TryParse - Duration of single invocation	180.93 ns	362.56 ns	2.00	0.00	False
ToStringWithFormat - Duration of single invocation	39.55 μs	91.72 μs	2.32	0.00	False
ToStringWithFormat - Duration of single invocation	39.40 μs	92.38 μs	2.34	0.00	False
ToStringWithFormat - Duration of single invocation	193.10 ns	492.04 ns	2.55	0.00	False
IsNaN - Duration of single invocation	669.72 μs	2.64 ms	3.95	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Double*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "G")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 731.1582510873864 > 291.8759827399036.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -253.8047282392172 (T) = (0 -741.4825840135896) / Math.Sqrt((2.4401219120200923 / (21)) + (44.966799876613095 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6627608376545289 = (278.4638310463956 - 741.4825840135896) / 278.4638310463956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithCultureInfo(value: 12345, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 458.92868761801714 > 176.74066919243694.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -150.82239652310193 (T) = (0 -458.53133471380625) / Math.Sqrt((7.662822254906456 / (21)) + (46.442404047211575 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7113274529923919 = (169.1169151139388 - 458.53133471380625) / 169.1169151139388 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.TryParse(value: "-1.7976931348623157e+308")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 362.6994521448317 > 191.41065847432412.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -315.1792004678499 (T) = (0 -362.824870224673) / Math.Sqrt((0.1747113023423676 / (21)) + (4.493068789343127 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9938365789167259 = (181.97322391477033 - 362.824870224673) / 181.97322391477033 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 733.7690906676681 > 288.7064232461841.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -233.1191732109726 (T) = (0 -740.229995744371) / Math.Sqrt((6.033027946297105 / (21)) + (51.45793046422653 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.680423438928189 = (276.1615888720791 - 740.229995744371) / 276.1615888720791 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToString(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 492.5884365662913 > 186.71433070307273.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -168.3516376858553 (T) = (0 -499.9229324121281) / Math.Sqrt((7.510550354357051 / (21)) + (46.946568351314724 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8467417844991307 = (175.6123211224396 - 499.9229324121281) / 175.6123211224396 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 494.6830920356734 > 183.24262378251953.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -153.01104995053544 (T) = (0 -502.5117350029974) / Math.Sqrt((4.984152951195572 / (21)) + (60.97695696600278 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.878153468664968 = (174.59518419498582 - 502.5117350029974) / 174.59518419498582 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 492.4233739805105 > 205.9403267403602.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -109.9762754609177 (T) = (0 -501.81380562424545) / Math.Sqrt((28.913620330550724 / (21)) + (88.10783963553719 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5442817551231258 = (197.23201041464887 - 501.81380562424545) / 197.23201041464887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 484.95403799128957 > 182.57345262594743.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -170.0804825972799 (T) = (0 -502.0404901033335) / Math.Sqrt((2.7842506795302073 / (21)) + (49.82009544933 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8642996102377407 = (175.27513124287424 - 502.0404901033335) / 175.27513124287424 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "F50")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.5300870209328008 > 582.802127569063.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -486.7890729416368 (T) = (0 -1531.1502266521118) / Math.Sqrt((20.26364662228638 / (21)) + (42.88336351350178 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.762978663529968 = (554.1665040206723 - 1531.1502266521118) / 554.1665040206723 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 592.8857465893383 > 275.7175634104341.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -170.81245243201747 (T) = (0 -605.2540111872388) / Math.Sqrt((10.327345328910774 / (21)) + (48.69002252433506 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2845966855281874 = (264.9281665430181 - 605.2540111872388) / 264.9281665430181 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToString(value: -1.7976931348623157E+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 720.5186527972572 > 290.6423152068934.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -206.8034868943337 (T) = (0 -731.0449859586237) / Math.Sqrt((8.872234198009215 / (21)) + (61.21462388791895 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.627775715821032 = (278.1991558705813 - 731.0449859586237) / 278.1991558705813 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.IsNaN(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.7565526027777776 > 702.7130446289062.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -144.73696434342025 (T) = (0 -2678304.6658482146) / Math.Sqrt((2549337.311785466 / (21)) + (2695445072.7991505 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.001280300577184 = (669361.9203488118 - 2678304.6658482146) / 669361.9203488118 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 508.1341385001033 > 208.2336477817192.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -129.79779768499995 (T) = (0 -491.1568888407126) / Math.Sqrt((6.580334810344295 / (21)) + (66.64868755684576 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4708417991505898 = (198.78119635565474 - 491.1568888407126) / 198.78119635565474 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithCultureInfo(value: -1.7976931348623157E+308, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 714.7721196009228 > 284.78618385536095.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -197.67345702211446 (T) = (0 -719.1614992787116) / Math.Sqrt((17.50274988029586 / (21)) + (59.42346242957815 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6274004484991704 = (273.71598405926767 - 719.1614992787116) / 273.71598405926767 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 740.1136346477845 > 290.3864043992605.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -220.52429083401685 (T) = (0 -737.7289222062145) / Math.Sqrt((1.3597768939868642 / (21)) + (60.44837159531855 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6722096310800716 = (276.07449416610115 - 737.7289222062145) / 276.07449416610115 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 12345, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0095735033947444 > 389.41896164790336.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -328.4208745509303 (T) = (0 -1021.2358268171677) / Math.Sqrt((13.726121663697521 / (21)) + (45.44160313835172 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7400867949153198 = (372.70199933529045 - 1021.2358268171677) / 372.70199933529045 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.Parse(value: "1.7976931348623157e+308")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 359.88246475635026 > 192.8099421681576.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -241.39518989638822 (T) = (0 -354.99820154077923) / Math.Sqrt((1.2191818791519085 / (21)) + (6.2469481046738435 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9337599131803636 = (183.5792536194064 - 354.99820154077923) / 183.5792536194064 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 586.6512109681421 > 275.44647304498534.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -195.71245407273682 (T) = (0 -601.8481138959972) / Math.Sqrt((7.830458922421262 / (21)) + (37.01219638142258 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2977684394300457 = (261.9272262462112 - 601.8481138959972) / 261.9272262462112 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.Parse(value: "-1.7976931348623157e+308")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 362.35719733159016 > 195.85824220731166.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -227.6222995136525 (T) = (0 -360.58547079136076) / Math.Sqrt((1.0417771033603325 / (21)) + (7.541017061141961 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9385838094509689 = (186.0045818155693 - 360.58547079136076) / 186.0045818155693 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithCultureInfo(value: 1.7976931348623157E+308, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 704.2637661506582 > 284.6065408766919.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -224.8781532820667 (T) = (0 -707.6737559775654) / Math.Sqrt((8.577308051204632 / (21)) + (47.125793561955724 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6135148601039113 = (270.7747205804787 - 707.6737559775654) / 270.7747205804787 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.Parse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 195.6160560399959 > 100.07121678841968.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -168.86616216192692 (T) = (0 -195.4948784543157) / Math.Sqrt((6.711027711595503 / (21)) + (0.49978283380776545 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.061252078300424 = (94.84278051790163 - 195.4948784543157) / 94.84278051790163 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.TryParse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 198.66973099676792 > 96.07559514134483.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -174.542709310112 (T) = (0 -196.1367611879845) / Math.Sqrt((3.8396259981979606 / (21)) + (2.3935933868279666 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1246387370029058 = (92.31534649728842 - 196.1367611879845) / 92.31534649728842 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 734.7214845908525 > 291.55730910768807.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -183.03232594077633 (T) = (0 -741.285502834261) / Math.Sqrt((13.347577396450859 / (21)) + (80.31242529573312 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6545300763269566 = (279.25300581260296 - 741.285502834261) / 279.25300581260296 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToString(value: 1.7976931348623157E+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 741.7060401205011 > 291.4993123477697.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -267.7473720923368 (T) = (0 -730.5378509106088) / Math.Sqrt((8.050224288740944 / (21)) + (34.812110068278656 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.637786439999961 = (276.95109802392477 - 730.5378509106088) / 276.95109802392477 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.TryParse(value: "1.7976931348623157e+308")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 362.5573349623584 > 189.53055901636804.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -343.2432811182277 (T) = (0 -356.8101510430462) / Math.Sqrt((0.4079716445423278 / (21)) + (3.4274515285394234 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.978248683738662 = (180.366681891943 - 356.8101510430462) / 180.366681891943 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: -1.7976931348623157E+308, format: "F50")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 91.71906922514619 > 41.4107424609375.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -414.78776463508837 (T) = (0 -91785.06377378726) / Math.Sqrt((2077.4324836761375 / (21)) + (221797.23001539736 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3287447148330225 = (39413.96546781578 - 91785.06377378726) / 39413.96546781578 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "F50")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 92.37633844921103 > 41.38693939788511.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -369.5206829822873 (T) = (0 -91949.518294227) / Math.Sqrt((23326.0533005593 / (21)) + (267240.73047048016 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3318764237968286 = (39431.55707390023 - 91949.518294227) / 39431.55707390023 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.ToStringWithFormat(value: 1.7976931348623157E+308, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 492.0386797832906 > 203.45699417407695.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -164.09029408211438 (T) = (0 -493.1147430176602) / Math.Sqrt((1.6620837668997488 / (21)) + (45.608103842663894 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5501177534740518 = (193.36940121525168 - 493.1147430176602) / 193.36940121525168 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Double.IsNaN(value: NaN)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.642924575694444 > 702.4917077864584.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -131.81641499845756 (T) = (0 -2707489.524573467) / Math.Sqrt((400262.96956493106 / (21)) + (3348001413.0940814 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.0472716347170263 = (668966.5950140179 - 2707489.524573467) / 668966.5950140179 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
MatchesWords - Duration of single invocation	18.60 μs	20.48 μs	1.10	0.01	False
ReplaceWords - Duration of single invocation	12.76 μs	17.11 μs	1.34	0.02	False
MatchesWords - Duration of single invocation	99.12 μs	172.19 μs	1.74	0.01	False
MatchesSet - Duration of single invocation	184.19 μs	487.33 μs	2.65	0.00	False
Uri_IsMatch - Duration of single invocation	435.88 ns	1.02 μs	2.33	0.01	False
Date_IsMatch - Duration of single invocation	270.74 ns	746.94 ns	2.76	0.00	False
Date_IsMatch - Duration of single invocation	215.30 ns	410.62 ns	1.91	0.04	False
Ctor - Duration of single invocation	72.51 μs	94.09 μs	1.30	0.36	False
MatchesWord - Duration of single invocation	6.99 μs	10.23 μs	1.46	0.02	False
Date_IsNotMatch - Duration of single invocation	355.32 ns	696.63 ns	1.96	0.00	False
MatchesBoundary - Duration of single invocation	118.45 μs	227.39 μs	1.92	0.01	False
SplitWords - Duration of single invocation	17.79 μs	21.97 μs	1.23	0.02	False
Email_IsMatch - Duration of single invocation	593.76 ns	1.43 μs	2.41	0.00	False
Date_IsMatch - Duration of single invocation	229.32 ns	410.94 ns	1.79	0.03	False
ReplaceWords - Duration of single invocation	17.54 μs	22.60 μs	1.29	0.02	False
Email_IsNotMatch - Duration of single invocation	364.99 ns	448.74 ns	1.23	0.00	False
MatchesWord - Duration of single invocation	7.19 μs	11.19 μs	1.56	0.05	False
IP_IsMatch - Duration of single invocation	445.15 ns	492.17 ns	1.11	0.01	False
Ctor - Duration of single invocation	99.14 μs	118.66 μs	1.20	0.27	False
ReplaceWords - Duration of single invocation	98.20 μs	173.29 μs	1.76	0.01	False
MatchesBoundary - Duration of single invocation	158.47 μs	447.38 μs	2.82	0.00	False
MatchesSet - Duration of single invocation	152.46 μs	277.34 μs	1.82	0.00	False
Uri_IsNotMatch - Duration of single invocation	431.82 ns	1.01 μs	2.33	0.03	False
Backtracking - Duration of single invocation	497.20 ns	561.51 ns	1.13	0.05	False
IP_IsMatch - Duration of single invocation	440.76 ns	482.66 ns	1.10	0.01	False
CtorInvoke - Duration of single invocation	14.92 μs	21.97 μs	1.47	0.10	False
SplitWords - Duration of single invocation	98.22 μs	173.13 μs	1.76	0.01	False
Ctor - Duration of single invocation	13.63 μs	21.51 μs	1.58	0.10	False
MatchWord - Duration of single invocation	2.79 μs	4.88 μs	1.75	0.02	False
Email_IsNotMatch - Duration of single invocation	766.61 ns	1.86 μs	2.43	0.00	False
Backtracking - Duration of single invocation	499.78 ns	631.15 ns	1.26	0.06	False
Uri_IsNotMatch - Duration of single invocation	316.33 ns	555.02 ns	1.75	0.13	False
Date_IsNotMatch - Duration of single invocation	562.88 ns	1.51 μs	2.68	0.00	False
Uri_IsNotMatch - Duration of single invocation	317.38 ns	549.16 ns	1.73	0.07	False
Email_IsMatch - Duration of single invocation	325.10 ns	399.33 ns	1.23	0.01	False
OneNodeBacktracking - Duration of single invocation	1.57 μs	3.24 μs	2.06	0.00	False
IP_IsNotMatch - Duration of single invocation	442.45 ns	501.04 ns	1.13	0.03	False
IP_IsNotMatch - Duration of single invocation	440.01 ns	496.87 ns	1.13	0.01	False
Email_IsNotMatch - Duration of single invocation	363.45 ns	502.53 ns	1.38	0.01	False
MatchesBoundary - Duration of single invocation	118.80 μs	228.79 μs	1.93	0.01	False
Uri_IsMatch - Duration of single invocation	274.30 ns	411.03 ns	1.50	0.07	False
MatchesSet - Duration of single invocation	151.28 μs	277.64 μs	1.84	0.00	False
Email_IsMatch - Duration of single invocation	325.90 ns	450.56 ns	1.38	0.01	False
Date_IsNotMatch - Duration of single invocation	357.01 ns	689.58 ns	1.93	0.00	False
Backtracking - Duration of single invocation	2.48 μs	4.49 μs	1.81	0.00	False
IP_IsNotMatch - Duration of single invocation	910.32 ns	2.08 μs	2.29	0.00	False
Uri_IsMatch - Duration of single invocation	277.61 ns	408.87 ns	1.47	0.05	False
IP_IsMatch - Duration of single invocation	917.64 ns	2.08 μs	2.26	0.00	False
SplitWords - Duration of single invocation	13.02 μs	16.74 μs	1.29	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWords(Options: IgnoreCase, Compiled)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.47837939812481 > 19.533567980826398.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -57.68156744107958 (T) = (0 -20621.607427463594) / Math.Sqrt((14005.09379627872 / (21)) + (7053.199317409738 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.10583501819952758 = (18647.996390129512 - 20621.607427463594) / 18647.996390129512 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.ReplaceWords(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.10978715697036 > 13.447317349415977.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 12/17/2022 10:44:50 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -205.99362075059418 (T) = (0 -17155.399875325667) / Math.Sqrt((2753.105699378192 / (21)) + (4449.469137474969 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3412228464385124 = (12790.864635865824 - 17155.399875325667) / 12790.864635865824 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWords(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 172.18688546069313 > 103.81894124312107.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -771.5013775916598 (T) = (0 -172505.96179037393) / Math.Sqrt((15655.768534978382 / (21)) + (116987.82911502567 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7442075637669808 = (98902.19798027434 - 172505.96179037393) / 98902.19798027434 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 487.32885712139426 > 193.53340164705884.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -560.4108339662716 (T) = (0 -484472.353881117) / Math.Sqrt((105005.39021616623 / (21)) + (3946315.5953305317 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6285772159534306 = (184309.7288300091 - 484472.353881117) / 184309.7288300091 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0173856473608474 > 455.73787624277907.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -230.00884692515427 (T) = (0 -1018.3653929238892) / Math.Sqrt((1.6931430681748965 / (21)) + (89.29985407988164 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3475485111581778 = (433.7995096090569 - 1018.3653929238892) / 433.7995096090569 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 746.9407057287913 > 283.4128016243913.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -394.31606537378536 (T) = (0 -751.2692729930147) / Math.Sqrt((0.26852343964845193 / (21)) + (20.669404967610326 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7816671081381867 = (270.0787850548555 - 751.2692729930147) / 270.0787850548555 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 410.61695474275007 > 226.09227719370912.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -195.96710438343956 (T) = (0 -412.98103261994726) / Math.Sqrt((3.654266542332727 / (21)) + (11.691483347812383 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9108657066346589 = (216.1224785112048 - 412.98103261994726) / 216.1224785112048 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 94.09393345808382 > 75.54123259760671.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -21.907163752403918 (T) = (0 -92738.79946193934) / Math.Sqrt((8998309.677321771 / (21)) + (5128209.583182966 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2667794203015616 = (73208.32496620645 - 92738.79946193934) / 73208.32496620645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.232752562949642 > 7.355812786465771.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -116.30813211118877 (T) = (0 -10444.604012752823) / Math.Sqrt((1435.5419945296944 / (21)) + (11066.573369112173 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4844301007955968 = (7036.1036246536105 - 10444.604012752823) / 7036.1036246536105 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 696.6298840898547 > 373.40087697804813.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -166.46705068991474 (T) = (0 -693.1913397723116) / Math.Sqrt((1.7426454102585254 / (21)) + (56.33569288655043 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.948068340090729 = (355.83522687916945 - 693.1913397723116) / 355.83522687916945 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 227.39322471316424 > 124.50029240767044.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -478.45320048106436 (T) = (0 -227710.44823357716) / Math.Sqrt((667486.9209082907 / (21)) + (281201.0890936613 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.917692970280395 = (118741.86940377767 - 227710.44823357716) / 118741.86940377767 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.97256299882629 > 18.65742237702459.
IsChangePoint: Marked as a change because one of 10/18/2022 9:26:37 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -229.61507864241108 (T) = (0 -22023.283403918485) / Math.Sqrt((3842.6522379861444 / (21)) + (2200.6550778242954 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.23807600074639476 = (17788.312987766003 - 22023.283403918485) / 17788.312987766003 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.43262443584784 > 623.3512219830222.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -421.05109388148816 (T) = (0 -1426.4972499902353) / Math.Sqrt((3.6974389105440673 / (21)) + (52.25162060724753 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4011033294771074 = (594.1007338076059 - 1426.4972499902353) / 594.1007338076059 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 410.93695184696566 > 226.66925924325116.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -130.28897092800545 (T) = (0 -411.83180119714245) / Math.Sqrt((41.455879118644106 / (21)) + (3.1050980834700317 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8825480657479354 = (218.7629674323996 - 411.83180119714245) / 218.7629674323996 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.ReplaceWords(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.59824923660674 > 18.412497865510684.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -388.6948055574387 (T) = (0 -22589.186954709825) / Math.Sqrt((1823.4534604890214 / (21)) + (1163.780916775173 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.28920117362711545 = (17521.847960435887 - 22589.186954709825) / 17521.847960435887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsNotMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 448.73927398733065 > 383.29292936158964.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -132.84367297997522 (T) = (0 -450.46317232245053) / Math.Sqrt((2.734713051284057 / (21)) + (3.88578587035206 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2320115626098219 = (365.632260275395 - 450.46317232245053) / 365.632260275395 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesWord(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.193030337514934 > 7.609015810334523.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -167.65370856756948 (T) = (0 -11145.09789967909) / Math.Sqrt((2179.5065280367135 / (21)) + (6033.041184232205 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5333885851869752 = (7268.280204603258 - 11145.09789967909) / 7268.280204603258 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 492.1723993247163 > 464.26559704885665.
IsChangePoint: Marked as a change because one of 10/26/2022 10:56:11 AM, 11/7/2022 10:11:20 AM, 12/7/2022 6:04:36 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -26.53486013539741 (T) = (0 -490.61325030413235) / Math.Sqrt((15.228626204157445 / (21)) + (33.22618899000903 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1052204679530668 = (443.9053243492467 - 490.61325030413235) / 443.9053243492467 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 118.65577266414142 > 99.51240651219366.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.343324984781674 (T) = (0 -120949.1264205244) / Math.Sqrt((6501886.004727903 / (21)) + (8919772.632928722 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2820024328608321 = (94343.91333456544 - 120949.1264205244) / 94343.91333456544 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.ReplaceWords(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 173.28624504629627 > 102.9119426015625.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -474.9260084540405 (T) = (0 -174254.9168028507) / Math.Sqrt((85874.87353152633 / (21)) + (303267.67458165024 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7773388021790893 = (98042.59975037236 - 174254.9168028507) / 98042.59975037236 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 447.3793104761905 > 166.39773548611112.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -535.7172216133761 (T) = (0 -443797.80093135865) / Math.Sqrt((89354.10840222854 / (21)) + (3912842.1011541015 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.801150498234977 = (158434.11527192077 - 443797.80093135865) / 158434.11527192077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 277.3409037202381 > 160.25042942354366.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -304.3496212339945 (T) = (0 -277277.15373252623) / Math.Sqrt((1770157.3093528082 / (21)) + (1191082.4109566074 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8239142197258019 = (152023.13285008035 - 277277.15373252623) / 152023.13285008035 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0080919446066663 > 453.10717646597067.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -122.21212272393214 (T) = (0 -1017.4209036407782) / Math.Sqrt((8.22511292727835 / (21)) + (315.42121663155257 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3534526498249009 = (432.30991017239086 - 1017.4209036407782) / 432.30991017239086 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Backtracking(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 561.5065278601068 > 521.4125698783856.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -28.323474218360232 (T) = (0 -565.6186702851035) / Math.Sqrt((33.65587219347624 / (21)) + (54.76542005354392 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.13326162586996804 = (499.10687644690734 - 565.6186702851035) / 499.10687644690734 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 482.6552272418513 > 464.3951171175417.
IsChangePoint: Marked as a change because one of 10/18/2022 9:26:37 AM, 11/7/2022 10:11:20 AM, 12/7/2022 6:04:36 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -28.155582192564033 (T) = (0 -491.22886228414967) / Math.Sqrt((22.00672188426916 / (21)) + (22.46681769438266 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1029644196317906 = (445.3714494690043 - 491.22886228414967) / 445.3714494690043 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.CtorInvoke(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.971931002331004 > 15.023829160255307.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -63.61922325883156 (T) = (0 -22289.12525530984) / Math.Sqrt((78288.7791414292 / (21)) + (154831.78847334994 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5316044543031857 = (14552.794745853906 - 22289.12525530984) / 14552.794745853906 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 173.1330962454212 > 103.1085839533461.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -408.5390515012596 (T) = (0 -173640.8499695024) / Math.Sqrt((39224.0216901987 / (21)) + (450807.28460812167 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7676191464415262 = (98234.31157049109 - 173640.8499695024) / 98234.31157049109 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Ctor(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.506469469496025 > 14.397527463802778.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -63.762366206364284 (T) = (0 -21512.687117692392) / Math.Sqrt((98450.38299697851 / (21)) + (131703.36008122325 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5429537929158629 = (13942.534907048559 - 21512.687117692392) / 13942.534907048559 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchWord(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.881839429591411 > 2.9194835931031524.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -920.6708582935593 (T) = (0 -4884.498562970233) / Math.Sqrt((39.88692722562354 / (21)) + (46.470672895413955 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.756210229129183 = (2781.2721290162467 - 4884.498562970233) / 2781.2721290162467 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsNotMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.86484503167687 > 804.2321157498513.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -613.3054729438629 (T) = (0 -1853.8501706542932) / Math.Sqrt((4.654832817209918 / (21)) + (40.935580709138044 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4198652087143837 = (766.0964602401136 - 1853.8501706542932) / 766.0964602401136 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Backtracking(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 631.1510423419771 > 523.0163611725237.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -54.48500730140142 (T) = (0 -632.5175025761713) / Math.Sqrt((44.28872307830558 / (21)) + (54.411107307783794 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2672980076610781 = (499.1071545543924 - 632.5175025761713) / 499.1071545543924 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 555.0165626856804 > 335.2529991348874.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -109.56940278736103 (T) = (0 -551.3344814165831) / Math.Sqrt((40.88999973291952 / (21)) + (34.63981391053815 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7178679666805625 = (320.9411270890202 - 551.3344814165831) / 320.9411270890202 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.5107328993814564 > 590.9653062361092.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -456.33890309189417 (T) = (0 -1513.080318329074) / Math.Sqrt((2.249614322894108 / (21)) + (59.366035407528855 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6943391474105975 = (561.5775281234452 - 1513.080318329074) / 561.5775281234452 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 549.1568765427661 > 335.4379928403006.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -145.4855908562352 (T) = (0 -550.6053147867264) / Math.Sqrt((22.86369279862468 / (21)) + (20.113560795803206 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7238447175004262 = (319.4054018885783 - 550.6053147867264) / 319.4054018885783 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 399.33302145708586 > 341.50901190574666.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -158.92471854788735 (T) = (0 -401.05827888648247) / Math.Sqrt((2.702669522775457 / (21)) + (1.349183999467825 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.23151645586558753 = (325.6621354723136 - 401.05827888648247) / 325.6621354723136 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.OneNodeBacktracking(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.235583347121682 > 1.649340511481998.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -382.64877844630746 (T) = (0 -3229.939868715025) / Math.Sqrt((13.190193934176154 / (21)) + (253.9856731649748 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0544844247443017 = (1572.1413264629732 - 3229.939868715025) / 1572.1413264629732 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsNotMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 501.04486591114863 > 468.7341957117446.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 11/7/2022 10:11:20 AM, 12/7/2022 6:04:36 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -25.125838864863454 (T) = (0 -490.4569488543476) / Math.Sqrt((15.637741025182581 / (21)) + (37.02794628712546 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.10413855889820471 = (444.1987329414197 - 490.4569488543476) / 444.1987329414197 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsNotMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 496.86711671549267 > 463.2902419234678.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 11/7/2022 10:11:20 AM, 12/7/2022 6:04:36 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.72357742678387 (T) = (0 -491.7589497052268) / Math.Sqrt((18.848167190511425 / (21)) + (23.66358477075831 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.10770538173116788 = (443.9438119698268 - 491.7589497052268) / 443.9438119698268 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsNotMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 502.5264824447334 > 381.6153992395926.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -62.587273117069785 (T) = (0 -506.2590966364348) / Math.Sqrt((91.90449274966389 / (21)) + (8.71396889653523 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.38199038168495486 = (366.3260637307706 - 506.2590966364348) / 366.3260637307706 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesBoundary(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 228.78924136473427 > 124.23083914673046.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -915.8951445811269 (T) = (0 -227911.91413946432) / Math.Sqrt((94315.40114574539 / (21)) + (136898.4828576511 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9232588229125507 = (118502.98640217252 - 227911.91413946432) / 118502.98640217252 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 411.032037309441 > 288.67210377299153.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -62.28609190433081 (T) = (0 -409.38750127980944) / Math.Sqrt((79.52421469248985 / (21)) + (6.929976609254758 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4594870397487625 = (280.500950080572 - 409.38750127980944) / 280.500950080572 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.MatchesSet(Options: IgnoreCase, Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 277.6368285818713 > 159.465313057669.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -496.3104585113759 (T) = (0 -277722.7480256559) / Math.Sqrt((848789.9856017141 / (21)) + (334537.8508196247 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8288406550646973 = (151857.26938896772 - 277722.7480256559) / 151857.26938896772 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Email_IsMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 450.55807956613666 > 341.4648021733846.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -65.06354977546393 (T) = (0 -451.8178462926372) / Math.Sqrt((73.96024467920432 / (21)) + (2.1652895060233 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.38144263712749527 = (327.0623290100017 - 451.8178462926372) / 327.0623290100017 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Date_IsNotMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 689.583994697465 > 373.9703683698419.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -201.69643614201865 (T) = (0 -690.1612556392349) / Math.Sqrt((0.9264804361750055 / (21)) + (37.767075084921025 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9376393073374717 = (356.1866509549664 - 690.1612556392349) / 356.1866509549664 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Backtracking(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.486193539689387 > 2.598845897850161.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -353.4165084576303 (T) = (0 -4485.068479530796) / Math.Sqrt((57.369598252906975 / (21)) + (413.35801891326184 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8100890700295394 = (2477.816453229897 - 4485.068479530796) / 2477.816453229897 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsNotMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.0807397736872533 > 957.3835892557196.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1155.9910652219885 (T) = (0 -2083.6136207854747) / Math.Sqrt((3.489037333484606 / (21)) + (12.085976249361696 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2878342632376423 = (910.736260168093 - 2083.6136207854747) / 910.736260168093 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 408.8677092855215 > 290.3526805352526.
IsChangePoint: Marked as a change because one of 10/17/2022 3:19:47 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -72.01710818025329 (T) = (0 -410.2088782317204) / Math.Sqrt((38.56637535443608 / (21)) + (21.32315414961853 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4744701179793732 = (278.20765794418014 - 410.2088782317204) / 278.20765794418014 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.IP_IsMatch(Options: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.0782165243632336 > 958.9782258614007.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -972.043758867809 (T) = (0 -2083.8374667485664) / Math.Sqrt((9.308193014693261 / (21)) + (14.152471711976583 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2857296962706917 = (911.6727450968831 - 2083.8374667485664) / 911.6727450968831 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.RegularExpressions.Tests.Perf_Regex_Common.SplitWords(Options: Compiled)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.742522733761596 > 13.699952982371606.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 12/17/2022 10:44:50 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -118.69793633002385 (T) = (0 -16636.529735731125) / Math.Sqrt((11913.67043319843 / (21)) + (4769.64362912354 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.27387445653151216 = (13059.78752492521 - 16636.529735731125) / 13059.78752492521 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.MathBenchmarks.Single

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Ceiling - Duration of single invocation	4.98 μs	50.11 μs	10.06	0.04	False
Log10P1 - Duration of single invocation	52.52 μs	106.10 μs	2.02	0.08	False
Exp2M1 - Duration of single invocation	33.92 μs	110.63 μs	3.26	0.06	False
TanPi - Duration of single invocation	54.53 μs	219.41 μs	4.02	0.04	False
Log2P1 - Duration of single invocation	30.26 μs	74.49 μs	2.46	0.08	False
Cos - Duration of single invocation	31.15 μs	83.45 μs	2.68	0.08	False
FusedMultiplyAdd - Duration of single invocation	7.25 μs	53.47 μs	7.37	0.03	False
ScaleB - Duration of single invocation	24.98 μs	43.09 μs	1.73	0.05	False
Abs - Duration of single invocation	4.87 μs	26.91 μs	5.53	0.00	False
ExpM1 - Duration of single invocation	36.79 μs	71.86 μs	1.95	0.09	False
Exp10M1 - Duration of single invocation	69.54 μs	109.98 μs	1.58	0.08	False
CopySign - Duration of single invocation	13.36 μs	80.83 μs	6.05	0.00	False
Log10 - Duration of single invocation	52.71 μs	93.49 μs	1.77	0.07	False
Exp10 - Duration of single invocation	68.70 μs	105.46 μs	1.54	0.06	False
Sin - Duration of single invocation	28.66 μs	58.38 μs	2.04	0.07	False
Exp - Duration of single invocation	36.38 μs	61.59 μs	1.69	0.09	False
Sqrt - Duration of single invocation	4.48 μs	46.93 μs	10.48	0.03	False
CosPi - Duration of single invocation	52.43 μs	167.54 μs	3.20	0.02	False
SinCosPi - Duration of single invocation	99.05 μs	325.56 μs	3.29	0.02	False
Round - Duration of single invocation	20.38 μs	62.05 μs	3.04	0.04	False
Log2 - Duration of single invocation	30.41 μs	91.81 μs	3.02	0.08	False
Hypot - Duration of single invocation	29.73 μs	199.35 μs	6.70	0.03	False
Max - Duration of single invocation	5.44 μs	25.98 μs	4.78	0.00	False
Floor - Duration of single invocation	4.95 μs	52.44 μs	10.59	0.05	False
ILogB - Duration of single invocation	23.39 μs	33.63 μs	1.44	0.03	False
SinPi - Duration of single invocation	52.75 μs	166.03 μs	3.15	0.04	False
Exp2 - Duration of single invocation	33.52 μs	130.58 μs	3.90	0.11	False
Min - Duration of single invocation	6.72 μs	25.91 μs	3.86	0.00	False
SinCos - Duration of single invocation	53.06 μs	172.75 μs	3.26	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.Single*'

Payloads

Baseline
Compare

Histogram

System.MathBenchmarks.Single.Ceiling

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.1122374198718 > 5.191586167044138.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -46.599885140655516 (T) = (0 -47478.32942123573) / Math.Sqrt((3434.69450179584 / (21)) + (11667411.552713064 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.62440829239547 = (4933.116715211445 - 47478.32942123573) / 4933.116715211445 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Log10P1

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 106.10161385135135 > 55.13079217701343.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -16.084398796826537 (T) = (0 -118878.08706528693) / Math.Sqrt((5420457.4606792135 / (21)) + (231124446.35830215 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2422872787906827 = (53016.439146638084 - 118878.08706528693) / 53016.439146638084 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Exp2M1

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 110.6309244172494 > 35.62953427486825.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -13.970473581487738 (T) = (0 -124921.57077825251) / Math.Sqrt((12593.698218607304 / (21)) + (593498229.7270209 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.678535608204071 = (33959.592643237054 - 124921.57077825251) / 33959.592643237054 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.TanPi

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 219.41444502314815 > 57.22897182394882.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -248.6243684506745 (T) = (0 -219338.51835967027) / Math.Sqrt((9140260.650487592 / (21)) + (11576.415828671441 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9766546497541246 = (55156.54178650688 - 219338.51835967027) / 55156.54178650688 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Log2P1

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.48546498015874 > 31.76797706304506.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -13.740287868099454 (T) = (0 -87349.41803484174) / Math.Sqrt((5816999.474101757 / (21)) + (233423259.95021427 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8378643301015636 = (30779.983774529355 - 87349.41803484174) / 30779.983774529355 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Cos

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 83.44838143738977 > 32.669659264249816.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -9.584298030652882 (T) = (0 -82927.06183696099) / Math.Sqrt((19148.45346253687 / (21)) + (409074073.1432959 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6649054257291782 = (31118.200682213806 - 82927.06183696099) / 31118.200682213806 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.FusedMultiplyAdd

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.47233632983911 > 7.612709186357859.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -32.44688730864207 (T) = (0 -54527.21075915756) / Math.Sqrt((9.440798942419434 / (21)) + (29723095.43713592 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.521473467081446 = (7249.538404649287 - 54527.21075915756) / 7249.538404649287 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.ScaleB

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.093019834710745 > 26.242550662500005.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -111.15631386693227 (T) = (0 -43155.022572839305) / Math.Sqrt((521697.81920754246 / (21)) + (19620.800519382516 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7160680212738223 = (25147.617715529545 - 43155.022572839305) / 25147.617715529545 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Abs

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.910632775362316 > 5.112219290985203.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1459.8145398706351 (T) = (0 -26999.061969314596) / Math.Sqrt((8.18453133701203 / (21)) + (3211.5655634538334 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.543820197800125 = (4870.118619652969 - 26999.061969314596) / 4870.118619652969 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.ExpM1

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 71.85786611238532 > 38.62457638252555.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.797455639693435 (T) = (0 -77887.49724166685) / Math.Sqrt((923.9088380811658 / (21)) + (170060380.43574616 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.118235023647953 = (36769.997838828865 - 77887.49724166685) / 36769.997838828865 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Exp10M1

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 109.98035988849766 > 72.97472088955783.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -8.137573133170786 (T) = (0 -124603.94867975496) / Math.Sqrt((1736.2651002834282 / (21)) + (642094496.9875959 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7930198048708363 = (69493.90538869762 - 124603.94867975496) / 69493.90538869762 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.CopySign

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 80.83309733676978 > 14.022949983306626.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1203.549029485522 (T) = (0 -80858.11498962369) / Math.Sqrt((55.53103588601975 / (21)) + (44006.28869432191 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.0556425618438885 = (13352.524387602414 - 80858.11498962369) / 13352.524387602414 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Log10

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 93.49088335421888 > 55.33815647411617.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -10.965731020008445 (T) = (0 -102792.55952044865) / Math.Sqrt((4518409.158489363 / (21)) + (283508575.25149715 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9327517810953553 = (53184.56333911262 - 102792.55952044865) / 53184.56333911262 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Exp10

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 105.46131735378714 > 72.04652679961622.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -7.649797773816926 (T) = (0 -115964.48499211084) / Math.Sqrt((5248.0286438338535 / (21)) + (536415836.9922429 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6901363089784154 = (68612.50443297341 - 115964.48499211084) / 68612.50443297341 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Sin

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.379678536687045 > 29.94564601341292.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -9.318415621514292 (T) = (0 -72687.84445436962) / Math.Sqrt((7514.530385391052 / (21)) + (314360210.84986365 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.547654783629567 = (28531.27704798899 - 72687.84445436962) / 28531.27704798899 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Exp

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 61.58633682208993 > 38.234644140882494.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -7.572944153831165 (T) = (0 -73796.4518240454) / Math.Sqrt((10231892.284697725 / (21)) + (321995061.08560824 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9893644081976211 = (37095.49216822751 - 73796.4518240454) / 37095.49216822751 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Sqrt

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.93047847222222 > 4.699900101350419.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -56.71743701127244 (T) = (0 -51847.34130469147) / Math.Sqrt((1204.7057258063628 / (21)) + (9762701.639837347 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -10.566433849328654 = (4482.569301833757 - 51847.34130469147) / 4482.569301833757 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.CosPi

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 167.5398947933715 > 55.142962222709485.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -635.3942712852847 (T) = (0 -168157.19333982567) / Math.Sqrt((2338.3183990886273 / (21)) + (462264.85430225614 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.2027197941568346 = (52504.49747324699 - 168157.19333982567) / 52504.49747324699 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.SinCosPi

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 325.5639425347223 > 104.0604134533228.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -5752.163818577633 (T) = (0 -325404.0379131308) / Math.Sqrt((12286.143140244956 / (21)) + (13494.312158987563 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.286278161563442 = (99019.0184504407 - 325404.0379131308) / 99019.0184504407 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Round

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 62.05106145479025 > 21.365932324854835.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2923.1318739758085 (T) = (0 -62107.00577222963) / Math.Sqrt((560.4443685903555 / (21)) + (2480.8837916834846 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.049364076516291 = (20367.199263127357 - 62107.00577222963) / 20367.199263127357 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Log2

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 91.81228884469698 > 31.95594405235243.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.762807796997652 (T) = (0 -72392.0677800099) / Math.Sqrt((2883.223819210767 / (21)) + (177826140.44720447 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3758807039379277 = (30469.571834992777 - 72392.0677800099) / 30469.571834992777 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Hypot

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 199.354557700422 > 31.249601801033748.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1057.9866107780333 (T) = (0 -199809.58538976405) / Math.Sqrt((10520.78939628351 / (21)) + (355022.82087014057 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.733248420013225 = (29675.065128426024 - 199809.58538976405) / 29675.065128426024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Max

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.984228839585327 > 5.712463615459666.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -548.878913188423 (T) = (0 -26135.62615628782) / Math.Sqrt((24.207812891030333 / (21)) + (19882.574712342586 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.8020907744758667 = (5442.5514601273735 - 26135.62615628782) / 5442.5514601273735 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Floor

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.44342104236344 > 5.197763161981804.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -45.814344282604736 (T) = (0 -48081.90690396581) / Math.Sqrt((992.6170103884533 / (21)) + (12413289.96653214 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.731838202008921 = (4940.680877127651 - 48081.90690396581) / 4940.680877127651 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.ILogB

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.6281875286785 > 24.56587824978949.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -54.955825304321124 (T) = (0 -33268.04320929101) / Math.Sqrt((531742.3870317203 / (21)) + (83225.4024333466 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4126144881716241 = (23550.688094917194 - 33268.04320929101) / 23550.688094917194 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.SinPi

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 166.03147293233081 > 55.419790743420975.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2261.028294397617 (T) = (0 -166003.19626888266) / Math.Sqrt((50331.08805567746 / (21)) + (1417.9056527138148 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.1323090159932914 = (52997.068750651706 - 166003.19626888266) / 52997.068750651706 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Exp2

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 130.57938071170284 > 35.28953417905621.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -13.560987981675112 (T) = (0 -122147.76246055197) / Math.Sqrt((1661.860933027428 / (21)) + (596729187.1843913 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.6339998496041823 = (33612.484181543485 - 122147.76246055197) / 33612.484181543485 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.Min

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.90970378472222 > 7.049061347138061.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -557.908273651094 (T) = (0 -26038.856106499356) / Math.Sqrt((33.55593338889365 / (21)) + (16771.0592898815 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.8770648416549114 = (6716.126030893195 - 26038.856106499356) / 6716.126030893195 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.MathBenchmarks.Single.SinCos

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 172.74767147435898 > 55.67485608487636.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -30.033832102802602 (T) = (0 -190576.84609769008) / Math.Sqrt((4615.189270001271 / (21)) + (293757804.27308714 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.595754359127192 = (53000.51868502757 - 190576.84609769008) / 53000.51868502757 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Json.Node.Tests.Perf_ParseThenWrite

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ParseThenWrite - Duration of single invocation	126.59 μs	275.73 μs	2.18	0.02	False
ParseThenWrite - Duration of single invocation	16.75 μs	36.87 μs	2.20	0.01	False
ParseThenWrite - Duration of single invocation	29.31 μs	59.45 μs	2.03	0.04	False
ParseThenWrite - Duration of single invocation	10.57 ms	21.35 ms	2.02	0.01	False
ParseThenWrite - Duration of single invocation	1.69 μs	3.30 μs	1.96	0.08	False
ParseThenWrite - Duration of single invocation	116.48 μs	259.46 μs	2.23	0.01	False
ParseThenWrite - Duration of single invocation	14.01 μs	26.75 μs	1.91	0.09	False
ParseThenWrite - Duration of single invocation	9.87 ms	19.98 ms	2.02	0.01	False
ParseThenWrite - Duration of single invocation	13.32 μs	25.89 μs	1.94	0.02	False
ParseThenWrite - Duration of single invocation	94.79 μs	200.58 μs	2.12	0.02	False
ParseThenWrite - Duration of single invocation	27.99 μs	56.15 μs	2.01	0.02	False
ParseThenWrite - Duration of single invocation	65.42 μs	160.89 μs	2.46	0.01	False
ParseThenWrite - Duration of single invocation	77.51 μs	177.79 μs	2.29	0.01	False
ParseThenWrite - Duration of single invocation	88.88 μs	190.39 μs	2.14	0.01	False
ParseThenWrite - Duration of single invocation	1.74 μs	3.20 μs	1.84	0.05	False
ParseThenWrite - Duration of single invocation	15.70 μs	34.61 μs	2.20	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Node.Tests.Perf_ParseThenWrite*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: BroadTree)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 275.7331887781469 > 133.98073897992887.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -278.17286002828484 (T) = (0 -277409.62061153783) / Math.Sqrt((2820324.7612142493 / (21)) + (2189291.7178632864 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1768946984453534 = (127433.64243096007 - 277409.62061153783) / 127433.64243096007 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfStrings)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.87079850833577 > 17.634567833012472.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -175.72247018242632 (T) = (0 -36446.385884993484) / Math.Sqrt((5953.229156041082 / (21)) + (170585.99000580117 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.166201377371782 = (16825.02202505905 - 36446.385884993484) / 16825.02202505905 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: LotsOfNumbers)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.44685465808912 > 30.858308840460527.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -228.73581348380222 (T) = (0 -59464.21716719908) / Math.Sqrt((218328.75829321734 / (21)) + (92221.37664139502 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0052080508179952 = (29654.886505637918 - 59464.21716719908) / 29654.886505637918 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.34832252380952 > 11.096348969021738.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -334.248247733203 (T) = (0 -21333276.835835297) / Math.Sqrt((17295216151.762505 / (21)) + (3173612055.7325134 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0315448383939616 = (10501012.053812372 - 21333276.835835297) / 10501012.053812372 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: HelloWorld)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.3047318273821307 > 1.7284766593112069.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -131.49734296561442 (T) = (0 -3281.921750656457) / Math.Sqrt((1426.3104166520657 / (21)) + (1186.6339927512754 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9805260258514515 = (1657.0959976380618 - 3281.921750656457) / 1657.0959976380618 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: BroadTree)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 259.46432080304606 > 122.05282444444445.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -403.57545252602057 (T) = (0 -260760.4413182729) / Math.Sqrt((780953.7840336597 / (21)) + (1269073.9609582063 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2389560193516573 = (116465.19139477436 - 260760.4413182729) / 116465.19139477436 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400B)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.750089772238937 > 14.996896700756464.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -151.76738529725435 (T) = (0 -26859.009847723035) / Math.Sqrt((127558.96950603747 / (21)) + (12457.77455900924 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8922974861803373 = (14193.862246225777 - 26859.009847723035) / 14193.862246225777 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.983630071428575 > 10.3565396440625.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -274.61651836824177 (T) = (0 -20245308.760232426) / Math.Sqrt((16288372501.53098 / (21)) + (8798965898.28646 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0336949488492269 = (9954938.8032302 - 20245308.760232426) / 9954938.8032302 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400B)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.890896513402577 > 13.981047374387254.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -192.48258829362857 (T) = (0 -25879.17285185807) / Math.Sqrt((49857.39983868573 / (21)) + (25406.06865145513 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9282024272012381 = (13421.398338047613 - 25879.17285185807) / 13421.398338047613 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 200.5837253675488 > 99.70693403481934.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -422.8165419910387 (T) = (0 -200376.38007805022) / Math.Sqrt((608083.6886356698 / (21)) + (458493.5381647944 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1015730138958661 = (95345.90459295789 - 200376.38007805022) / 95345.90459295789 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfNumbers)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.15289556365899 > 29.392306127012525.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -166.9261233483314 (T) = (0 -56221.30728368387) / Math.Sqrt((525124.0173040056 / (21)) + (45106.016791147915 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9953722744566668 = (28175.84868918395 - 56221.30728368387) / 28175.84868918395 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: DeepTree)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 160.88801981833197 > 69.37542962420886.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -471.78553257454064 (T) = (0 -160634.44250279214) / Math.Sqrt((453091.55402097444 / (21)) + (258105.63355611003 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.424184326558389 = (66263.2955518051 - 160634.44250279214) / 66263.2955518051 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: DeepTree)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 177.79377446102822 > 81.32343065468697.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -764.7743541244795 (T) = (0 -177119.20684331443) / Math.Sqrt((152761.76025006158 / (21)) + (135936.62126452735 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2868434885720683 = (77451.38997418215 - 177119.20684331443) / 77451.38997418215 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json4KB)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 190.3897471736375 > 94.58107477650185.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -456.8822363211635 (T) = (0 -190271.28326144192) / Math.Sqrt((609490.2743448026 / (21)) + (267105.37629602134 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.112557651769016 = (90066.78852154038 - 190271.28326144192) / 90066.78852154038 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: HelloWorld)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.197263240939257 > 1.674892682414017.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -110.43161298679907 (T) = (0 -3196.9463090488885) / Math.Sqrt((1787.2176567417032 / (21)) + (1695.1337380237076 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9841566512660243 = (1611.2368481636888 - 3196.9463090488885) / 1611.2368481636888 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfStrings)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.61310618346756 > 16.64740970830466.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -282.306430524141 (T) = (0 -34752.555446068494) / Math.Sqrt((38068.05746349236 / (21)) + (37860.91425817447 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.202472334007236 = (15778.883988448917 - 34752.555446068494) / 15778.883988448917 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Collections.Sort<IntClass>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Array_ComparerClass - Duration of single invocation	108.07 μs	122.72 μs	1.14	0.01	False
Array - Duration of single invocation	41.68 μs	101.40 μs	2.43	0.00	False
Array_Comparison - Duration of single invocation	101.77 μs	115.07 μs	1.13	0.02	False
List - Duration of single invocation	41.93 μs	101.26 μs	2.41	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;IntClass&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.Sort<IntClass>.Array_ComparerClass(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 122.71699753333333 > 113.835035111.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -24.75587196731038 (T) = (0 -120790.01354382522) / Math.Sqrt((112326.65002893987 / (21)) + (3436252.63371228 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.11437714988739092 = (108392.39978676087 - 120790.01354382522) / 108392.39978676087 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;IntClass&gt;.Array(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.40218795999999 > 43.732516604000004.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -847.613952844585 (T) = (0 -101383.91610003139) / Math.Sqrt((25283.390519800174 / (21)) + (52653.81055598815 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4336643034266134 = (41658.95680734695 - 101383.91610003139) / 41658.95680734695 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;IntClass&gt;.Array_Comparison(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 115.07050081538463 > 107.37096215999999.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -43.58767812276308 (T) = (0 -116718.30978083727) / Math.Sqrt((149486.01003306574 / (21)) + (1423769.4886633637 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.14049649214741405 = (102339.91124433106 - 116718.30978083727) / 102339.91124433106 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort&lt;IntClass&gt;.List(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.25861872 > 43.7923731765.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -938.1967568741411 (T) = (0 -101389.80565029827) / Math.Sqrt((16410.582256518104 / (21)) + (45619.8946465076 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4280948496447043 = (41756.93781696144 - 101389.80565029827) / 41756.93781696144 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Diagnostics.Perf_Activity

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
EnumerateActivityLinksLarge - Duration of single invocation	24.26 μs	25.92 μs	1.07	0.06	False
EnumerateActivityLinksSmall - Duration of single invocation	148.15 ns	159.67 ns	1.08	0.05	False
EnumerateActivityLinkTagsSmall - Duration of single invocation	102.51 ns	117.42 ns	1.15	0.07	False
ActivityAllocations - Duration of single invocation	415.52 ns	606.84 ns	1.46	0.21	False
ActivityAllocations - Duration of single invocation	464.76 ns	719.95 ns	1.55	0.02	False
EnumerateActivityTagObjectsLarge - Duration of single invocation	15.49 μs	16.74 μs	1.08	0.00	False
EnumerateActivityTagsLarge - Duration of single invocation	20.25 μs	30.11 μs	1.49	0.00	False
EnumerateActivityTagObjectsSmall - Duration of single invocation	102.93 ns	119.15 ns	1.16	0.03	False
EnumerateActivityTagsSmall - Duration of single invocation	139.73 ns	177.89 ns	1.27	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Diagnostics.Perf_Activity*'

Payloads

Baseline
Compare

Histogram

System.Diagnostics.Perf_Activity.EnumerateActivityLinksLarge

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.916281669463086 > 25.4905542510353.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -7.964422259285321 (T) = (0 -26139.688546786852) / Math.Sqrt((13081.966309062125 / (21)) + (754208.3197196086 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.07657298357356938 = (24280.46119086041 - 26139.688546786852) / 24280.46119086041 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.EnumerateActivityLinksSmall

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 159.66581303303428 > 157.30104646581535.
IsChangePoint: Marked as a change because one of 11/3/2022 4:18:41 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.52420176085073 (T) = (0 -160.48885201542484) / Math.Sqrt((1.900053710431532 / (21)) + (11.414662574362731 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.07335475148348423 = (149.5207915124176 - 160.48885201542484) / 149.5207915124176 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.EnumerateActivityLinkTagsSmall

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 117.4162475288066 > 107.01452739380068.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -45.241129896357386 (T) = (0 -118.49936452331556) / Math.Sqrt((0.6662932830155123 / (21)) + (1.4194822474294453 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.16183968423949924 = (101.99287055759437 - 118.49936452331556) / 101.99287055759437 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat: Hierarchical)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 606.8417374259873 > 439.84982627686554.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -57.17768492282196 (T) = (0 -589.322329124271) / Math.Sqrt((74.04967238679234 / (21)) + (78.10779694324927 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4139594915172139 = (416.78869349496955 - 589.322329124271) / 416.78869349496955 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.ActivityAllocations(idFormat: W3C)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 719.9488615558864 > 490.7411934699766.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -96.09099499611015 (T) = (0 -706.6663949584016) / Math.Sqrt((28.863472306906168 / (21)) + (66.43128420730294 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5068822025608137 = (468.9592814604116 - 706.6663949584016) / 468.9592814604116 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagObjectsLarge

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.74388722280887 > 16.26769154427471.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -15.870391900395644 (T) = (0 -16654.206115908764) / Math.Sqrt((53106.76242055368 / (21)) + (17894.30327761598 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.06247055492345452 = (15674.981333584923 - 16654.206115908764) / 15674.981333584923 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagsLarge

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.112529962719613 > 21.320226730214028.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -195.4933450986655 (T) = (0 -30161.0543625869) / Math.Sqrt((29189.263039188623 / (21)) + (16194.89701422271 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.48610075640321737 = (20295.430328415383 - 30161.0543625869) / 20295.430328415383 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagObjectsSmall

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 119.15284901991089 > 106.7077186843021.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -28.18878902913313 (T) = (0 -119.96928283189199) / Math.Sqrt((2.463933740947966 / (21)) + (3.775627014565768 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1711996039962096 = (102.43282393756705 - 119.96928283189199) / 102.43282393756705 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Diagnostics.Perf_Activity.EnumerateActivityTagsSmall

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 177.89147523201282 > 147.31183802395498.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -56.79736481094328 (T) = (0 -175.9098639423055) / Math.Sqrt((4.825134077162524 / (21)) + (1.9778273251681153 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.24482631592853046 = (141.3127772857953 - 175.9098639423055) / 141.3127772857953 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Remainder - Duration of single invocation	2.24 ms	7.67 ms	3.43	0.00	False
Subtract - Duration of single invocation	10.86 μs	13.56 μs	1.25	0.34	False
Multiply - Duration of single invocation	1.93 μs	3.84 μs	1.99	0.00	False
Ctor_ByteArray - Duration of single invocation	106.87 ns	391.73 ns	3.67	0.01	False
ToStringD - Duration of single invocation	1.66 μs	3.79 μs	2.29	0.00	False
Add - Duration of single invocation	10.81 μs	13.45 μs	1.24	0.35	False
Parse - Duration of single invocation	2.72 μs	4.99 μs	1.84	0.01	False
ToByteArray - Duration of single invocation	129.02 ns	178.71 ns	1.39	0.05	False
Parse - Duration of single invocation	350.82 ns	609.93 ns	1.74	0.03	False
GreatestCommonDivisor - Duration of single invocation	9.73 ms	16.72 ms	1.72	0.00	False
Divide - Duration of single invocation	2.23 ms	7.66 ms	3.43	0.00	False
ToByteArray - Duration of single invocation	30.70 ns	45.88 ns	1.49	0.44	False
ToStringX - Duration of single invocation	89.32 ns	197.93 ns	2.22	0.20	False
GreatestCommonDivisor - Duration of single invocation	36.66 ns	46.68 ns	1.27	0.05	False
Divide - Duration of single invocation	16.07 ns	27.77 ns	1.73	0.13	False
Subtract - Duration of single invocation	149.37 ns	274.53 ns	1.84	0.04	False
Ctor_ByteArray - Duration of single invocation	16.27 ns	30.94 ns	1.90	0.13	False
ModPow - Duration of single invocation	123.78 μs	297.59 μs	2.40	0.00	False
Remainder - Duration of single invocation	868.56 ns	1.55 μs	1.78	0.01	False
Remainder - Duration of single invocation	14.77 ns	26.42 ns	1.79	0.31	False
ToByteArray - Duration of single invocation	44.80 ns	59.47 ns	1.33	0.16	False
Multiply - Duration of single invocation	1.72 ms	3.30 ms	1.92	0.00	False
GreatestCommonDivisor - Duration of single invocation	7.41 μs	12.36 μs	1.67	0.00	False
Multiply - Duration of single invocation	19.02 ns	37.78 ns	1.99	0.07	False
ToStringX - Duration of single invocation	113.04 ns	218.55 ns	1.93	0.38	False
ModPow - Duration of single invocation	104.72 ns	126.38 ns	1.21	0.01	False
ToStringD - Duration of single invocation	178.95 ns	234.10 ns	1.31	0.21	False
Ctor_ByteArray - Duration of single invocation	12.07 ns	21.35 ns	1.77	0.47	False
Parse - Duration of single invocation	243.42 ns	457.76 ns	1.88	0.08	False
Add - Duration of single invocation	17.98 ns	40.02 ns	2.23	0.16	False
ToStringX - Duration of single invocation	723.03 ns	1.19 μs	1.65	0.20	False
ModPow - Duration of single invocation	2.34 ms	5.28 ms	2.26	0.00	False
Subtract - Duration of single invocation	18.10 ns	39.70 ns	2.19	0.11	False
Divide - Duration of single invocation	844.69 ns	1.59 μs	1.89	0.01	False
ToStringD - Duration of single invocation	72.81 ns	166.81 ns	2.29	0.18	False
Add - Duration of single invocation	149.57 ns	272.68 ns	1.82	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 65536,32768 bits)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.665632376488095 > 2.348975491875.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -287.8996664920833 (T) = (0 -7683873.256172052) / Math.Sqrt((1409856.4143728246 / (21)) + (5010422790.259409 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.4350509415434494 = (2236902.2721740208 - 7683873.256172052) / 2236902.2721740208 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 65536,65536 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.558613634608253 > 10.915677819112016.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -33.13065171013099 (T) = (0 -13495.816805792902) / Math.Sqrt((151523.68108038523 / (21)) + (5501.714141748428 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2724748958621315 = (10605.959182125294 - 13495.816805792902) / 10605.959182125294 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 1024,1024 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.842557291409782 > 2.030002307379021.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1088.4647251922977 (T) = (0 -3830.9133453801555) / Math.Sqrt((12.159160222358846 / (21)) + (34.3605535504975 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9796032859264165 = (1935.1924562942727 - 3830.9133453801555) / 1935.1924562942727 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 391.73135582411203 > 113.42259297717119.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -494.1931337846444 (T) = (0 -392.20696347589103) / Math.Sqrt((1.747948347669217 / (21)) + (3.4498758158638014 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.616046712022371 = (108.46291398059367 - 392.20696347589103) / 108.46291398059367 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.785500608943286 > 1.7328440871787827.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -395.8405207794823 (T) = (0 -3800.6389122425912) / Math.Sqrt((136.6544185473477 / (21)) + (319.4938484525274 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.293771297862564 = (1656.9389092034555 - 3800.6389122425912) / 1656.9389092034555 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Add(arguments: 65536,65536 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.4481588989118 > 10.870020242175732.
IsChangePoint: Marked as a change because one of 11/19/2022 5:03:25 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -30.811767552582317 (T) = (0 -13504.145984522782) / Math.Sqrt((218782.22943546786 / (21)) + (2772.1298130859163 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.30734343717853524 = (10329.45559712066 - 13504.145984522782) / 10329.45559712066 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Parse(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.990864981169105 > 2.855001983542498.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -278.66321792300624 (T) = (0 -4928.473079939424) / Math.Sqrt((99.54665535560329 / (21)) + (813.091167974088 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8120418962307725 = (2719.8449937560154 - 4928.473079939424) / 2719.8449937560154 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 178.71085495734417 > 135.55687991542865.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.79198364141574 (T) = (0 -183.16931225952794) / Math.Sqrt((1.903774436704974 / (21)) + (6.717866568917868 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.41226535912834367 = (129.69893446411575 - 183.16931225952794) / 129.69893446411575 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Parse(numberString: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 609.932613587836 > 367.14558201335996.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -176.17346436663283 (T) = (0 -612.8639810744934) / Math.Sqrt((21.246292271138465 / (21)) + (17.12500845466861 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7535978041903388 = (349.4894779236231 - 612.8639810744934) / 349.4894779236231 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 65536,65536 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.71668960888889 > 10.209068587578123.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -191.95815691549515 (T) = (0 -16603209.609107362) / Math.Sqrt((13452443.213022754 / (21)) + (17964585103.374863 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7072267609638939 = (9725251.494847264 - 16603209.609107362) / 9725251.494847264 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 65536,32768 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.662369023611112 > 2.3466915374999995.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -178.66178769749635 (T) = (0 -7836086.823131024) / Math.Sqrt((894672.0870524466 / (21)) + (13759667029.251143 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.5062556980457793 = (2234887.4406103604 - 7836086.823131024) / 2234887.4406103604 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 123)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.87595738515352 > 32.42159406696717.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -31.504727261100015 (T) = (0 -47.0319676473892) / Math.Sqrt((1.6332879447282065 / (21)) + (2.3610855399095327 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.49818394978536346 = (31.392652186753978 - 47.0319676473892) / 31.392652186753978 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString: 123)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 197.93158936240292 > 92.17494995895647.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -163.40882441347685 (T) = (0 -194.71484077459283) / Math.Sqrt((4.908903366789298 / (21)) + (2.7113180782135284 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2156372105966096 = (87.88209542760005 - 194.71484077459283) / 87.88209542760005 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 16,16 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.68372421112473 > 38.53501843631395.
IsChangePoint: Marked as a change because one of 12/15/2022 2:06:03 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -59.61033420583144 (T) = (0 -46.67834267255159) / Math.Sqrt((0.5640753573669233 / (21)) + (0.0021071798586446656 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.26563624044335526 = (36.881325914150544 - 46.67834267255159) / 36.881325914150544 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 16,8 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.76911507414821 > 16.967810009985314.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -151.53332213700827 (T) = (0 -27.594056381712466) / Math.Sqrt((0.06807839356609491 / (21)) + (0.03338763346542169 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7004627003110092 = (16.22738115729654 - 27.594056381712466) / 16.22738115729654 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 1024,1024 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 274.53372746363056 > 156.89027166097125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -79.99671092568934 (T) = (0 -280.33365191025416) / Math.Sqrt((11.889500405434486 / (21)) + (28.57416587890143 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8544892476578504 = (151.16488395082632 - 280.33365191025416) / 151.16488395082632 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.93662542861077 > 17.641612107951197.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -58.148901145885674 (T) = (0 -31.464400778445825) / Math.Sqrt((0.7072790497466702 / (21)) + (0.4131592150277565 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8676563677528003 = (16.846996761135664 - 31.464400778445825) / 16.846996761135664 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 1024,1024,64 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 297.59419308176103 > 129.8388623843504.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -308.54525431547376 (T) = (0 -295540.04188278737) / Math.Sqrt((19501.103400486943 / (21)) + (4330010.165647338 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3893659623648957 = (123689.73465675137 - 295540.04188278737) / 123689.73465675137 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 1024,512 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.5466688876019448 > 912.1875810504905.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -207.46025189317604 (T) = (0 -1553.3988025815013) / Math.Sqrt((6.096538774421819 / (21)) + (149.13403927453797 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7914377167028099 = (867.1240915037639 - 1553.3988025815013) / 867.1240915037639 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 16,8 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.423053699526985 > 16.184749825132812.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -134.472571691571 (T) = (0 -26.23335456430493) / Math.Sqrt((0.11209634869496765 / (21)) + (0.018943903029532885 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.722066435955058 = (15.23364837533455 - 26.23335456430493) / 15.23364837533455 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.47049451698102 > 47.12834654654912.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.398380231031624 (T) = (0 -62.544627251481515) / Math.Sqrt((1.5202177463189266 / (21)) + (4.4220028523286885 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3754292702197935 = (45.472805185748946 - 62.544627251481515) / 45.472805185748946 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 65536,65536 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.3015877125 > 1.8086548242187501.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -524.3147164563959 (T) = (0 -3310519.5608817376) / Math.Sqrt((19863197.077013336 / (21)) + (115217273.55815779 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9221521623111706 = (1722298.382923656 - 3310519.5608817376) / 1722298.382923656 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 1024,1024 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.35835040417981 > 7.777209361594024.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -297.6955907883625 (T) = (0 -12305.5264034273) / Math.Sqrt((47.69736443576445 / (21)) + (3752.6094522316516 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6604323353982525 = (7411.0375599712925 - 12305.5264034273) / 7411.0375599712925 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 16,16 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.77840455480978 > 19.953402684768502.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -427.24470418753674 (T) = (0 -37.81822949301751) / Math.Sqrt((0.004769499354795581 / (21)) + (0.024023637987327227 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9919998570163929 = (18.985056329101077 - 37.81822949301751) / 18.985056329101077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 218.55416714023895 > 123.30000187756964.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -65.82694714404528 (T) = (0 -218.5233588523961) / Math.Sqrt((39.987195502773574 / (21)) + (5.159597688413741 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8319247396460163 = (119.2862098115567 - 218.5233588523961) / 119.2862098115567 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16,16,16 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 126.37629389021639 > 109.97420710803593.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -195.30908388916916 (T) = (0 -126.15087098062835) / Math.Sqrt((0.0067814442895882746 / (21)) + (0.1640633881087116 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.20466472394275545 = (104.71865613176445 - 126.15087098062835) / 104.71865613176445 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 234.09697432000323 > 183.08596877611765.
IsChangePoint: Marked as a change because one of 12/1/2022 7:29:59 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -21.50186005999958 (T) = (0 -238.90341522649487) / Math.Sqrt((63.76978599700292 / (21)) + (77.45735501132393 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.35771325147382577 = (175.96014104389147 - 238.90341522649487) / 175.96014104389147 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 123)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.34997238054137 > 12.659580890060345.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -74.98672079323721 (T) = (0 -20.824327434725387) / Math.Sqrt((0.24482612768011358 / (21)) + (0.04836836715613314 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7943101704895692 = (11.605756784538297 - 20.824327434725387) / 11.605756784538297 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Parse(numberString: 123)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 457.76079629955774 > 256.5884787039181.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -184.99024649276214 (T) = (0 -458.6120958829428) / Math.Sqrt((8.351896171350523 / (21)) + (12.851585476054833 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8610798458810347 = (246.42257928801328 - 458.6120958829428) / 246.42257928801328 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Add(arguments: 16,16 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.015420269808374 > 19.413396494556068.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -396.49666998594756 (T) = (0 -39.975057351438195) / Math.Sqrt((0.04256054323526885 / (21)) + (0.01365240983192746 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.190259016255709 = (18.251292223773763 - 39.975057351438195) / 18.251292223773763 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToStringX(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1927656367680137 > 695.593277216708.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -118.04699053947222 (T) = (0 -1183.2090863833157) / Math.Sqrt((354.33457700571773 / (21)) + (32.88657586715061 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7775102938120878 = (665.655265402587 - 1183.2090863833157) / 665.655265402587 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16384,16384,64 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.281740159722222 > 2.4377513435267857.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -868.8218931540938 (T) = (0 -5288816.390363357) / Math.Sqrt((68339217.54824972 / (21)) + (117179138.83959539 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2731638558878104 = (2326632.2736324472 - 5288816.390363357) / 2326632.2736324472 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 16,16 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.695681072212224 > 19.00569457546322.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -138.50207473953267 (T) = (0 -39.859796349689425) / Math.Sqrt((0.48901676369546276 / (21)) + (0.017079129419009333 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1927566447259375 = (18.177938917919146 - 39.859796349689425) / 18.177938917919146 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 1024,512 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.594032136017073 > 878.6847834991906.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -231.00499657963186 (T) = (0 -1592.1750461879515) / Math.Sqrt((12.253984150855837 / (21)) + (140.98045817698707 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8995628832635443 = (838.179699243499 - 1592.1750461879515) / 838.179699243499 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 123)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 166.80566695216692 > 76.6408964689134.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -131.26064503803553 (T) = (0 -166.77119041791386) / Math.Sqrt((4.459556420877653 / (21)) + (3.9942947442332835 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.24841659805465 = (74.1727269591435 - 166.77119041791386) / 74.1727269591435 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.Add(arguments: 1024,1024 bits)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 272.6808672239662 > 153.40146740170468.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -138.36766501990815 (T) = (0 -270.0135227804941) / Math.Sqrt((14.047958520038213 / (21)) + (1.7729301660694519 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8418957957993088 = (146.5954390016505 - 270.0135227804941) / 146.5954390016505 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Tests.Perf_Single

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
TryParse - Duration of single invocation	138.92 ns	267.61 ns	1.93	0.01	False
ToStringWithFormat - Duration of single invocation	1.91 μs	4.48 μs	2.34	0.00	False
IsNaN - Duration of single invocation	669.64 μs	2.77 ms	4.14	0.00	False
ToStringWithFormat - Duration of single invocation	224.11 ns	552.42 ns	2.46	0.03	False
TryParse - Duration of single invocation	94.61 ns	175.05 ns	1.85	0.13	False
Parse - Duration of single invocation	142.20 ns	262.13 ns	1.84	0.01	False
ToStringWithFormat - Duration of single invocation	221.06 ns	555.58 ns	2.51	0.01	False
ToStringWithFormat - Duration of single invocation	197.45 ns	432.44 ns	2.19	0.01	False
ToStringWithFormat - Duration of single invocation	174.58 ns	477.46 ns	2.73	0.05	False
ToStringWithFormat - Duration of single invocation	197.67 ns	476.37 ns	2.41	0.01	False
ToStringWithFormat - Duration of single invocation	197.71 ns	435.98 ns	2.21	0.02	False
IsNaN - Duration of single invocation	669.11 μs	2.77 ms	4.14	0.00	False
ToStringWithFormat - Duration of single invocation	535.19 ns	1.46 μs	2.72	0.01	False
ToString - Duration of single invocation	173.25 ns	473.07 ns	2.73	0.04	False
ToStringWithCultureInfo - Duration of single invocation	209.93 ns	525.37 ns	2.50	0.01	False
ToStringWithFormat - Duration of single invocation	219.36 ns	548.57 ns	2.50	0.02	False
ToStringWithFormat - Duration of single invocation	265.45 ns	534.33 ns	2.01	0.01	False
ToStringWithFormat - Duration of single invocation	269.59 ns	525.93 ns	1.95	0.00	False
Parse - Duration of single invocation	99.20 ns	176.24 ns	1.78	0.08	False
TryParse - Duration of single invocation	137.84 ns	264.24 ns	1.92	0.02	False
ToStringWithCultureInfo - Duration of single invocation	169.34 ns	435.72 ns	2.57	0.02	False
ToStringWithCultureInfo - Duration of single invocation	213.03 ns	528.65 ns	2.48	0.01	False
ToString - Duration of single invocation	213.95 ns	536.45 ns	2.51	0.02	False
ToStringWithFormat - Duration of single invocation	352.72 ns	949.96 ns	2.69	0.00	False
ToStringWithFormat - Duration of single invocation	173.46 ns	475.61 ns	2.74	0.01	False
ToStringWithFormat - Duration of single invocation	1.90 μs	4.46 μs	2.35	0.00	False
Parse - Duration of single invocation	144.72 ns	270.18 ns	1.87	0.00	False
ToStringWithFormat - Duration of single invocation	217.51 ns	552.53 ns	2.54	0.01	False
ToString - Duration of single invocation	218.77 ns	538.29 ns	2.46	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Single.TryParse(value: "-3.4028235E+38")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 267.60970675526215 > 146.5246012801726.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -154.36292246329944 (T) = (0 -269.14083393476693) / Math.Sqrt((0.5239791752032786 / (21)) + (9.556801089011095 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9321757959330023 = (139.29417525117333 - 269.14083393476693) / 139.29417525117333 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "F50")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.482443407558807 > 2.0129842458961873.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -471.49437724618633 (T) = (0 -4460.060557765883) / Math.Sqrt((102.95158388822668 / (21)) + (337.7614530286306 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3232529437783511 = (1919.7481573024072 - 4460.060557765883) / 1919.7481573024072 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.IsNaN(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.773368863839286 > 702.1999373958333.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -6989.364739543986 (T) = (0 -2774190.949369058) / Math.Sqrt((310179.88462238875 / (21)) + (1063563.313761421 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.148091400250583 = (668787.3245033779 - 2774190.949369058) / 668787.3245033779 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 552.4212147182169 > 229.53676169927877.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -81.2916650083109 (T) = (0 -554.7885788118912) / Math.Sqrt((6.663966088352064 / (21)) + (236.1198898865637 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5470645564103445 = (217.81488710822924 - 554.7885788118912) / 217.81488710822924 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.TryParse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 175.0510847239678 > 100.29407917860628.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -112.80849730361496 (T) = (0 -175.84632180833003) / Math.Sqrt((2.3943792577756025 / (21)) + (5.514190796430016 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8422514373097759 = (95.45185757331633 - 175.84632180833003) / 95.45185757331633 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.Parse(value: "3.4028235E+38")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 262.1339737964604 > 150.3136041999449.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -216.20993339557486 (T) = (0 -261.416542037468) / Math.Sqrt((1.3074938367873368 / (21)) + (3.3416863646944126 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8305783072586551 = (142.8054407729473 - 261.416542037468) / 142.8054407729473 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 555.5803074023946 > 226.76164168849536.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -127.58509494525075 (T) = (0 -549.824517265062) / Math.Sqrt((3.2238376205818553 / (21)) + (93.04556097461139 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5322084801791065 = (217.13240500093903 - 549.824517265062) / 217.13240500093903 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 432.44384383446254 > 207.77190533471378.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -79.57237505326104 (T) = (0 -431.6576989134522) / Math.Sqrt((7.249442748098039 / (21)) + (117.33579477944593 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1956375035328233 = (196.59788932321777 - 431.6576989134522) / 196.59788932321777 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 477.4568556753981 > 183.85013785219394.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -135.51991565927827 (T) = (0 -475.5650094745453) / Math.Sqrt((3.7804534879941705 / (21)) + (65.89126541075646 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7022093907168272 = (175.99117637156536 - 475.5650094745453) / 175.99117637156536 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 476.366450553517 > 208.61849661382118.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -96.70788895225805 (T) = (0 -462.0003396221488) / Math.Sqrt((8.417329115554605 / (21)) + (97.18276738647863 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3105634290020052 = (199.95137715033394 - 462.0003396221488) / 199.95137715033394 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "E")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 435.97973795258815 > 210.1276868018957.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -85.45993530393355 (T) = (0 -436.2826936925281) / Math.Sqrt((4.509341953781881 / (21)) + (104.42138198568749 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1863223188454806 = (199.55094906725077 - 436.2826936925281) / 199.55094906725077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.IsNaN(value: NaN)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.7731920770833334 > 702.6831836718752.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -5359.713407250725 (T) = (0 -2774198.6174744903) / Math.Sqrt((436446.6825163422 / (21)) + (1869234.1714613563 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.1477253865738577 = (668848.1900114558 - 2774198.6174744903) / 668848.1900114558 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "F50")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.4555837693753657 > 560.8986049632241.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -288.520316925113 (T) = (0 -1447.1669982186506) / Math.Sqrt((21.446957873966717 / (21)) + (125.53245215036402 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7032752752148292 = (535.3383769263544 - 1447.1669982186506) / 535.3383769263544 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToString(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 473.07109942408806 > 183.13850525964858.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -200.75357087266198 (T) = (0 -463.3055124892645) / Math.Sqrt((3.5132234689270847 / (21)) + (26.57148162091152 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6504535400239548 = (174.8023519344833 - 463.3055124892645) / 174.8023519344833 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 3.4028235E+38, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 525.3742046121363 > 219.5648283799124.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -122.43237265560734 (T) = (0 -521.8091790396355) / Math.Sqrt((0.3867085773880977 / (21)) + (90.79232356520286 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4897770225439477 = (209.58068707151662 - 521.8091790396355) / 209.58068707151662 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 548.5696711507021 > 229.4287447086005.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -131.71202102329082 (T) = (0 -556.8167839810629) / Math.Sqrt((9.334019294659448 / (21)) + (85.58630752906002 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.536445962462247 = (219.52637360369184 - 556.8167839810629) / 219.52637360369184 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 534.3310265039362 > 279.4116210900975.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -124.04334860812574 (T) = (0 -528.4331074033905) / Math.Sqrt((2.987432105725685 / (21)) + (60.23339668988969 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9797367796988179 = (266.9208921217205 - 528.4331074033905) / 266.9208921217205 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 525.9291186077372 > 277.7736765607846.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -178.155056742065 (T) = (0 -520.766985662597) / Math.Sqrt((4.932519023002209 / (21)) + (25.63328696454175 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9673503981713931 = (264.70474509606316 - 520.766985662597) / 264.70474509606316 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.Parse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 176.24008468758728 > 104.79838431708694.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -168.47727575191763 (T) = (0 -178.22282052768418) / Math.Sqrt((2.248723150338792 / (21)) + (1.4964281540074558 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7770656494008868 = (100.29051013831118 - 178.22282052768418) / 100.29051013831118 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.TryParse(value: "3.4028235E+38")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 264.2393444628966 > 144.9033573515912.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -142.87345386373283 (T) = (0 -261.92345339226335) / Math.Sqrt((0.39182362155811074 / (21)) + (10.303305341213814 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9005874948425221 = (137.81183665736245 - 261.92345339226335) / 137.81183665736245 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: 12345, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 435.72479475291453 > 177.1612145794963.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -128.50396449135533 (T) = (0 -419.47814879168794) / Math.Sqrt((0.38211687457574534 / (21)) + (53.093568022627764 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.487582003247085 = (168.62887263380088 - 419.47814879168794) / 168.62887263380088 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithCultureInfo(value: -3.4028235E+38, culture: zh)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 528.6544246058712 > 223.681381279226.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -138.95293966498295 (T) = (0 -528.0275579327663) / Math.Sqrt((0.17132376282826495 / (21)) + (71.91214832010431 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4807004112983766 = (212.8542227541299 - 528.0275579327663) / 212.8542227541299 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToString(value: 3.4028235E+38)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 536.4495060957273 > 224.97441744658218.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -168.13329035370435 (T) = (0 -537.5964639865572) / Math.Sqrt((2.9771674742239167 / (21)) + (49.433574178101225 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4960460592336666 = (215.37922427265204 - 537.5964639865572) / 215.37922427265204 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "G17")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 949.955211130778 > 370.54735484224545.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -251.6148136086229 (T) = (0 -932.0917214017596) / Math.Sqrt((6.5373267763628204 / (21)) + (70.19327930075949 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6520524498548754 = (351.46051559152426 - 932.0917214017596) / 351.46051559152426 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 12345, format: "R")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 475.6137634799834 > 183.88890178789464.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -173.5439126679734 (T) = (0 -470.9685726152731) / Math.Sqrt((5.389805527500146 / (21)) + (37.04390130428784 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6866598257379617 = (175.29892251465412 - 470.9685726152731) / 175.29892251465412 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: 3.4028235E+38, format: "F50")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.463900930027626 > 2.0021263878169413.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -372.37122140245293 (T) = (0 -4461.384785109238) / Math.Sqrt((168.78562874811107 / (21)) + (544.332618092665 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3348796888714827 = (1910.755747447338 - 4461.384785109238) / 1910.755747447338 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.Parse(value: "-3.4028235E+38")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 270.1821491679342 > 151.92949827557115.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -157.519662982192 (T) = (0 -269.3332452592994) / Math.Sqrt((0.2610025742040301 / (21)) + (8.684374355914061 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8699258431610004 = (144.03418522951011 - 269.3332452592994) / 144.03418522951011 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToStringWithFormat(value: -3.4028235E+38, format: "G")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 552.532474459045 > 229.7302920796018.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -152.2115031309694 (T) = (0 -555.122618557295) / Math.Sqrt((0.38976907096309155 / (21)) + (68.09267134583773 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5371651365124108 = (218.79640807313277 - 555.122618557295) / 218.79640807313277 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Single.ToString(value: -3.4028235E+38)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 538.2924169420769 > 229.67752854409983.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -201.9987824998092 (T) = (0 -542.7990040034335) / Math.Sqrt((2.3080835993379076 / (21)) + (34.4205197187098 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4778130118629735 = (219.06374750826075 - 542.7990040034335) / 219.06374750826075 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in Benchstone.MDBenchI.MDPuzzle

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	1.01 secs	1.43 secs	1.42	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchI.MDPuzzle*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchI.MDPuzzle.Test

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.4337570142 > 1.0567407846086538.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -548.8714109773573 (T) = (0 -1430040029.0594714) / Math.Sqrt((3248956051941.0645 / (21)) + (6131737791166.358 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.41941899843646196 = (1007482660.6060007 - 1430040029.0594714) / 1007482660.6060007 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
SubtractBenchmark - Duration of single invocation	36.48 ns	45.19 ns	1.24	0.01	False
LessThanOrEqualBenchmark - Duration of single invocation	38.73 ns	44.12 ns	1.14	0.00	False
GreaterThanOrEqualBenchmark - Duration of single invocation	37.47 ns	43.34 ns	1.16	0.00	False
SubtractionOperatorBenchmark - Duration of single invocation	36.73 ns	39.62 ns	1.08	0.03	False
MultiplyOperatorBenchmark - Duration of single invocation	36.85 ns	40.45 ns	1.10	0.03	False
AddOperatorBenchmark - Duration of single invocation	36.74 ns	39.25 ns	1.07	0.02	False
DivideBenchmark - Duration of single invocation	42.09 ns	48.78 ns	1.16	0.02	False
MaxBenchmark - Duration of single invocation	36.51 ns	46.53 ns	1.27	0.15	False
GetHashCodeBenchmark - Duration of single invocation	49.76 ns	61.99 ns	1.25	0.01	False
EqualsBenchmark - Duration of single invocation	43.90 ns	66.93 ns	1.52	0.02	False
MultiplyBenchmark - Duration of single invocation	38.62 ns	46.07 ns	1.19	0.02	False
DivisionOperatorBenchmark - Duration of single invocation	39.80 ns	42.81 ns	1.08	0.10	False
EqualsStaticBenchmark - Duration of single invocation	36.48 ns	41.09 ns	1.13	0.02	False
MinBenchmark - Duration of single invocation	38.65 ns	46.78 ns	1.21	0.15	False
GreaterThanBenchmark - Duration of single invocation	36.06 ns	41.39 ns	1.15	0.01	False
LessThanBenchmark - Duration of single invocation	37.16 ns	41.24 ns	1.11	0.02	False
AddBenchmark - Duration of single invocation	36.07 ns	45.15 ns	1.25	0.01	False
AbsBenchmark - Duration of single invocation	48.23 ns	50.83 ns	1.05	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.18573789944225 > 38.36108403188931.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -141.70886559963444 (T) = (0 -45.122743295663575) / Math.Sqrt((0.06855748675032348 / (21)) + (0.005652245305333188 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.23489138748518842 = (36.53984775742457 - 45.122743295663575) / 36.53984775742457 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.LessThanOrEqualBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.11588167979089 > 40.28709237052853.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -35.501913488231246 (T) = (0 -43.825845144445005) / Math.Sqrt((0.2525722629963639 / (21)) + (0.19923786683816183 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.15110209447912665 = (38.07294362041465 - 43.825845144445005) / 38.07294362041465 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.GreaterThanOrEqualBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.33908028561266 > 39.376862148550494.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -39.578222520682786 (T) = (0 -43.23566982191148) / Math.Sqrt((0.23978649298257787 / (21)) + (0.15030905607675848 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.15774709649272847 = (37.34465839118866 - 43.23566982191148) / 37.34465839118866 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.SubtractionOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.621593870431056 > 38.15254333638795.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -14.652211110725029 (T) = (0 -40.04164469237291) / Math.Sqrt((0.39828898046079675 / (21)) + (0.7323481205976131 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.10827070716887525 = (36.129841232257235 - 40.04164469237291) / 36.129841232257235 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MultiplyOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.45270427952882 > 38.78563403834727.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -15.701991517422023 (T) = (0 -41.11467904738474) / Math.Sqrt((0.29679024384493696 / (21)) + (0.6780636490086507 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.10561642537954816 = (37.187109474491066 - 41.11467904738474) / 37.187109474491066 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AddOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.24995585030876 > 37.354879295537486.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -15.955568489153016 (T) = (0 -40.09515497064187) / Math.Sqrt((0.43601829300308353 / (21)) + (0.5951857733292848 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.11123628166985094 = (36.0815747577923 - 40.09515497064187) / 36.0815747577923 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.DivideBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.780784775669225 > 44.642963170015406.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -94.73857645363576 (T) = (0 -48.662522304376374) / Math.Sqrt((0.08102003255860066 / (21)) + (0.009749755371995199 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1512609172821508 = (42.26889106880901 - 48.662522304376374) / 42.26889106880901 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MaxBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.525389769148696 > 39.63842624022899.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -36.41031322090598 (T) = (0 -46.32684572975325) / Math.Sqrt((1.0438849127867331 / (21)) + (0.1698947043836762 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.24293450965649044 = (37.27215341583572 - 46.32684572975325) / 37.27215341583572 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.GetHashCodeBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 61.98657347414275 > 51.97819413521767.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -113.17139848682635 (T) = (0 -62.18305646771787) / Math.Sqrt((0.026041405207520917 / (21)) + (0.1564309835213682 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2543517505901646 = (49.57385871902449 - 62.18305646771787) / 49.57385871902449 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.EqualsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.92880675115585 > 46.199028863592396.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -178.65069051512202 (T) = (0 -66.83326751550658) / Math.Sqrt((0.32463156509180124 / (21)) + (0.008006602597500617 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5115866653767771 = (44.21398325768358 - 66.83326751550658) / 44.21398325768358 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MultiplyBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.06576603589545 > 40.06375275257643.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -108.15257374478357 (T) = (0 -46.088118753225096) / Math.Sqrt((0.1059312079920492 / (21)) + (0.004531635637022328 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.20762953506948564 = (38.16412021636523 - 46.088118753225096) / 38.16412021636523 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.DivisionOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.81329854440874 > 40.7501589076955.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -16.108064796644214 (T) = (0 -43.287350975543326) / Math.Sqrt((0.7240848555878852 / (21)) + (0.5752838303924916 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.11395409003470851 = (38.859187611757484 - 43.287350975543326) / 38.859187611757484 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.EqualsStaticBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.093592075381004 > 38.284151047056575.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.841722698051 (T) = (0 -41.79465957206588) / Math.Sqrt((0.13709897657041842 / (21)) + (0.4193673569186356 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.14578994694478623 = (36.47672043511122 - 41.79465957206588) / 36.47672043511122 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.MinBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.78422628086293 > 38.8637310768225.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -37.92031801904488 (T) = (0 -46.30724568480652) / Math.Sqrt((0.9734005241906127 / (21)) + (0.09708679523339946 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.23309364733851998 = (37.55371360865817 - 46.30724568480652) / 37.55371360865817 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.GreaterThanBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.39233313654842 > 37.87982783662044.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -36.165506880510634 (T) = (0 -41.51605907630907) / Math.Sqrt((0.18071931849425132 / (21)) + (0.1608902013918205 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.14089618915593644 = (36.38898917439955 - 41.51605907630907) / 36.38898917439955 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.LessThanBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.23975636450052 > 38.156972591174366.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.96070284296253 (T) = (0 -41.98306696216581) / Math.Sqrt((0.10231159029852477 / (21)) + (0.5026268890169603 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.15537784368795074 = (36.33708850444666 - 41.98306696216581) / 36.33708850444666 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AddBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.149686587933935 > 38.5139462024065.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -111.0361319509649 (T) = (0 -45.065505774464256) / Math.Sqrt((0.1147255939703697 / (21)) + (0.006939191165613202 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.23486495390212983 = (36.494278691818764 - 45.065505774464256) / 36.494278691818764 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.AbsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.82762444547567 > 50.533381787482604.
IsChangePoint: Marked as a change because one of 12/20/2022 4:39:07 PM, 12/21/2022 10:31:08 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.72755820640297 (T) = (0 -50.968070666888465) / Math.Sqrt((0.09397054984197586 / (21)) + (0.0158586088223204 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.05376585974277058 = (48.367547871905835 - 50.968070666888465) / 48.367547871905835 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorConvert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Convert_double_long - Duration of single invocation	18.32 μs	21.48 μs	1.17	0.01	False
Convert_uint_float - Duration of single invocation	44.16 μs	52.37 μs	1.19	0.01	False
Convert_float_int - Duration of single invocation	18.98 μs	26.08 μs	1.37	0.02	False
Convert_int_float - Duration of single invocation	18.65 μs	28.07 μs	1.51	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorConvert.Convert_double_long

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.479150251862734 > 19.279030663586422.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -113.74572510828361 (T) = (0 -21479.264498246564) / Math.Sqrt((9625.764052946884 / (21)) + (3605.0691517216333 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.16507798868651852 = (18435.90275227994 - 21479.264498246564) / 18435.90275227994 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.36973715044743 > 45.720309535167125.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -88.34937702856126 (T) = (0 -52104.87283750749) / Math.Sqrt((145503.9824167633 / (21)) + (27784.209075368242 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.190594017573949 = (43763.7616756051 - 52104.87283750749) / 43763.7616756051 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorConvert.Convert_float_int

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.080911812500002 > 19.95629677368165.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -211.596276473614 (T) = (0 -26044.196333303087) / Math.Sqrt((20515.60000048218 / (21)) + (2392.490599807178 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3797953888991659 = (18875.40467437116 - 26044.196333303087) / 18875.40467437116 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorConvert.Convert_int_float

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.07092518677366 > 19.68278941154581.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -263.7971568266295 (T) = (0 -28117.00874488086) / Math.Sqrt((18139.852574022836 / (21)) + (5670.844811242272 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5019558184824029 = (18720.263538304793 - 28117.00874488086) / 18720.263538304793 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Json.Tests.Perf_Strings

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
WriteStringsUtf8 - Duration of single invocation	76.94 ms	164.26 ms	2.13	0.00	False
WriteStringsUtf16 - Duration of single invocation	22.77 ms	65.69 ms	2.89	0.01	False
WriteStringsUtf8 - Duration of single invocation	34.13 ms	89.58 ms	2.62	0.00	False
WriteStringsUtf8 - Duration of single invocation	34.71 ms	86.12 ms	2.48	0.02	False
WriteStringsUtf8 - Duration of single invocation	34.93 ms	91.50 ms	2.62	0.00	False
WriteStringsUtf16 - Duration of single invocation	23.54 ms	68.21 ms	2.90	0.01	False
WriteStringsUtf8 - Duration of single invocation	35.12 ms	87.40 ms	2.49	0.01	False
WriteStringsUtf16 - Duration of single invocation	96.46 ms	237.07 ms	2.46	0.01	False
WriteStringsUtf16 - Duration of single invocation	15.82 ms	45.51 ms	2.88	0.01	False
WriteStringsUtf16 - Duration of single invocation	15.72 ms	45.00 ms	2.86	0.01	False
WriteStringsUtf8 - Duration of single invocation	34.67 ms	90.94 ms	2.62	0.00	False
WriteStringsUtf8 - Duration of single invocation	77.72 ms	167.73 ms	2.16	0.00	False
WriteStringsUtf16 - Duration of single invocation	94.79 ms	235.22 ms	2.48	0.01	False
WriteStringsUtf16 - Duration of single invocation	16.46 ms	47.05 ms	2.86	0.01	False
WriteStringsUtf16 - Duration of single invocation	96.35 ms	236.35 ms	2.45	0.01	False
WriteStringsUtf16 - Duration of single invocation	22.97 ms	65.86 ms	2.87	0.01	False
WriteStringsUtf8 - Duration of single invocation	35.41 ms	87.62 ms	2.47	0.00	False
WriteStringsUtf8 - Duration of single invocation	34.50 ms	85.86 ms	2.49	0.01	False
WriteStringsUtf16 - Duration of single invocation	95.25 ms	234.90 ms	2.47	0.01	False
WriteStringsUtf8 - Duration of single invocation	76.64 ms	163.36 ms	2.13	0.00	False
WriteStringsUtf16 - Duration of single invocation	16.76 ms	47.51 ms	2.83	0.01	False
WriteStringsUtf16 - Duration of single invocation	23.42 ms	67.61 ms	2.89	0.01	False
WriteStringsUtf8 - Duration of single invocation	76.27 ms	163.87 ms	2.15	0.00	False
WriteStringsUtf8 - Duration of single invocation	33.84 ms	88.50 ms	2.61	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: AllEscaped)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 164.25653433333335 > 80.88992366000001.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -237.70909929565343 (T) = (0 -166273925.19540817) / Math.Sqrt((13580690781.827618 / (21)) + (1964598219600.384 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1587818744436522 = (77022105.45855136 - 166273925.19540817) / 77022105.45855136 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 65.68947221666667 > 23.827006731818187.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -881.299416346264 (T) = (0 -65900252.227825746) / Math.Sqrt((5515313117.397632 / (21)) + (29985991604.100716 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.9049884714407155 = (22685202.66971759 - 65900252.227825746) / 22685202.66971759 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 89.57949217857143 > 35.782287645000004.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -818.4382835082803 (T) = (0 -89451929.05364665) / Math.Sqrt((1628752586.520801 / (21)) + (62973396482.562935 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.624008589739119 = (34089800.392970525 - 89451929.05364665) / 34089800.392970525 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.11728853571428 > 36.41017114.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2304.8054742461086 (T) = (0 -85972954.58353612) / Math.Sqrt((1185556091.123895 / (21)) + (6142505023.230619 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4787760365541773 = (34683631.484129466 - 85972954.58353612) / 34683631.484129466 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 91.49549366071429 > 36.651798213846156.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -522.6969292566637 (T) = (0 -91077392.08677721) / Math.Sqrt((2212596358.676179 / (21)) + (160358425459.95294 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6112022066797331 = (34879486.48855747 - 91077392.08677721) / 34879486.48855747 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.20954968333334 > 24.79311212636363.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -568.790215201888 (T) = (0 -67854165.69438776) / Math.Sqrt((5171453128.992249 / (21)) + (81404476619.1821 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8784744346471642 = (23572961.03715618 - 67854165.69438776) / 23572961.03715618 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 87.39742375 > 36.927836684999995.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1192.9687549920218 (T) = (0 -87389272.24993458) / Math.Sqrt((1116500810.1017227 / (21)) + (26077652380.31326 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4845950836904716 = (35172440.2996611 - 87389272.24993458) / 35172440.2996611 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: AllEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 237.06776053333334 > 101.03459214250002.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -196.95405900543668 (T) = (0 -240829456.6292517) / Math.Sqrt((114852609413.12085 / (21)) + (7482080476263.484 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.505734927000085 = (96111306.1219039 - 240829456.6292517) / 96111306.1219039 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.508442571428574 > 16.649799812187503.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -735.0075548170664 (T) = (0 -45491342.158342056) / Math.Sqrt((2102961922.5312164 / (21)) + (21315190919.244137 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8640394819121935 = (15883629.553866863 - 45491342.158342056) / 15883629.553866863 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.00438814444444 > 16.4773454803125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -540.587779675012 (T) = (0 -45079212.03599773) / Math.Sqrt((1035103612.5620785 / (21)) + (40727860470.01822 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.87570349593437 = (15675890.125574525 - 45079212.03599773) / 15675890.125574525 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 90.94282726666667 > 36.421048607142865.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -579.9880188325104 (T) = (0 -90950236.62241627) / Math.Sqrt((1909683233.4493523 / (21)) + (130462583157.587 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6218507618341809 = (34689326.313443474 - 90950236.62241627) / 34689326.313443474 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: AllEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 167.7342584642857 > 81.07291448375.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -210.38645130230842 (T) = (0 -166638115.03894562) / Math.Sqrt((39997117322.475555 / (21)) + (2500868779119.971 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.157256648044709 = (77245382.55102044 - 166638115.03894562) / 77245382.55102044 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: AllEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 235.22063057142856 > 99.62326793293269.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -183.90574253258734 (T) = (0 -237606202.83503404) / Math.Sqrt((324715966740.16644 / (21)) + (8156093067390.965 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4909913299953546 = (95386202.26168236 - 237606202.83503404) / 95386202.26168236 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.05138636666667 > 17.279675592666667.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -966.1891495223647 (T) = (0 -47268951.45888279) / Math.Sqrt((4837756295.884993 / (21)) + (11019283055.632494 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8735319299045698 = (16449774.219301121 - 47268951.45888279) / 16449774.219301121 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: AllEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 236.3540072142857 > 101.44185375875001.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -189.187200368159 (T) = (0 -239200925.6957352) / Math.Sqrt((229042986526.88605 / (21)) + (7845075095567.603 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4862693296702567 = (96208774.66539772 - 239200925.6957352) / 96208774.66539772 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: False, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 65.8554721 > 24.074009199055943.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -623.9018821285383 (T) = (0 -66227013.96250001) / Math.Sqrt((5756651900.180361 / (21)) + (63540323834.0117 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8863897884934107 = (22944584.347725287 - 66227013.96250001) / 22944584.347725287 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: True, SkipValidation: False, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 87.61573256666667 > 37.205157802500004.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1396.6486056521444 (T) = (0 -87557341.65943877) / Math.Sqrt((1563726448.1533256 / (21)) + (18472076429.496033 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.47242416548946 = (35413560.05234856 - 87557341.65943877) / 35413560.05234856 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.863964 > 36.204854467857146.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1800.4878153076265 (T) = (0 -85724652.59230115) / Math.Sqrt((1012593187.0245161 / (21)) + (10664768662.055769 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4860513529623574 = (34482253.34933343 - 85724652.59230115) / 34482253.34933343 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: AllEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 234.90092206666665 > 99.95130649875.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -190.5142011574797 (T) = (0 -237699329.71972784) / Math.Sqrt((232551908926.77545 / (21)) + (7673892299645.479 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4959955787428063 = (95232271.94154456 - 237699329.71972784) / 95232271.94154456 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: False, Escaped: AllEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 163.35654166666666 > 80.208483284375.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -234.9478576639918 (T) = (0 -164311200.64812925) / Math.Sqrt((21799565836.50608 / (21)) + (1940376123478.7751 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1474096289543307 = (76516002.55147393 - 164311200.64812925) / 76516002.55147393 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: False, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.50936513333333 > 17.485531074666667.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1062.4836532813742 (T) = (0 -47571484.1835034) / Math.Sqrt((3097904003.394946 / (21)) + (9797637977.624874 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8582888578165826 = (16643343.815097388 - 47571484.1835034) / 16643343.815097388 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.60645575 > 24.63811026068182.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -717.8865969155726 (T) = (0 -67848444.21683674) / Math.Sqrt((7773255808.174487 / (21)) + (48302058214.734146 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8900105770478934 = (23476884.394707996 - 67848444.21683674) / 23476884.394707996 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: AllEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 163.865976 > 80.13543295625.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -190.23757334782297 (T) = (0 -164020004.59081632) / Math.Sqrt((17707298709.73409 / (21)) + (2964517388591.068 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1495222434333694 = (76305330.21553288 - 164020004.59081632) / 76305330.21553288 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf8(Formatted: False, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 88.49761398333334 > 35.592161045000005.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -381.67582465246807 (T) = (0 -89374972.62108843) / Math.Sqrt((2987945848.585052 / (21)) + (293843639353.36365 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.637013747149902 = (33892494.00678527 - 89374972.62108843) / 33892494.00678527 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
MultiplyOperatorBenchmark - Duration of single invocation	2.66 ns	18.59 ns	7.00	0.23	False
EqualsBenchmark - Duration of single invocation	7.24 ns	10.76 ns	1.49	0.08	False
AndNotBenchmark - Duration of single invocation	6.63 ns	14.54 ns	2.19	0.30	False
InequalityOperatorBenchmark - Duration of single invocation	0.69 ns	5.97 ns	8.70	0.50	False
EqualityOperatorBenchmark - Duration of single invocation	0.72 ns	6.17 ns	8.56	0.56	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	2.56 ns	14.21 ns	5.56	0.24	False
EqualsAllBenchmark - Duration of single invocation	0.94 ns	7.91 ns	8.45	0.52	False
ConditionalSelectBenchmark - Duration of single invocation	7.14 ns	16.68 ns	2.34	0.31	False
XorBenchmark - Duration of single invocation	2.65 ns	15.51 ns	5.85	0.05	False
DivisionOperatorBenchmark - Duration of single invocation	27.55 ns	31.81 ns	1.15	0.04	False
MultiplyBenchmark - Duration of single invocation	3.24 ns	20.47 ns	6.32	0.20	False
DivideBenchmark - Duration of single invocation	27.47 ns	33.74 ns	1.23	0.04	False
NegateBenchmark - Duration of single invocation	2.22 ns	15.12 ns	6.80	0.23	False
AllBitsSetBenchmark - Duration of single invocation	1.66 ns	6.10 ns	3.68	0.02	False
UnaryNegateOperatorBenchmark - Duration of single invocation	2.83 ns	15.16 ns	5.36	0.21	False
SubtractionOperatorBenchmark - Duration of single invocation	2.57 ns	18.27 ns	7.10	0.04	False
SubtractBenchmark - Duration of single invocation	3.21 ns	20.17 ns	6.29	0.08	False
AddBenchmark - Duration of single invocation	2.53 ns	20.02 ns	7.92	0.24	False
BitwiseOrBenchmark - Duration of single invocation	2.67 ns	15.58 ns	5.83	0.08	False
OnesComplementBenchmark - Duration of single invocation	2.81 ns	9.30 ns	3.31	0.18	False
BitwiseOrOperatorBenchmark - Duration of single invocation	2.51 ns	14.39 ns	5.72	0.21	False
AddOperatorBenchmark - Duration of single invocation	2.57 ns	18.28 ns	7.11	0.22	False
OnesComplementOperatorBenchmark - Duration of single invocation	2.84 ns	9.33 ns	3.28	0.23	False
BitwiseAndOperatorBenchmark - Duration of single invocation	2.57 ns	14.24 ns	5.54	0.20	False
BitwiseAndBenchmark - Duration of single invocation	2.62 ns	15.47 ns	5.90	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.59255213860894 > 2.7901070797729215.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -212.6636717489974 (T) = (0 -18.643147563123808) / Math.Sqrt((0.0057372095837264145 / (21)) + (0.07513031807568736 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.975625401798974 = (2.6726130618074544 - 18.643147563123808) / 2.6726130618074544 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.EqualsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.760060226766857 > 7.585182906715485.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -40.5145731875799 (T) = (0 -10.758427874116778) / Math.Sqrt((0.004590194501839486 / (21)) + (0.10446960331690534 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.49261989491240266 = (7.207747873914114 - 10.758427874116778) / 7.207747873914114 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AndNotBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.535184319466 > 6.965155010796839.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -180.7957732212325 (T) = (0 -14.51168497793079) / Math.Sqrt((0.03268224842767159 / (21)) + (0.004992818501984238 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1973366637737055 = (6.604215556576762 - 14.51168497793079) / 6.604215556576762 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.InequalityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.969933157290234 > 0.9203314879096465.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -57.28904267933351 (T) = (0 -5.944517365132644) / Math.Sqrt((0.008912431069813464 / (21)) + (0.1082485108210279 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.714421164831023 = (0.7705720543535884 - 5.944517365132644) / 0.7705720543535884 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.EqualityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.166135428349581 > 0.9161678222647883.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -50.88206753360798 (T) = (0 -5.911383080302282) / Math.Sqrt((0.008017013981906806 / (21)) + (0.13841439549105505 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.826346539584092 = (0.7553183404802856 - 5.911383080302282) / 0.7553183404802856 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.ExclusiveOrOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.212369456128698 > 2.688771032968125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -553.8380895810503 (T) = (0 -14.38860485320728) / Math.Sqrt((0.00045037938267088304 / (21)) + (0.006092456297103031 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.634204711647744 = (2.5537951831003456 - 14.38860485320728) / 2.5537951831003456 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.EqualsAllBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.910173699328483 > 0.7149870872052918.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -80.03817684523335 (T) = (0 -8.174581984063243) / Math.Sqrt((0.017594963833502033 / (21)) + (0.1074547915251462 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -9.351500169145872 = (0.7897002222372324 - 8.174581984063243) / 0.7897002222372324 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.ConditionalSelectBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.67521443101773 > 7.644986577075826.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -159.28788968429424 (T) = (0 -16.684274508083416) / Math.Sqrt((0.05082745773108623 / (21)) + (0.015468569467240024 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3086859099153743 = (7.226740734383823 - 16.684274508083416) / 7.226740734383823 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.XorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.509303197322474 > 2.7574429029960044.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -507.9351068116726 (T) = (0 -15.545726926642134) / Math.Sqrt((0.0013466144185790181 / (21)) + (0.008162888725145385 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.924632906764482 = (2.6239139489794745 - 15.545726926642134) / 2.6239139489794745 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivisionOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.805600316327705 > 28.899425762008505.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -50.09488527457838 (T) = (0 -31.46915058703829) / Math.Sqrt((0.020032575042197423 / (21)) + (0.07505030659372154 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1448170616384246 = (27.488366169177 - 31.46915058703829) / 27.488366169177 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.MultiplyBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.468042433286698 > 3.4044032127442763.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -653.5332881628672 (T) = (0 -20.51136032804203) / Math.Sqrt((0.01057554309204478 / (21)) + (0.002697064815212122 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.278469271387478 = (3.2669364842665267 - 20.51136032804203) / 3.2669364842665267 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivideBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.73944732323315 > 28.836583999419187.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -79.52303628421816 (T) = (0 -33.68368484104941) / Math.Sqrt((0.058372709677379044 / (21)) + (0.05071619303201217 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2328984341910635 = (27.320729678069668 - 33.68368484104941) / 27.320729678069668 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.NegateBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.117514868439004 > 2.345146749839552.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -158.14488738937894 (T) = (0 -15.011831473322957) / Math.Sqrt((0.0007449863783404569 / (21)) + (0.09066640604527304 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.670843853289937 = (2.250364692005105 - 15.011831473322957) / 2.250364692005105 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AllBitsSetBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.101915035092872 > 1.7610243397414058.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -132.58792086211446 (T) = (0 -5.985752846348987) / Math.Sqrt((0.0004453006792658404 / (21)) + (0.014581762148048925 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.598530336873222 = (1.6633881851750716 - 5.985752846348987) / 1.6633881851750716 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.UnaryNegateOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.16446021825959 > 2.985879635676672.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -449.22314678257976 (T) = (0 -15.121104265997454) / Math.Sqrt((0.011262162840624045 / (21)) + (0.0029576861065621148 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.326814585119147 = (2.838676665833158 - 15.121104265997454) / 2.838676665833158 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SubtractionOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.268386083897234 > 2.7690583916905545.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -265.18417910457964 (T) = (0 -18.24660086721802) / Math.Sqrt((0.0013268756774612025 / (21)) + (0.04772291795619803 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.961552538293759 = (2.621053388141228 - 18.24660086721802) / 2.621053388141228 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SubtractBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.16669970858997 > 3.3619528822939633.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -729.052100732617 (T) = (0 -20.189409600707403) / Math.Sqrt((0.0006516776852442825 / (21)) + (0.007179790513244669 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.3347253646416295 = (3.1871010088926823 - 20.189409600707403) / 3.1871010088926823 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AddBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.02272622542963 > 2.70540936799976.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -612.2467032656014 (T) = (0 -20.167180514449573) / Math.Sqrt((0.005252382761015147 / (21)) + (0.008023643056011267 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.754822758971297 = (2.6005985102778566 - 20.167180514449573) / 2.6005985102778566 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseOrBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.584072189493922 > 2.733141899079852.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -293.52125054684063 (T) = (0 -15.57554929027901) / Math.Sqrt((0.001329993349733243 / (21)) + (0.0264248640687619 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.964750459166685 = (2.6112658688583292 - 15.57554929027901) / 2.6112658688583292 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.OnesComplementBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.299892630105854 > 2.9494485831499326.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -287.65087972121427 (T) = (0 -9.289058688991052) / Math.Sqrt((0.00029848491745712103 / (21)) + (0.00690475217116251 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.3063005894984836 = (2.809502172456759 - 9.289058688991052) / 2.809502172456759 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseOrOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.389140806120421 > 2.6875856166933203.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -169.81630944627372 (T) = (0 -14.272681363700453) / Math.Sqrt((0.003390375887920673 / (21)) + (0.06427417456765443 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.562509418785295 = (2.5658709566405067 - 14.272681363700453) / 2.5658709566405067 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.AddOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.28299257973564 > 2.7063041912511356.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -375.1292287614201 (T) = (0 -18.31086947772902) / Math.Sqrt((0.00212296191872357 / (21)) + (0.02319966989153397 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.093639495853226 = (2.5813081547819174 - 18.31086947772902) / 2.5813081547819174 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.334102171386522 > 2.9852431254032035.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -214.46439752540184 (T) = (0 -9.257613421127205) / Math.Sqrt((0.00035523058670273533 / (21)) + (0.012293107124562917 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.2578910707912208 = (2.8415969779121175 - 9.257613421127205) / 2.8415969779121175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseAndOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.236796900980304 > 2.6882866847264997.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -387.85669481486036 (T) = (0 -14.362482157578345) / Math.Sqrt((0.0002992966956668132 / (21)) + (0.012755422054360165 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.601536210505745 = (2.5640255847389413 - 14.362482157578345) / 2.5640255847389413 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Runtime.Intrinsics.Tests.Perf_Vector128Int.BitwiseAndBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.465092372811712 > 2.7299840907550816.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -435.74074009704384 (T) = (0 -15.559334354922882) / Math.Sqrt((0.001400956133849829 / (21)) + (0.011447079661590974 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.981627197261193 = (2.6011875768598607 - 15.559334354922882) / 2.6011875768598607 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Net.Tests.Perf_WebUtility

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
HtmlDecode_Entities - Duration of single invocation	344.72 ns	949.93 ns	2.76	0.01	False
Decode_NoDecodingRequired - Duration of single invocation	171.86 ns	191.84 ns	1.12	0.02	False
Decode_DecodingRequired - Duration of single invocation	274.09 ns	466.66 ns	1.70	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Net.Tests.Perf_WebUtility*'

Payloads

Baseline
Compare

Histogram

System.Net.Tests.Perf_WebUtility.HtmlDecode_Entities

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 949.9301683814278 > 354.8835304391114.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -651.5158880672687 (T) = (0 -947.5928902161512) / Math.Sqrt((9.112101336509589 / (21)) + (6.110718671340469 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.788979445881459 = (339.763310775015 - 947.5928902161512) / 339.763310775015 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Net.Tests.Perf_WebUtility.Decode_NoDecodingRequired

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 191.84137355944682 > 180.23518694772196.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -14.82816586098268 (T) = (0 -189.10554038089953) / Math.Sqrt((4.525747383980904 / (21)) + (17.600345217951848 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.10516317199974641 = (171.11096820094085 - 189.10554038089953) / 171.11096820094085 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Net.Tests.Perf_WebUtility.Decode_DecodingRequired

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 466.6567650276961 > 292.29006770596095.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -154.52438982051868 (T) = (0 -463.4532764194959) / Math.Sqrt((7.159103638288563 / (21)) + (15.45868853955249 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6689241899353761 = (277.6958229824937 - 463.4532764194959) / 277.6958229824937 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in Benchstone.MDBenchI.MDNDhrystone

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	878.79 ms	1.40 secs	1.59	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchI.MDNDhrystone*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchI.MDNDhrystone.Test

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3974496153333333 > 925.7532791796154.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -121.26425629654943 (T) = (0 -1408601521.345578) / Math.Sqrt((124639078468947.58 / (21)) + (181540504859667.38 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5981725675351557 = (881382617.8471133 - 1408601521.345578) / 881382617.8471133 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Globalization.Tests.Perf_NumberCultureInfo

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString - Duration of single invocation	193.69 ns	501.36 ns	2.59	0.04	False
ToString - Duration of single invocation	194.81 ns	495.32 ns	2.54	0.03	False
ToString - Duration of single invocation	193.57 ns	501.05 ns	2.59	0.04	False
ToString - Duration of single invocation	195.14 ns	492.95 ns	2.53	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.Perf_NumberCultureInfo*'

Payloads

Baseline
Compare

Histogram

System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: fr)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 501.36143235769225 > 206.9312455617742.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -86.86260018041774 (T) = (0 -495.9209601314256) / Math.Sqrt((6.597276962208696 / (21)) + (162.489861118351 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5299826062871191 = (196.01753739296072 - 495.9209601314256) / 196.01753739296072 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: ja)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 495.3205583125209 > 203.97446057849626.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -149.6904376331521 (T) = (0 -499.9831509961713) / Math.Sqrt((4.027067849364615 / (21)) + (55.49500699369999 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5662348095575351 = (194.8314118154984 - 499.9831509961713) / 194.8314118154984 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: )

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 501.04967192943553 > 205.136167162628.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -204.1093506334522 (T) = (0 -500.90125562433286) / Math.Sqrt((4.091521141067321 / (21)) + (28.555569961683947 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5583284631044394 = (195.7923944670135 - 500.90125562433286) / 195.7923944670135 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.Perf_NumberCultureInfo.ToString(culturestring: da)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 492.95143954010626 > 204.82195147028295.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -196.2423808821934 (T) = (0 -501.90676581692975) / Math.Sqrt((3.8523062235927767 / (21)) + (31.527618074096058 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.565271302686672 = (195.65445779215258 - 501.90676581692975) / 195.65445779215258 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Buffers.Text.Tests.Utf8ParserTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
TryParseSingle - Duration of single invocation	49.89 ns	101.09 ns	2.03	0.21	False
TryParseUInt32 - Duration of single invocation	7.31 ns	12.42 ns	1.70	0.04	False
TryParseBool - Duration of single invocation	5.90 ns	15.02 ns	2.55	0.05	False
TryParseSByte - Duration of single invocation	11.38 ns	18.52 ns	1.63	0.32	False
TryParseInt32 - Duration of single invocation	18.49 ns	32.88 ns	1.78	0.26	False
TryParseBool - Duration of single invocation	5.78 ns	14.92 ns	2.58	0.42	False
TryParseInt16 - Duration of single invocation	8.69 ns	12.81 ns	1.47	0.05	False
TryParseUInt64 - Duration of single invocation	38.81 ns	81.96 ns	2.11	0.03	False
TryParseByte - Duration of single invocation	9.18 ns	14.76 ns	1.61	0.10	False
TryParseDouble - Duration of single invocation	46.80 ns	119.16 ns	2.55	0.19	False
TryParseUInt16 - Duration of single invocation	11.14 ns	20.22 ns	1.81	0.28	False
TryParseInt32 - Duration of single invocation	11.41 ns	20.95 ns	1.84	0.41	False
TryParseDateTimeOffset - Duration of single invocation	20.31 ns	32.40 ns	1.60	0.03	False
TryParseDouble - Duration of single invocation	106.60 ns	261.03 ns	2.45	0.00	False
TryParseUInt64 - Duration of single invocation	12.80 ns	21.24 ns	1.66	0.06	False
TryParseBool - Duration of single invocation	5.80 ns	14.70 ns	2.53	0.47	False
TryParseInt64 - Duration of single invocation	41.94 ns	69.42 ns	1.66	0.03	False
TryParseSByte - Duration of single invocation	10.85 ns	17.36 ns	1.60	0.06	False
TryParseUInt64Hex - Duration of single invocation	13.06 ns	27.87 ns	2.13	0.05	False
TryParseInt64 - Duration of single invocation	13.38 ns	21.58 ns	1.61	0.09	False
TryParseUInt16 - Duration of single invocation	11.70 ns	20.60 ns	1.76	0.20	False
TryParseDouble - Duration of single invocation	106.86 ns	263.13 ns	2.46	0.02	False
TryParseSingle - Duration of single invocation	86.98 ns	213.61 ns	2.46	0.09	False
TryParseInt32 - Duration of single invocation	7.68 ns	12.35 ns	1.61	0.32	False
TryParseBool - Duration of single invocation	6.66 ns	15.64 ns	2.35	0.06	False
TryParseUInt32 - Duration of single invocation	11.45 ns	20.09 ns	1.76	0.46	False
TryParseBool - Duration of single invocation	6.74 ns	15.17 ns	2.25	0.03	False
TryParseUInt16 - Duration of single invocation	7.67 ns	12.25 ns	1.60	0.04	False
TryParseUInt64Hex - Duration of single invocation	33.74 ns	66.35 ns	1.97	0.01	False
TryParseUInt64Hex - Duration of single invocation	8.97 ns	20.38 ns	2.27	0.03	False
TryParseUInt64 - Duration of single invocation	7.51 ns	13.37 ns	1.78	0.05	False
TryParseSingle - Duration of single invocation	91.42 ns	205.89 ns	2.25	0.09	False
TryParseInt16 - Duration of single invocation	13.49 ns	22.74 ns	1.68	0.04	False
TryParseByte - Duration of single invocation	7.53 ns	12.62 ns	1.68	0.07	False
TryParseUInt32Hex - Duration of single invocation	15.56 ns	43.64 ns	2.81	0.11	False
TryParseInt64 - Duration of single invocation	40.83 ns	69.69 ns	1.71	0.02	False
TryParseInt32 - Duration of single invocation	19.48 ns	33.75 ns	1.73	0.07	False
TryParseInt16 - Duration of single invocation	12.61 ns	21.58 ns	1.71	0.31	False
TryParseUInt32Hex - Duration of single invocation	9.00 ns	20.05 ns	2.23	0.17	False
TryParseDecimal - Duration of single invocation	75.40 ns	130.32 ns	1.73	0.08	False
TryParseUInt32Hex - Duration of single invocation	13.14 ns	27.15 ns	2.07	0.17	False
TryParseUInt32 - Duration of single invocation	17.04 ns	32.05 ns	1.88	0.15	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8ParserTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: 12345)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.09077596049632 > 52.06409560731277.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -162.22051549061197 (T) = (0 -102.05405290934888) / Math.Sqrt((1.4010694795969427 / (21)) + (0.5272534613924961 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0557018816650605 = (49.6443836626194 - 102.05405290934888) / 49.6443836626194 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.4215012920918 > 7.667540646195148.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -107.10026771899976 (T) = (0 -12.302011061973975) / Math.Sqrt((0.0011194835359232998 / (21)) + (0.029545901656127246 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6805695016481629 = (7.320144183212408 - 12.302011061973975) / 7.320144183212408 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value:  True )

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.018393879842648 > 6.21457812761203.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -89.6022189870594 (T) = (0 -15.201806576824211) / Math.Sqrt((0.0020788837585594454 / (21)) + (0.14828496652803846 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5604008358254795 = (5.93727605620122 - 15.201806576824211) / 5.93727605620122 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSByte(value: -128)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.52494350750247 > 12.274940267029868.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -35.22145932158528 (T) = (0 -18.010560046670985) / Math.Sqrt((0.10247114467792395 / (21)) + (0.3837646698879551 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5418234779896772 = (11.681337263169869 - 18.010560046670985) / 11.681337263169869 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: 2147483647)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.87942350195394 > 18.416302476035263.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -146.38705137121437 (T) = (0 -32.922351183126715) / Math.Sqrt((0.19389941809320782 / (21)) + (0.02009544115115586 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8493495492343265 = (17.80212464255734 - 32.922351183126715) / 17.80212464255734 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: TRUE)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.923106498387344 > 6.262019397580897.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -98.05032386080246 (T) = (0 -14.85076418344516) / Math.Sqrt((0.029657385042404998 / (21)) + (0.09805143923716954 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5360837621808017 = (5.855786155373217 - 14.85076418344516) / 5.855786155373217 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.808713425531682 > 9.114344802244432.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.299946164635433 (T) = (0 -12.232858793351815) / Math.Sqrt((0.024887230736606897 / (21)) + (0.19404276791940792 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.41601256716917656 = (8.63894789988139 - 12.232858793351815) / 8.63894789988139 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 18446744073709551615)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 81.96098121326307 > 40.35969484592275.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -58.085313206229806 (T) = (0 -83.46067478163464) / Math.Sqrt((0.6080569790835456 / (21)) + (7.894518716000059 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1545524439813957 = (38.736896386428974 - 83.46067478163464) / 38.736896386428974 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseByte(value: 255)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.758175956567523 > 9.661153758070334.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -42.89529741401869 (T) = (0 -15.379805223377812) / Math.Sqrt((0.05605295005037544 / (21)) + (0.2315250390746932 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6300760881586528 = (9.435022901753602 - 15.379805223377812) / 9.435022901753602 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 119.15652673443229 > 49.47449517976624.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -191.0735638175935 (T) = (0 -119.06677491680043) / Math.Sqrt((2.0380270725825116 / (21)) + (0.6043251588153322 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.505681412881389 = (47.518720578240035 - 119.06677491680043) / 47.518720578240035 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.21667218000865 > 11.69536092969228.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -35.293698457539115 (T) = (0 -20.56595553663501) / Math.Sqrt((0.9166417538421714 / (21)) + (0.32643180764922247 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7988688727594739 = (11.432715217917318 - 20.56595553663501) / 11.432715217917318 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.94671967337395 > 11.992741031784831.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -93.00335734111765 (T) = (0 -20.448047416651182) / Math.Sqrt((0.13362418076257038 / (21)) + (0.036608828675797435 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7573425095505378 = (11.635778060066972 - 20.448047416651182) / 11.635778060066972 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDateTimeOffset(value: 12/30/2017 3:45:22 AM -08:00)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.40410012528083 > 21.35956143380306.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -52.026820816707776 (T) = (0 -34.60410245672041) / Math.Sqrt((0.10959550322798332 / (21)) + (0.9442996404200452 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6815124764719572 = (20.579152959557305 - 34.60410245672041) / 20.579152959557305 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: 1.7976931348623157e+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 261.0310739431485 > 112.05234275610108.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -262.0667466751663 (T) = (0 -260.23042270384695) / Math.Sqrt((1.2239438437223498 / (21)) + (3.953441914849088 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.425945682434063 = (107.26968232971555 - 260.23042270384695) / 107.26968232971555 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.235188218902984 > 13.201260325277389.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -43.91671502990577 (T) = (0 -21.36274457523485) / Math.Sqrt((0.7667492087003455 / (21)) + (0.034859570870494586 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.683473319210658 = (12.68968407842148 - 21.36274457523485) / 12.68968407842148 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: true)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.69955194973301 > 6.272306411612054.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -62.01611659974799 (T) = (0 -14.849030152933127) / Math.Sqrt((0.022266566213298332 / (21)) + (0.2781084872866711 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.526178843397975 = (5.878059739016588 - 14.849030152933127) / 5.878059739016588 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: -9223372036854775808)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.41896044529966 > 44.05444567427468.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -345.23418677399627 (T) = (0 -69.43577504783157) / Math.Sqrt((0.03844096309247992 / (21)) + (0.062095944222332326 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6489995380534919 = (42.10781958726003 - 69.43577504783157) / 42.10781958726003 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSByte(value: 127)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.359758483610744 > 11.389417178127992.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -54.60239253767227 (T) = (0 -17.17398906783552) / Math.Sqrt((0.0368757861358231 / (21)) + (0.16661240895396842 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5912141256958514 = (10.79300943254585 - 17.17398906783552) / 10.79300943254585 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: 3039)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.868864177807197 > 13.852081840562207.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -127.37235111740645 (T) = (0 -28.046283590514292) / Math.Sqrt((0.045204670769750224 / (21)) + (0.15932028654588373 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1200474985259303 = (13.229082654994702 - 28.046283590514292) / 13.229082654994702 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.579377221950075 > 14.05833969455981.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -69.38229722837703 (T) = (0 -22.282189978948992) / Math.Sqrt((0.10302600870089411 / (21)) + (0.149612612578878 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6361832513333204 = (13.618395103843843 - 22.282189978948992) / 13.618395103843843 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value: 65535)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.604524542070457 > 11.691206012818038.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -84.6631101668102 (T) = (0 -20.300792474669162) / Math.Sqrt((0.08360282420559631 / (21)) + (0.10142564199350429 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7916805782554229 = (11.330586892020811 - 20.300792474669162) / 11.330586892020811 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDouble(value: -1.7976931348623157e+308)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 263.1344812880917 > 113.15636267226866.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -233.68652142170373 (T) = (0 -262.0545130312741) / Math.Sqrt((1.9943534806780172 / (21)) + (4.758837750777255 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4276033604398055 = (107.9478292466188 - 262.0545130312741) / 107.9478292466188 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: -3.4028235E+38)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 213.60549528004154 > 91.78569445434852.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -114.74322956120862 (T) = (0 -209.44860197873598) / Math.Sqrt((2.6288250024187727 / (21)) + (14.01061861341397 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.388398501224496 = (87.69416069862497 - 209.44860197873598) / 87.69416069862497 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.346095742562033 > 8.0875812889112.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -40.72559373543 (T) = (0 -12.321202016017704) / Math.Sqrt((0.08197811517558971 / (21)) + (0.10471788494604808 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.544778150191695 = (7.976033331704452 - 12.321202016017704) / 7.976033331704452 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: false)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.641858900071176 > 6.870369293738655.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -107.96230112193976 (T) = (0 -15.542542613637439) / Math.Sqrt((0.007340565036024231 / (21)) + (0.09134414888803435 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.35802252525638 = (6.591346116147703 - 15.542542613637439) / 6.591346116147703 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.093435559546187 > 11.683359844711743.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -108.93053827464792 (T) = (0 -20.11806234399804) / Math.Sqrt((0.10585992557388606 / (21)) + (0.02411576738253103 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8027651763513888 = (11.159557888018965 - 20.11806234399804) / 11.159557888018965 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value: False)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.170717452070322 > 6.871214841330859.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -143.44917239561602 (T) = (0 -15.70801162515356) / Math.Sqrt((0.006867119174304362 / (21)) + (0.05231246537527961 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3931876395776799 = (6.563635615268979 - 15.70801162515356) / 6.563635615268979 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt16(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.251770374592883 > 8.05625207192802.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -44.8837102296127 (T) = (0 -12.232867300590316) / Math.Sqrt((0.009396355856024954 / (21)) + (0.13686809993002325 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5898066353676839 = (7.6945629917824245 - 12.232867300590316) / 7.6945629917824245 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: FFFFFFFFFFFFFFFF)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.35469960872119 > 34.947369227816736.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -158.3057575919861 (T) = (0 -66.14759248729749) / Math.Sqrt((0.061690369482623277 / (21)) + (0.5631770852843424 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9889314990813829 = (33.2578535348496 - 66.14759248729749) / 33.2578535348496 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.380346683492146 > 9.410661387286893.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -119.58838209003581 (T) = (0 -20.458025746378773) / Math.Sqrt((0.0059886059894842265 / (21)) + (0.12456839440788493 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2735769461956914 = (8.99816730663573 - 20.458025746378773) / 8.99816730663573 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.371255390202549 > 7.928964468503399.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -97.69997505732734 (T) = (0 -13.485910183990791) / Math.Sqrt((0.009366613808503404 / (21)) + (0.04533876338700807 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7849121207304386 = (7.55550372892978 - 13.485910183990791) / 7.55550372892978 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseSingle(value: 3.4028235E+38)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 205.89344970176643 > 93.69675670339207.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -92.49445594698875 (T) = (0 -208.7768633633918) / Math.Sqrt((3.7176074410391715 / (21)) + (21.41709824710104 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.3741606551679977 = (87.93712544639006 - 208.7768633633918) / 87.93712544639006 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value: -32768)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.73835834194851 > 14.308632194458193.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -111.18553572767787 (T) = (0 -22.712722856308282) / Math.Sqrt((0.02738358188476171 / (21)) + (0.07520444922982997 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6665857419077034 = (13.628295433698801 - 22.712722856308282) / 13.628295433698801 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseByte(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.618816914516163 > 8.006478998126365.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -31.41839034407771 (T) = (0 -12.205420885533453) / Math.Sqrt((0.003083825023166175 / (21)) + (0.2981245876724301 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6049508867951185 = (7.604856314267732 - 12.205420885533453) / 7.604856314267732 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: FFFFFFFFFFFFFFFF)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.641728309453214 > 17.005023200260858.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -130.76255800721708 (T) = (0 -44.449896053086846) / Math.Sqrt((0.08437322688608109 / (21)) + (0.6060329007124753 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7765282775664344 = (16.00916382239989 - 44.449896053086846) / 16.00916382239989 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: 9223372036854775807)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.68975423124975 > 42.47595377542668.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -76.26727270068673 (T) = (0 -70.38716590909578) / Math.Sqrt((0.044910219999601916 / (21)) + (2.086311300585104 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.727932549413234 = (40.73490364713463 - 70.38716590909578) / 40.73490364713463 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt32(value: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.75016855533351 > 20.469658375031738.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -74.1434812995314 (T) = (0 -33.93732730729423) / Math.Sqrt((0.7898752227006284 / (21)) + (0.021484364409187735 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.761380238127611 = (19.26746228478776 - 33.93732730729423) / 19.26746228478776 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt16(value: 32767)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.578185346798936 > 13.231004370106508.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -106.65106129863793 (T) = (0 -21.815887422923346) / Math.Sqrt((0.10449130591513518 / (21)) + (0.030167140180707146 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7030380751108602 = (12.809982196964814 - 21.815887422923346) / 12.809982196964814 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.046722593986775 > 9.279585591846448.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -101.48755059606994 (T) = (0 -20.06126299995691) / Math.Sqrt((0.029431719567534424 / (21)) + (0.15332782944243595 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2845441410151528 = (8.781298045325817 - 20.06126299995691) / 8.781298045325817 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseDecimal(value: 123456.789)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 130.3186910700142 > 77.71402760469984.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -46.02748892745248 (T) = (0 -127.24530186390078) / Math.Sqrt((20.465595300914124 / (21)) + (3.909880870329126 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6807769093855529 = (75.70624105635665 - 127.24530186390078) / 75.70624105635665 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32Hex(value: 3039)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.149435082188404 > 14.186149884701345.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -58.91182213116513 (T) = (0 -27.33822296714698) / Math.Sqrt((0.9486542434362155 / (21)) + (0.1299758603370185 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.011580465345214 = (13.590419790865973 - 27.33822296714698) / 13.590419790865973 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt32(value: 4294967295)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.046321064297445 > 17.870302564517285.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -150.3535735963147 (T) = (0 -32.00229494366073) / Math.Sqrt((0.10107903261341349 / (21)) + (0.06858161261266497 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8622173320364017 = (17.185048379216333 - 32.00229494366073) / 17.185048379216333 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
IndexOf_Word_NotFound - Duration of single invocation	1.17 μs	2.90 μs	2.47	0.01	False
LastIndexOf_Word_NotFound - Duration of single invocation	1.02 μs	2.20 μs	2.16	0.01	False
IsSuffix_DifferentLastChar - Duration of single invocation	119.85 ns	1.00 μs	8.35	0.00	False
IsSuffix_SecondHalf - Duration of single invocation	432.68 ns	1.69 μs	3.90	0.00	False
IsPrefix_DifferentFirstChar - Duration of single invocation	23.81 ns	67.05 ns	2.82	0.04	False
LastIndexOf_Word_NotFound - Duration of single invocation	1.17 μs	2.91 μs	2.48	0.01	False
IsPrefix_FirstHalf - Duration of single invocation	41.45 ns	318.70 ns	7.69	0.02	False
IsPrefix_DifferentFirstChar - Duration of single invocation	15.68 ns	35.56 ns	2.27	0.07	False
IsPrefix_FirstHalf - Duration of single invocation	443.13 ns	1.69 μs	3.82	0.00	False
LastIndexOf_Word_NotFound - Duration of single invocation	1.02 μs	2.19 μs	2.15	0.01	False
IsSuffix_DifferentLastChar - Duration of single invocation	24.39 ns	67.10 ns	2.75	0.04	False
IsPrefix_FirstHalf - Duration of single invocation	68.19 ns	512.48 ns	7.51	0.01	False
IndexOf_Word_NotFound - Duration of single invocation	1.02 μs	2.20 μs	2.16	0.01	False
IndexOf_Word_NotFound - Duration of single invocation	1.17 μs	2.91 μs	2.48	0.01	False
LastIndexOf_Word_NotFound - Duration of single invocation	1.17 μs	2.92 μs	2.49	0.01	False
LastIndexOf_Word_NotFound - Duration of single invocation	1.02 μs	2.19 μs	2.15	0.01	False
IsPrefix_FirstHalf - Duration of single invocation	431.33 ns	1.70 μs	3.93	0.00	False
LastIndexOf_Word_NotFound - Duration of single invocation	16.83 μs	18.18 μs	1.08	0.00	False
IsPrefix_DifferentFirstChar - Duration of single invocation	23.77 ns	66.46 ns	2.80	0.05	False
IsPrefix_FirstHalf - Duration of single invocation	431.30 ns	1.70 μs	3.94	0.00	False
LastIndexOf_Word_NotFound - Duration of single invocation	16.38 μs	18.50 μs	1.13	0.01	False
IsPrefix_DifferentFirstChar - Duration of single invocation	26.99 ns	68.34 ns	2.53	0.04	False
IsPrefix_DifferentFirstChar - Duration of single invocation	23.80 ns	67.40 ns	2.83	0.01	False
IsSuffix_SecondHalf - Duration of single invocation	442.55 ns	1.70 μs	3.83	0.00	False
IsSuffix_SecondHalf - Duration of single invocation	431.94 ns	1.70 μs	3.94	0.00	False
LastIndexOf_Word_NotFound - Duration of single invocation	949.53 ns	1.83 μs	1.93	0.00	False
IsPrefix_DifferentFirstChar - Duration of single invocation	26.54 ns	66.55 ns	2.51	0.03	False
IsSuffix_DifferentLastChar - Duration of single invocation	26.67 ns	67.31 ns	2.52	0.04	False
IsSuffix_SecondHalf - Duration of single invocation	67.66 ns	513.91 ns	7.60	0.00	False
IsSuffix_DifferentLastChar - Duration of single invocation	24.34 ns	67.44 ns	2.77	0.02	False
IsSuffix_DifferentLastChar - Duration of single invocation	70.08 ns	609.05 ns	8.69	0.01	False
IsPrefix_DifferentFirstChar - Duration of single invocation	17.02 ns	40.00 ns	2.35	0.08	False
IsSuffix_DifferentLastChar - Duration of single invocation	26.41 ns	68.87 ns	2.61	0.04	False
IndexOf_Word_NotFound - Duration of single invocation	1.02 μs	2.21 μs	2.17	0.01	False
IsSuffix_SecondHalf - Duration of single invocation	42.05 ns	319.75 ns	7.60	0.01	False
IsPrefix_FirstHalf - Duration of single invocation	442.88 ns	1.69 μs	3.81	0.00	False
IsSuffix_SecondHalf - Duration of single invocation	442.82 ns	1.70 μs	3.83	0.00	False
IndexOf_Word_NotFound - Duration of single invocation	1.02 μs	2.19 μs	2.15	0.01	False
IsPrefix_FirstHalf - Duration of single invocation	431.35 ns	1.68 μs	3.90	0.00	False
IsSuffix_DifferentLastChar - Duration of single invocation	24.34 ns	66.83 ns	2.75	0.04	False
IsSuffix_SecondHalf - Duration of single invocation	432.66 ns	1.69 μs	3.91	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringSearch*'

Payloads

Baseline
Compare

Histogram

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreCase, False))

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.904326540616246 > 1.2305112811181955.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -249.22306768927942 (T) = (0 -2911.61570046865) / Math.Sqrt((762.7660017522805 / (21)) + (179.2166850842882 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.499543038739051 = (1164.8591983987114 - 2911.61570046865) / 1164.8591983987114 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.202395805721368 > 1.0694906073100763.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -204.47173500949188 (T) = (0 -2203.597619934716) / Math.Sqrt((688.1140326752629 / (21)) + (17.950029579935567 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1807746377020165 = (1010.4655390970381 - 2203.597619934716) / 1010.4655390970381 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, OrdinalIgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0005790770290932 > 126.10650893538212.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -5166.288482462691 (T) = (0 -1000.7209004321912) / Math.Sqrt((0.2313199279290253 / (21)) + (0.2525801750156984 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -7.334174079594216 = (120.07439380014912 - 1000.7209004321912) / 120.07439380014912 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, IgnoreNonSpace, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6863145741085994 > 453.58974759538154.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -630.2137148649782 (T) = (0 -1691.4136073543461) / Math.Sqrt((0.1572275468125796 / (21)) + (55.80251853253942 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9150426282710407 = (432.02942290855907 - 1691.4136073543461) / 432.02942290855907 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreNonSpace, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.04827095946898 > 24.9881322079124.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -75.64557203154058 (T) = (0 -67.85307317186059) / Math.Sqrt((6.051805961901827 / (21)) + (0.5434843455646425 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.758717916447555 = (24.595872150363263 - 67.85307317186059) / 24.595872150363263 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.90794545059313 > 1.2287930881215572.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -268.34251503276806 (T) = (0 -2921.0869531418207) / Math.Sqrt((748.8157732299678 / (21)) + (101.83660895336001 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5120270137429839 = (1162.8405813953916 - 2921.0869531418207) / 1162.8405813953916 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, Ordinal, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 318.70090701439864 > 43.732773925445294.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2113.254382420953 (T) = (0 -318.7114573411687) / Math.Sqrt((0.13021832898792632 / (21)) + (0.15386239271052757 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.655276808839557 = (41.63291090573657 - 318.7114573411687) / 41.63291090573657 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, Ordinal, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.559391605735996 > 16.719852245723093.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -106.91937598022645 (T) = (0 -35.32800216303417) / Math.Sqrt((0.028794714758748195 / (21)) + (0.4473032025211948 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2344254262191992 = (15.810777011614825 - 35.32800216303417) / 15.810777011614825 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6926316625166906 > 464.96864526181685.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -957.8832386514255 (T) = (0 -1688.606890803496) / Math.Sqrt((3.962417554669533 / (21)) + (21.013803444920743 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.8076337328133776 = (443.4793389530724 - 1688.606890803496) / 443.4793389530724 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.188528457371975 > 1.068591784583829.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -147.71614053900998 (T) = (0 -2208.004434678474) / Math.Sqrt((687.2282420923618 / (21)) + (462.29532602519606 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1855760897062804 = (1010.261983134711 - 2208.004434678474) / 1010.261983134711 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.09781413625234 > 25.583225000783294.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -244.1524268079397 (T) = (0 -67.83898236373297) / Math.Sqrt((0.003150637245423678 / (21)) + (0.4417151240804807 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.783923845597985 = (24.368117134741954 - 67.83898236373297) / 24.368117134741954 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, OrdinalIgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 512.4776880600992 > 71.9597195664108.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2352.3854793503597 (T) = (0 -512.8189552577984) / Math.Sqrt((0.061548753940494194 / (21)) + (0.4581944134946851 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.475091728437828 = (68.60370064849614 - 512.8189552577984) / 68.60370064849614 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.1980824117910305 > 1.0684965826250448.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -202.51180087615535 (T) = (0 -2201.6311928799432) / Math.Sqrt((694.6811594885367 / (21)) + (20.977050409441784 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.178123469960458 = (1010.7926493808508 - 2201.6311928799432) / 1010.7926493808508 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.9098600085669792 > 1.2309056795908464.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -270.11527173301533 (T) = (0 -2908.4636284308185) / Math.Sqrt((749.7295948377972 / (21)) + (84.05277739757568 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.498526755872843 = (1164.0714359349604 - 2908.4636284308185) / 1164.0714359349604 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.918854660447528 > 1.2299041009254044.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -274.0466307685489 (T) = (0 -2919.2345175248583) / Math.Sqrt((752.2101281482076 / (21)) + (73.5086054819549 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5101341578871603 = (1162.9794799422384 - 2919.2345175248583) / 1162.9794799422384 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.188717641681901 > 1.069789707275812.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -187.00914534165014 (T) = (0 -2206.9057641565614) / Math.Sqrt((694.7996064693306 / (21)) + (109.6506280789227 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1836224066191607 = (1010.6627214791451 - 2206.9057641565614) / 1010.6627214791451 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6955964893482347 > 453.49845796782887.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -608.4776375343249 (T) = (0 -1690.5392624272567) / Math.Sqrt((12.771016358177283 / (21)) + (51.230270193828396 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.8992220758190745 = (433.5580866017077 - 1690.5392624272567) / 433.5580866017077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, IgnoreCase, True))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.184703703127592 > 17.574520849649137.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -30.748480138128304 (T) = (0 -18317.42033963213) / Math.Sqrt((4363.023736961737 / (21)) + (34327.108168597035 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.09477659902518085 = (16731.651330456338 - 18317.42033963213) / 16731.651330456338 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.46136325358022 > 24.958329450121234.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -106.74438529511815 (T) = (0 -67.89280007590921) / Math.Sqrt((0.8187274085392197 / (21)) + (1.8199167696001035 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8273284632810578 = (24.01305718725053 - 67.89280007590921) / 24.01305718725053 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, IgnoreNonSpace, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6995501063638006 > 453.149125623033.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -651.71780488873 (T) = (0 -1686.7996539631106) / Math.Sqrt((4.793324910406632 / (21)) + (48.67231490924234 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.901246832162645 = (432.37450141754755 - 1686.7996539631106) / 432.37450141754755 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreCase, True))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.50498996638988 > 17.491252541592583.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -18.41871059148812 (T) = (0 -18340.83502936342) / Math.Sqrt((86758.2048275883 / (21)) + (47007.489143258266 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.09517818642469597 = (16746.895853759346 - 18340.83502936342) / 16746.895853759346 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.34266027285138 > 27.986677749926383.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -69.64670205690737 (T) = (0 -68.60251231692045) / Math.Sqrt((6.530554630280399 / (21)) + (0.4852075168775686 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4805096153544919 = (27.656620192990626 - 68.60251231692045) / 27.656620192990626 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.4037333993226 > 24.969835693863715.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -280.4462441235814 (T) = (0 -67.69481878228859) / Math.Sqrt((0.009113500575048988 / (21)) + (0.33654960612054396 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8416905626162685 = (23.82202329586645 - 67.69481878228859) / 23.82202329586645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6961850541048287 > 465.142433441994.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -681.1890046542516 (T) = (0 -1689.707598005996) / Math.Sqrt((0.49593547166561713 / (21)) + (46.56241471872222 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.8140701020563457 = (443.0195441596615 - 1689.707598005996) / 443.0195441596615 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6997318793996428 > 453.7251235701234.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -686.6341373150335 (T) = (0 -1692.4170651418087) / Math.Sqrt((0.16652124762719897 / (21)) + (47.04174170204295 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9150190578728923 = (432.28833375368873 - 1692.4170651418087) / 432.28833375368873 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.8314323159650647 > 995.9919020709461.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -379.45224428593406 (T) = (0 -1826.1824734475776) / Math.Sqrt((16.911849376021074 / (21)) + (63.375990334560484 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9223588699820501 = (949.969593068036 - 1826.1824734475776) / 949.969593068036 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.55409179532387 > 27.8544549934028.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -78.40028130522404 (T) = (0 -68.67129084202803) / Math.Sqrt((4.046405456518917 / (21)) + (1.2104919305507411 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5201581752621138 = (27.2488018871616 - 68.67129084202803) / 27.2488018871616 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.30951543643734 > 27.848770840993108.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -225.45249718580024 (T) = (0 -67.71239799400355) / Math.Sqrt((0.07428765394863177 / (21)) + (0.4156204969603628 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.543883399608185 = (26.617728628770003 - 67.71239799400355) / 26.617728628770003 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, OrdinalIgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 513.9055636853195 > 71.24094862583289.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2056.0435029583437 (T) = (0 -512.3806363490163) / Math.Sqrt((0.1049482417472225 / (21)) + (0.5845798538162177 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.555822938408843 = (67.81268440587849 - 512.3806363490163) / 67.81268440587849 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, IgnoreNonSpace, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.44344465993642 > 25.579522714277022.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -144.29962180582405 (T) = (0 -68.11851784479154) / Math.Sqrt((0.3461125680524161 / (21)) + (1.0483696097272004 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.78017035903283 = (24.50156251161843 - 68.11851784479154) / 24.50156251161843 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, Ordinal, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 609.0453344607477 > 72.84234291897162.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2756.2645224399434 (T) = (0 -609.1505801422071) / Math.Sqrt((0.28662860329515816 / (21)) + (0.3455662530551784 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -7.763283853314682 = (69.511679678366 - 609.1505801422071) / 69.511679678366 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_DifferentFirstChar(Options: (en-US, OrdinalIgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.002776903025556 > 17.907930812184826.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -139.52985031037295 (T) = (0 -39.369341533444135) / Math.Sqrt((0.024218193420307444 / (21)) + (0.3407988288444676 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.303654610540654 = (17.089949749109476 - 39.369341533444135) / 17.089949749109476 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.86900674273859 > 27.838542471215337.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -165.26637365207895 (T) = (0 -67.80806621703331) / Math.Sqrt((0.30542516923965185 / (21)) + (0.6658395307034729 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5470148238922825 = (26.622564415785682 - 67.80806621703331) / 26.622564415785682 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.2051311883873406 > 1.0692174992091452.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -205.42315527333582 (T) = (0 -2201.2684402151212) / Math.Sqrt((694.3130566151501 / (21)) + (7.266805371132826 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1776430358176255 = (1010.8490712246718 - 2201.2684402151212) / 1010.8490712246718 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, Ordinal, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 319.7468814499484 > 43.428520206452255.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1401.955335430252 (T) = (0 -318.5080797736751) / Math.Sqrt((0.09366857731006001 / (21)) + (0.48559231632845673 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.744341400195636 = (41.127845908966385 - 318.5080797736751) / 41.127845908966385 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6884130371386996 > 464.86901296849305.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -716.7488981296585 (T) = (0 -1691.2701800124084) / Math.Sqrt((8.460561355835361 / (21)) + (36.747645846158065 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.8082813594819953 = (444.10326348430726 - 1691.2701800124084) / 444.10326348430726 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (, IgnoreCase, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6965002713073312 > 464.78322183534.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -556.4537995370073 (T) = (0 -1692.2349052177647) / Math.Sqrt((1.482641604695424 / (21)) + (69.54747515404439 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.81811137917439 = (443.21255646127463 - 1692.2349052177647) / 443.21255646127463 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.187292378342015 > 1.0701459637083648.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -198.69978966851227 (T) = (0 -2200.7663073240196) / Math.Sqrt((709.8477921954944 / (21)) + (28.98285570746983 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1775084220032779 = (1010.6809622804328 - 2200.7663073240196) / 1010.6809622804328 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6842920812073046 > 453.5389473302386.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -603.4342861485951 (T) = (0 -1688.8146547696876) / Math.Sqrt((0.6583380631874316 / (21)) + (60.30724507803762 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9107095462510406 = (431.84354010352206 - 1688.8146547696876) / 431.84354010352206 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_DifferentLastChar(Options: (en-US, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.82708059945722 > 25.563785795524424.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -69.295845718212 (T) = (0 -67.94188153596022) / Math.Sqrt((0.020636027913658987 / (21)) + (5.508277714638349 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.782052715527491 = (24.42149322216495 - 67.94188153596022) / 24.42149322216495 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (, None, False))

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6935219301823856 > 453.9191634341802.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -634.7518629211482 (T) = (0 -1692.4169986232541) / Math.Sqrt((0.15648108453494142 / (21)) + (55.07899498427116 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9157803832046225 = (432.20426913682087 - 1692.4169986232541) / 432.20426913682087 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Perf_Convert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToBase64CharArray - Duration of single invocation	2.09 μs	3.37 μs	1.61	0.00	False
FromBase64String - Duration of single invocation	151.54 ns	197.94 ns	1.31	0.04	False
ChangeType - Duration of single invocation	56.10 ns	115.19 ns	2.05	0.22	False
ToBase64String - Duration of single invocation	2.41 μs	3.73 μs	1.54	0.01	False
ToBase64CharArray - Duration of single invocation	1.99 μs	3.14 μs	1.58	0.04	False
ToDateTime_String - Duration of single invocation	309.05 ns	527.00 ns	1.71	0.15	False
FromBase64Chars - Duration of single invocation	164.51 ns	207.79 ns	1.26	0.01	False
ToDateTime_String - Duration of single invocation	726.08 ns	1.17 μs	1.61	0.04	False
ToDateTime_String - Duration of single invocation	2.24 μs	3.72 μs	1.67	0.06	False
ToHexString - Duration of single invocation	229.79 ns	424.96 ns	1.85	0.01	False
ToDateTime_String - Duration of single invocation	830.24 ns	1.38 μs	1.66	0.10	False
ToBase64String - Duration of single invocation	2.29 μs	3.50 μs	1.53	0.03	False
ToDateTime_String - Duration of single invocation	513.45 ns	859.26 ns	1.67	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Perf_Convert*'

Payloads

Baseline
Compare

Histogram

System.Perf_Convert.ToBase64CharArray(binaryDataSize: 1024, formattingOptions: InsertLineBreaks)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.3652016338534128 > 2.189751243772272.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1433.3390935736588 (T) = (0 -3364.6326573437777) / Math.Sqrt((6.180410896530323 / (21)) + (7.014521682306337 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.612686583200005 = (2086.3524831138852 - 3364.6326573437777) / 2086.3524831138852 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.FromBase64String

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 197.93793266089426 > 158.33674528770212.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -30.723604703686036 (T) = (0 -201.79719740621485) / Math.Sqrt((2.1434783413765697 / (21)) + (36.566877297920904 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3347916908382965 = (151.1825394114336 - 201.79719740621485) / 151.1825394114336 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ChangeType

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 115.18769762342875 > 59.09574461260494.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -88.08180323075406 (T) = (0 -114.60635484786583) / Math.Sqrt((2.2745142849794204 / (21)) + (4.503748936066023 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.016055918702457 = (56.846813515781356 - 114.60635484786583) / 56.846813515781356 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToBase64String(formattingOptions: InsertLineBreaks)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.725117481516814 > 2.5235334383850314.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -454.5295341895977 (T) = (0 -3729.4016369516908) / Math.Sqrt((84.73975527417548 / (21)) + (63.42949512276421 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5544975089332546 = (2399.104286446187 - 3729.4016369516908) / 2399.104286446187 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToBase64CharArray(binaryDataSize: 1024, formattingOptions: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.1376335959524773 > 2.09046964913098.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1234.4166824106508 (T) = (0 -3141.3254793989586) / Math.Sqrt((7.989228385125156 / (21)) + (6.844825569033666 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5782662225040599 = (1990.3647652136697 - 3141.3254793989586) / 1990.3647652136697 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToDateTime_String(value: "12/12/1999")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 527.0026564064724 > 326.6484003681011.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -75.76484193078548 (T) = (0 -529.3846341805076) / Math.Sqrt((88.4899073232851 / (21)) + (48.11822847906697 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6552674567711965 = (319.81818528175364 - 529.3846341805076) / 319.81818528175364 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.FromBase64Chars

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 207.78620944757333 > 172.7453594578456.
IsChangePoint: Marked as a change because one of 12/1/2022 7:29:59 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -71.939883479328 (T) = (0 -212.23368607873476) / Math.Sqrt((4.816984382972309 / (21)) + (2.7654592024364364 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.28448060132284503 = (165.22918747092183 - 212.23368607873476) / 165.22918747092183 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToDateTime_String(value: "12/12/1999 11:59:59 PM")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1703336756654237 > 764.7380400826747.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -104.83763026532245 (T) = (0 -1193.3972597949455) / Math.Sqrt((38.03039953688982 / (21)) + (250.1258258134505 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6384958324278239 = (728.3492799775033 - 1193.3972597949455) / 728.3492799775033 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToDateTime_String(value: "Fri, 27 Feb 2009 03:11:21 GMT")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.7243761446080246 > 2.3799990039264056.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -97.84482774252618 (T) = (0 -3710.2206164119693) / Math.Sqrt((1804.4486318181157 / (21)) + (1860.5367869965435 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6396306625480264 = (2262.8392485940676 - 3710.2206164119693) / 2262.8392485940676 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToHexString

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 424.96485889083544 > 241.28844059422255.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -412.96609305223114 (T) = (0 -424.02187343441483) / Math.Sqrt((2.134858824019946 / (21)) + (1.6499702756005283 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8392770638796873 = (230.53724844477884 - 424.02187343441483) / 230.53724844477884 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToDateTime_String(value: "Thursday, February 26, 2009")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.382064647977705 > 863.571054389587.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -90.06709030774918 (T) = (0 -1373.8514757278958) / Math.Sqrt((431.2647064480676 / (21)) + (269.0897962174569 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7046376701514676 = (805.9492640484829 - 1373.8514757278958) / 805.9492640484829 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToBase64String(formattingOptions: None)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.4961906991715184 > 2.4073698535960832.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -518.2344746517856 (T) = (0 -3492.961863417465) / Math.Sqrt((43.669979341732194 / (21)) + (46.012723579821 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5236643377948395 = (2292.4746460055235 - 3492.961863417465) / 2292.4746460055235 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Perf_Convert.ToDateTime_String(value: "February 26, 2009")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 859.2607836777881 > 537.6411059881542.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -85.73633693741434 (T) = (0 -843.359283335627) / Math.Sqrt((73.93990516802108 / (21)) + (148.95100956626192 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6195652678855555 = (520.7318902539109 - 843.359283335627) / 520.7318902539109 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in BilinearTest

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Interpol_Scalar - Duration of single invocation	15.75 μs	47.57 μs	3.02	0.00	False
Interpol_Vector - Duration of single invocation	128.43 μs	434.49 μs	3.38	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'BilinearTest*'

Payloads

Baseline
Compare

Histogram

BilinearTest.Interpol_Scalar

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.56796923225309 > 16.82753597963228.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -760.7100559382806 (T) = (0 -47651.15553892196) / Math.Sqrt((20469.369251732296 / (21)) + (10561.293965033909 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.9746875601612646 = (16018.877470391775 - 47651.15553892196) / 16018.877470391775 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### BilinearTest.Interpol_Vector

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 434.4885306712963 > 134.62409072745902.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -171.29074401504454 (T) = (0 -430247.36693277664) / Math.Sqrt((15546416.932915047 / (21)) + (32766551.521416817 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.319923044151751 = (129595.58435870492 - 430247.36693277664) / 129595.58435870492 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Json.Tests.Perf_DateTimes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
WriteDateTimes - Duration of single invocation	6.51 ms	34.37 ms	5.28	0.01	False
WriteDateTimes - Duration of single invocation	5.97 ms	30.84 ms	5.17	0.01	False
WriteDateTimes - Duration of single invocation	5.81 ms	31.29 ms	5.39	0.01	False
WriteDateTimes - Duration of single invocation	6.71 ms	34.09 ms	5.08	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_DateTimes*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: True)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.37053328571428 > 6.850116107916666.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -426.6469305199623 (T) = (0 -33923879.06896913) / Math.Sqrt((47565806.07870254 / (21)) + (57698708005.2245 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.197763620711635 = (6526629.824756162 - 33923879.06896913) / 6526629.824756162 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: False)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.836176891666664 > 6.269288278020833.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -262.3877279749968 (T) = (0 -30838472.60837585) / Math.Sqrt((38764626.925955445 / (21)) + (125736565262.37062 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.16586126315388 = (5969667.212771456 - 30838472.60837585) / 5969667.212771456 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: True)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.29056552884615 > 6.0907444825.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -555.4510131867197 (T) = (0 -31014049.34443027) / Math.Sqrt((32746342.781181283 / (21)) + (28826067405.708374 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.347048436214054 = (5800218.515766725 - 31014049.34443027) / 5800218.515766725 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: False)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.08665260952381 > 7.047123221979167.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -535.1818522224542 (T) = (0 -34004744.4979106) / Math.Sqrt((283516997.8970046 / (21)) + (36210526339.5044 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.0633260569009995 = (6715890.723956881 - 34004744.4979106) / 6715890.723956881 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Numerics.Tests.Perf_Vector2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
AddFunctionBenchmark - Duration of single invocation	1.10 ns	8.96 ns	8.17	0.42	False
TransformNormalByMatrix3x2Benchmark - Duration of single invocation	2.14 ns	27.51 ns	12.88	0.14	False
DivideByScalarOperatorBenchmark - Duration of single invocation	1.82 ns	13.60 ns	7.46	0.43	False
ZeroBenchmark - Duration of single invocation	0.47 ns	1.60 ns	3.41	0.18	False
MaxBenchmark - Duration of single invocation	1.20 ns	14.75 ns	12.28	0.38	False
CreateFromScalar - Duration of single invocation	0.40 ns	1.65 ns	4.15	0.34	False
AddOperatorBenchmark - Duration of single invocation	1.34 ns	8.13 ns	6.06	0.50	False
DistanceSquaredBenchmark - Duration of single invocation	1.02 ns	13.54 ns	13.32	0.28	False
LengthBenchmark - Duration of single invocation	1.48 ns	16.27 ns	11.02	0.52	False
TransformNormalByMatrix4x4Benchmark - Duration of single invocation	2.23 ns	125.04 ns	56.14	0.15	False
ReflectBenchmark - Duration of single invocation	1.14 ns	38.76 ns	34.01	0.34	False
DivideByVector2Benchmark - Duration of single invocation	0.98 ns	11.20 ns	11.40	0.25	False
UnitYBenchmark - Duration of single invocation	0.38 ns	2.94 ns	7.74	0.35	False
OneBenchmark - Duration of single invocation	0.39 ns	2.87 ns	7.34	0.46	False
MultiplyOperatorBenchmark - Duration of single invocation	0.91 ns	9.27 ns	10.15	0.27	False
LengthSquaredBenchmark - Duration of single invocation	1.26 ns	6.66 ns	5.30	0.52	False
NegateBenchmark - Duration of single invocation	1.54 ns	8.95 ns	5.82	0.54	False
AbsBenchmark - Duration of single invocation	1.07 ns	26.25 ns	24.50	0.13	False
TransformByQuaternionBenchmark - Duration of single invocation	5.65 ns	37.55 ns	6.65	0.03	False
NegateOperatorBenchmark - Duration of single invocation	1.71 ns	9.22 ns	5.39	0.43	False
TransformByMatrix4x4Benchmark - Duration of single invocation	2.54 ns	126.27 ns	49.69	0.14	False
DivideByVector2OperatorBenchmark - Duration of single invocation	0.91 ns	11.12 ns	12.16	0.29	False
EqualsBenchmark - Duration of single invocation	4.02 ns	12.65 ns	3.14	0.37	False
NormalizeBenchmark - Duration of single invocation	1.80 ns	45.89 ns	25.43	0.03	False
MinBenchmark - Duration of single invocation	1.20 ns	14.62 ns	12.18	0.35	False
CreateFromScalarXYBenchmark - Duration of single invocation	0.46 ns	3.20 ns	6.96	0.16	False
EqualityOperatorBenchmark - Duration of single invocation	0.80 ns	2.57 ns	3.22	0.23	False
DotBenchmark - Duration of single invocation	0.92 ns	4.80 ns	5.23	0.23	False
MultiplyFunctionBenchmark - Duration of single invocation	0.91 ns	9.27 ns	10.24	0.24	False
ClampBenchmark - Duration of single invocation	1.11 ns	34.94 ns	31.45	0.39	False
SquareRootBenchmark - Duration of single invocation	1.83 ns	26.78 ns	14.64	0.54	False
MultiplyByScalarOperatorBenchmark - Duration of single invocation	1.72 ns	11.65 ns	6.76	0.40	False
TransformByMatrix3x2Benchmark - Duration of single invocation	2.50 ns	27.50 ns	11.02	0.16	False
DivideByScalarBenchmark - Duration of single invocation	1.67 ns	13.52 ns	8.10	0.39	False
SubtractFunctionBenchmark - Duration of single invocation	0.92 ns	8.92 ns	9.73	0.22	False
UnitXBenchmark - Duration of single invocation	0.46 ns	3.19 ns	6.96	0.20	False
LerpBenchmark - Duration of single invocation	1.59 ns	44.88 ns	28.28	0.38	False
SubtractOperatorBenchmark - Duration of single invocation	0.97 ns	7.80 ns	8.02	0.31	False
InequalityOperatorBenchmark - Duration of single invocation	0.82 ns	5.32 ns	6.46	0.20	False
DistanceBenchmark - Duration of single invocation	1.37 ns	23.81 ns	17.34	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector2.AddFunctionBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.955168419991898 > 1.1404238766198596.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -56.556973809214774 (T) = (0 -8.59964957264516) / Math.Sqrt((0.0011102577260662726 / (21)) + (0.24607951382042914 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.88863210903054 = (1.0901319080149117 - 8.59964957264516) / 1.0901319080149117 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.5108017911665 > 2.2824012893333228.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -20.65237450908493 (T) = (0 -25.352269805979226) / Math.Sqrt((0.0023002091748367194 / (21)) + (17.57829453628834 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -10.473643845043128 = (2.209609270461361 - 25.352269805979226) / 2.209609270461361 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.DivideByScalarOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.604889393094549 > 1.9870445426692347.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -135.11768497339017 (T) = (0 -13.309009019388581) / Math.Sqrt((0.01211288056047694 / (21)) + (0.09217129633488506 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.096580208007631 = (1.8754116249360469 - 13.309009019388581) / 1.8754116249360469 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.ZeroBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6047056536006092 > 0.49090341705650425.
IsChangePoint: Marked as a change because one of 1/6/2023 2:21:07 AM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -7.661386316188469 (T) = (0 -1.3756755463118904) / Math.Sqrt((0.00039549869218926986 / (22)) + (0.1814962089428941 / (13))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (13) - 2, .025) and -1.9279599639945566 = (0.4698409688755047 - 1.3756755463118904) / 0.4698409688755047 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.MaxBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.746664491290998 > 1.1820486258763123.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -119.39669199101914 (T) = (0 -14.587296456004816) / Math.Sqrt((0.0017233618021515388 / (21)) + (0.1763849493685097 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -11.772941147984765 = (1.142046791494558 - 14.587296456004816) / 1.142046791494558 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.CreateFromScalar

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6457124670760883 > 0.4045227569120512.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -18.721609106171265 (T) = (0 -2.5576428748986153) / Math.Sqrt((0.0001359017800232202 / (21)) + (0.18912267070103644 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.710128942292232 = (0.3811615092488677 - 2.5576428748986153) / 0.3811615092488677 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.AddOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.127256177782307 > 1.423807908604241.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -79.71773478999982 (T) = (0 -8.623576394805948) / Math.Sqrt((0.008160383845718365 / (21)) + (0.1116589848355186 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.469797141191343 = (1.3328974937872642 - 8.623576394805948) / 1.3328974937872642 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.DistanceSquaredBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.539069622711402 > 1.1171573034098883.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -121.72330377677964 (T) = (0 -13.299623708632211) / Math.Sqrt((0.0035755696696445904 / (21)) + (0.1390880458354012 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -11.505765188882478 = (1.063479403919679 - 13.299623708632211) / 1.063479403919679 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.LengthBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.271977610455902 > 1.51737343946664.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -129.94908938725555 (T) = (0 -16.28313230163784) / Math.Sqrt((0.012804771156149211 / (21)) + (0.17360061828895826 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -10.144619891266386 = (1.4610756096220303 - 16.28313230163784) / 1.4610756096220303 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix4x4Benchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 125.04051618279097 > 2.33299998535546.
IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.68175782268302 (T) = (0 -125.41689666385908) / Math.Sqrt((66.35988204685107 / (25)) + (2.1401639447484793 / (10))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (10) - 2, .025) and -20.97388190332472 = (5.707543947657381 - 125.41689666385908) / 5.707543947657381 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.ReflectBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.75742579894992 > 1.2011896930831103.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -299.00993439054304 (T) = (0 -38.63282021630902) / Math.Sqrt((0.0012967046935518005 / (21)) + (0.218841369790324 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -31.87875240916887 = (1.175008702749181 - 38.63282021630902) / 1.175008702749181 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.DivideByVector2Benchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.200856963686679 > 0.9590387207999044.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -458.26980279347725 (T) = (0 -11.216273205996758) / Math.Sqrt((0.0004953726645495343 / (21)) + (0.006734931901524414 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -11.172402795702297 = (0.9214510392275945 - 11.216273205996758) / 0.9214510392275945 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.UnitYBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.9440677761550083 > 0.40205855932616974.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -22.1067337492182 (T) = (0 -2.924592189411366) / Math.Sqrt((5.3691571590350976E-05 / (21)) + (0.18503156025884723 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.638299062119342 = (0.38288526877866197 - 2.924592189411366) / 0.38288526877866197 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.OneBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.8665823991347286 > 0.5445806374786281.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -23.77962019624646 (T) = (0 -2.670619389075392) / Math.Sqrt((0.0022130165351824465 / (21)) + (0.11632801556055977 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.4580674650078285 = (0.4892976142557742 - 2.670619389075392) / 0.4892976142557742 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.MultiplyOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.26772094702316 > 0.9538707106308771.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -104.0890203851908 (T) = (0 -9.003366861477984) / Math.Sqrt((0.00034807338587370523 / (21)) + (0.08425315892344638 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.81386109016848 = (0.9174133176286295 - 9.003366861477984) / 0.9174133176286295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.LengthSquaredBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 6.6612122373551355 > 1.318311480849604.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -64.34872580397032 (T) = (0 -6.603724029510664) / Math.Sqrt((0.002808802216681912 / (21)) + (0.09550914727810836 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.3387826313786 = (1.236934425967709 - 6.603724029510664) / 1.236934425967709 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.NegateBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.946667278324481 > 1.7809463707184.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -85.65645866525905 (T) = (0 -8.932106715602123) / Math.Sqrt((0.010130651983751474 / (21)) + (0.09345380832071776 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.299994086116448 = (1.6853050343961973 - 8.932106715602123) / 1.6853050343961973 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.AbsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.24723037590036 > 1.11697965619483.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -189.12198561513486 (T) = (0 -26.083409837733846) / Math.Sqrt((0.0007537234427881864 / (21)) + (0.24442096107790492 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -23.403659302021698 = (1.068831912252315 - 26.083409837733846) / 1.068831912252315 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformByQuaternionBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.55416616838223 > 5.819783177746716.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -237.91773579556036 (T) = (0 -37.954612977441506) / Math.Sqrt((0.03631004922758588 / (21)) + (0.23421786830052985 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.741170433367132 = (5.630270492728611 - 37.954612977441506) / 5.630270492728611 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.NegateOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.220978786185405 > 1.826602266636793.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -73.20641946761639 (T) = (0 -8.990059909974523) / Math.Sqrt((0.012655340641301888 / (21)) + (0.13017556395836466 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.270333423758169 = (1.705785798949299 - 8.990059909974523) / 1.705785798949299 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformByMatrix4x4Benchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 126.27213260864826 > 2.6683036851937127.
IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -71.84068759782512 (T) = (0 -124.96755011335918) / Math.Sqrt((67.42756380359464 / (25)) + (0.39599186312995005 / (10))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (10) - 2, .025) and -19.414039824115683 = (6.121647218779865 - 124.96755011335918) / 6.121647218779865 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.DivideByVector2OperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.119948301613654 > 0.9854399817810788.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -392.76344202405244 (T) = (0 -11.162186438350494) / Math.Sqrt((0.000389549470859819 / (21)) + (0.009258531788938625 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -11.118054629306863 = (0.9211203266368635 - 11.162186438350494) / 0.9211203266368635 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.EqualsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.645758423497831 > 4.238174993036342.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -151.90607129001404 (T) = (0 -12.55489945323365) / Math.Sqrt((0.014906767619684564 / (21)) + (0.03365708523264476 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.078573639656488 = (4.078154666014274 - 12.55489945323365) / 4.078154666014274 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.NormalizeBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.894914613214574 > 1.894035878553923.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -218.11177299893797 (T) = (0 -46.65272828024995) / Math.Sqrt((0.0006459886723683676 / (21)) + (0.5913108723807472 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -24.758953859966937 = (1.8111266681817737 - 46.65272828024995) / 1.8111266681817737 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.MinBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.615563664557419 > 1.216966158050168.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -108.18197905731057 (T) = (0 -14.440817107092721) / Math.Sqrt((0.0015495934326858296 / (21)) + (0.2099903448829081 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -11.459301908324237 = (1.1590390226794813 - 14.440817107092721) / 1.1590390226794813 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.CreateFromScalarXYBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.1960408061067893 > 0.4828180040715243.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -44.8121156713875 (T) = (0 -3.0628865055622856) / Math.Sqrt((0.00010700859918083218 / (21)) + (0.047022095634646224 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.603117903451057 = (0.4638545835992868 - 3.0628865055622856) / 0.4638545835992868 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.EqualityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.5738338792672555 > 0.7225281747573459.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -21.996434113671214 (T) = (0 -2.769044695318708) / Math.Sqrt((0.0033972507619668786 / (21)) + (0.11803191731133311 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.7929305984984767 = (0.7300541424129673 - 2.769044695318708) / 0.7300541424129673 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.DotBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.800588269260065 > 0.9558319316180139.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -31.21158237529665 (T) = (0 -4.443359994941288) / Math.Sqrt((0.00012649713340829205 / (21)) + (0.17890901708070261 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.860331754383716 = (0.9142091979490194 - 4.443359994941288) / 0.9142091979490194 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.MultiplyFunctionBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.269564054425596 > 0.9578572910882243.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -83.71957243630702 (T) = (0 -9.023257482642745) / Math.Sqrt((0.04386578184147115 / (21)) + (0.10025002297623865 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.287417875709327 = (0.9715571758908924 - 9.023257482642745) / 0.9715571758908924 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.ClampBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.941081135702184 > 1.1726894501713694.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -218.84243282111396 (T) = (0 -35.063306123687696) / Math.Sqrt((0.0009731654232495666 / (21)) + (0.3358434986212885 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -29.877665168274284 = (1.1355556170650496 - 35.063306123687696) / 1.1355556170650496 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.SquareRootBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.776378230351973 > 2.0300998710169096.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -33.033985791256285 (T) = (0 -31.793938091115272) / Math.Sqrt((0.015327598028640584 / (21)) + (11.462925983067208 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -15.828200415380348 = (1.8893249014349032 - 31.793938091115272) / 1.8893249014349032 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.MultiplyByScalarOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.646128647825307 > 1.728135741851112.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -189.4302564510579 (T) = (0 -11.596593484418491) / Math.Sqrt((0.022656945540179815 / (21)) + (0.023850628920778646 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.228776003004361 = (1.604226424999034 - 11.596593484418491) / 1.604226424999034 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.TransformByMatrix3x2Benchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.503746884497836 > 2.6247239499192463.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -21.052331285600374 (T) = (0 -26.846120902122596) / Math.Sqrt((0.0014322351691148857 / (21)) + (18.70541466186602 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -9.690791527814527 = (2.5111443649683287 - 26.846120902122596) / 2.5111443649683287 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.DivideByScalarBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.515452332006198 > 1.7809153624620568.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -96.81297976269775 (T) = (0 -13.166313542595523) / Math.Sqrt((0.008568675080489948 / (21)) + (0.1901832870177824 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -6.680310276112002 = (1.7142944841104384 - 13.166313542595523) / 1.7142944841104384 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.SubtractFunctionBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.918654554904553 > 0.9664828242501171.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.31278200480176 (T) = (0 -8.621139830284568) / Math.Sqrt((0.0007083843159465281 / (21)) + (0.1670683384493816 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.277035767697173 = (0.9292989750350594 - 8.621139830284568) / 0.9292989750350594 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.UnitXBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.1915486553165224 > 0.4722482627463494.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -22.030306971323384 (T) = (0 -2.988425252287309) / Math.Sqrt((0.0001293532999174559 / (21)) + (0.18529686999367947 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.591935985802561 = (0.4533456117783389 - 2.988425252287309) / 0.4533456117783389 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.LerpBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.88351983828245 > 1.6557298052783673.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -154.94669909485998 (T) = (0 -42.9041207362214) / Math.Sqrt((0.028895369379384618 / (21)) + (0.9809159326023764 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -27.811016988497652 = (1.4891567608790137 - 42.9041207362214) / 1.4891567608790137 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.SubtractOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.800707618569944 > 0.9588920520304491.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.65853634453198 (T) = (0 -8.680784477433635) / Math.Sqrt((0.04415950981941076 / (21)) + (0.1371282260122278 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -7.916255764492594 = (0.9735907881874943 - 8.680784477433635) / 0.9735907881874943 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.InequalityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.323875263100311 > 0.7858047805116898.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -65.29409400233311 (T) = (0 -5.126866241114517) / Math.Sqrt((0.01930398407990047 / (21)) + (0.048956898361885264 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.50782331574674 = (0.7878004660497202 - 5.126866241114517) / 0.7878004660497202 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector2.DistanceBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.809009537761575 > 1.4158671416945263.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -167.51172694645797 (T) = (0 -23.94286714397233) / Math.Sqrt((9.729433812626908E-05 / (21)) + (0.2545325443931952 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -16.692398095792782 = (1.35328557577878 - 23.94286714397233) / 1.35328557577878 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Collections.CreateAddAndRemove<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Queue - Duration of single invocation	13.31 μs	19.96 μs	1.50	0.02	False
LinkedList - Duration of single invocation	51.38 μs	58.92 μs	1.15	0.33	False
Dictionary - Duration of single invocation	84.52 μs	103.00 μs	1.22	0.05	False
HashSet - Duration of single invocation	74.66 μs	88.35 μs	1.18	0.03	False
Stack - Duration of single invocation	12.43 μs	15.71 μs	1.26	0.08	False
SortedSet - Duration of single invocation	1.49 ms	1.76 ms	1.18	0.26	False
SortedList - Duration of single invocation	1.66 ms	1.83 ms	1.10	0.26	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove&lt;String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndRemove<String>.Queue(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.955117427628778 > 13.894652283950107.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -117.61070269479634 (T) = (0 -19851.17193146245) / Math.Sqrt((61683.45657139622 / (21)) + (3279.8663602621737 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5007260719074142 = (13227.711774362475 - 19851.17193146245) / 13227.711774362475 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CreateAddAndRemove&lt;String&gt;.LinkedList(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.92402272869673 > 53.66841029996707.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -12.084129130084058 (T) = (0 -58483.29606059159) / Math.Sqrt((7900000.221415332 / (21)) + (3195204.154864147 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.19138338783101957 = (49088.560960266295 - 58483.29606059159) / 49088.560960266295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CreateAddAndRemove&lt;String&gt;.Dictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 103.00006975446429 > 91.89979273046843.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -25.64922010517664 (T) = (0 -104090.44560849851) / Math.Sqrt((2508464.6942926995 / (21)) + (3822339.199673673 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.18255344532008205 = (88021.76850478358 - 104090.44560849851) / 88021.76850478358 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CreateAddAndRemove&lt;String&gt;.HashSet(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 88.34948965899919 > 77.49865660438616.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -38.45637067387678 (T) = (0 -89400.94281099988) / Math.Sqrt((1010440.4719622128 / (21)) + (1522089.6904932894 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.20533221518245467 = (74171.20498805137 - 89400.94281099988) / 74171.20498805137 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CreateAddAndRemove&lt;String&gt;.Stack(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.713758793016193 > 13.075437244913656.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -72.34704699366512 (T) = (0 -15698.788747746215) / Math.Sqrt((36999.61772492393 / (21)) + (3970.0321792606887 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2633044626588549 = (12426.765844478416 - 15698.788747746215) / 12426.765844478416 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CreateAddAndRemove&lt;String&gt;.SortedSet(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.7633688314814817 > 1.6231783594886364.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -17.510364008763975 (T) = (0 -1780507.7418853927) / Math.Sqrt((1079856007.6698406 / (21)) + (2470797463.698045 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1743528177317154 = (1516160.8291829 - 1780507.7418853927) / 1516160.8291829 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.CreateAddAndRemove&lt;String&gt;.SortedList(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.8336920149572646 > 1.74004500621875.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -9.454420997237728 (T) = (0 -1844660.949247231) / Math.Sqrt((3994927056.466127 / (21)) + (2973220236.911496 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1146275719058435 = (1654957.2213552385 - 1844660.949247231) / 1654957.2213552385 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Memory.Span<Char>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToArray - Duration of single invocation	264.52 ns	625.16 ns	2.36	0.04	False
ToArray - Duration of single invocation	26.57 ns	29.48 ns	1.11	0.37	False
EndsWith - Duration of single invocation	76.82 ns	683.97 ns	8.90	0.01	False
SequenceCompareToDifferent - Duration of single invocation	16.01 ns	28.93 ns	1.81	0.01	False
Reverse - Duration of single invocation	11.89 ns	14.72 ns	1.24	0.07	False
StartsWith - Duration of single invocation	14.42 ns	34.57 ns	2.40	0.09	False
SequenceCompareTo - Duration of single invocation	23.44 ns	96.12 ns	4.10	0.01	False
SequenceCompareToDifferent - Duration of single invocation	15.88 ns	29.49 ns	1.86	0.02	False
SequenceCompareTo - Duration of single invocation	141.75 ns	1.34 μs	9.46	0.03	False
Reverse - Duration of single invocation	24.77 ns	38.35 ns	1.55	0.03	False
SequenceCompareToDifferent - Duration of single invocation	16.10 ns	29.63 ns	1.84	0.05	False
SequenceEqual - Duration of single invocation	17.36 ns	106.05 ns	6.11	0.03	False
StartsWith - Duration of single invocation	16.22 ns	59.27 ns	3.65	0.01	False
SequenceEqual - Duration of single invocation	136.63 ns	1.34 μs	9.83	0.01	False
Clear - Duration of single invocation	16.51 ns	18.50 ns	1.12	0.03	False
EndsWith - Duration of single invocation	14.62 ns	35.15 ns	2.40	0.03	False
SequenceCompareTo - Duration of single invocation	16.92 ns	21.62 ns	1.28	0.03	False
SequenceEqual - Duration of single invocation	10.66 ns	25.06 ns	2.35	0.09	False
EndsWith - Duration of single invocation	17.62 ns	70.94 ns	4.03	0.04	False
ToArray - Duration of single invocation	41.27 ns	72.39 ns	1.75	0.38	False
StartsWith - Duration of single invocation	75.70 ns	686.27 ns	9.07	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Char&gt;*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Char>.ToArray(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 625.1569604474093 > 273.0953900529978.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -341.5415019082829 (T) = (0 -624.7255572632076) / Math.Sqrt((14.250301552921306 / (21)) + (6.74809360868845 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.43291975950267 = (256.78017321496543 - 624.7255572632076) / 256.78017321496543 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.ToArray(Size: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.48355563660362 > 29.291745932078005.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -6.118691017636916 (T) = (0 -30.855460898838317) / Math.Sqrt((2.307112808190087 / (21)) + (2.3565890561406353 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.11680902364556381 = (27.628233874864144 - 30.855460898838317) / 27.628233874864144 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.EndsWith(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 683.9692136689799 > 80.43977293777922.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -3357.351488835933 (T) = (0 -683.7518562630299) / Math.Sqrt((0.09185060531472097 / (21)) + (0.3967736271734153 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -7.93796093498508 = (76.49975886409167 - 683.7518562630299) / 76.49975886409167 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceCompareToDifferent(Size: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.93220342475754 > 16.768044431002707.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -181.92136194124248 (T) = (0 -29.3935552776245) / Math.Sqrt((0.01766722283833733 / (21)) + (0.0644029846734808 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8401061108494788 = (15.973837108804048 - 29.3935552776245) / 15.973837108804048 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.Reverse(Size: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.723105503886716 > 12.445016951636054.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.99608702880741 (T) = (0 -14.814724321445935) / Math.Sqrt((0.025709289873642027 / (21)) + (0.007672758545008419 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2527379339191236 = (11.825876682043836 - 14.814724321445935) / 11.825876682043836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.StartsWith(Size: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.56722572890901 > 14.940919920899105.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -125.51882984087717 (T) = (0 -34.27809907787886) / Math.Sqrt((0.07477748306073174 / (21)) + (0.3177457415437334 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4591452784475716 = (13.939029702026474 - 34.27809907787886) / 13.939029702026474 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceCompareTo(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 96.12212845081008 > 24.606488275409802.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -660.3320967312634 (T) = (0 -95.72878531847087) / Math.Sqrt((0.03432593689970155 / (21)) + (0.14570699103862206 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.1145501759582843 = (23.26591759114361 - 95.72878531847087) / 23.26591759114361 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceCompareToDifferent(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.488032069461543 > 16.66754677238355.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -19.64840973265854 (T) = (0 -29.800145932328938) / Math.Sqrt((0.022185159086324135 / (21)) + (6.895406647751271 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8629713585062461 = (15.996030103341509 - 29.800145932328938) / 15.996030103341509 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceCompareTo(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3404348631152971 > 148.47889177368893.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1837.0617840432744 (T) = (0 -1342.4558213827302) / Math.Sqrt((0.05997352288652332 / (21)) + (5.94310977287322 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.486496803254044 = (141.51228311406197 - 1342.4558213827302) / 141.51228311406197 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.Reverse(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.352721631717024 > 26.077079001450038.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -124.42006283646158 (T) = (0 -38.64881193337031) / Math.Sqrt((0.1481233434325518 / (21)) + (0.07171293976388958 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5509292234401946 = (24.91977799453764 - 38.64881193337031) / 24.91977799453764 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceCompareToDifferent(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.63313062001458 > 16.89409266837543.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.17367445920486 (T) = (0 -29.34056123518241) / Math.Sqrt((0.35925956903223055 / (21)) + (0.24862625156227974 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8069842899403689 = (16.23730842516105 - 29.34056123518241) / 16.23730842516105 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceEqual(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 106.05253354132608 > 18.19486614774714.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -657.631953671932 (T) = (0 -106.357152678559) / Math.Sqrt((0.16962732091297625 / (21)) + (0.14187016750904757 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.039326955590225 = (17.610762500631115 - 106.357152678559) / 17.610762500631115 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.StartsWith(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.27449365257204 > 16.893754618774057.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -188.56935613334318 (T) = (0 -58.80362570694702) / Math.Sqrt((0.017257037741420435 / (21)) + (0.706124843184696 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.650003084028723 = (16.110568773011007 - 58.80362570694702) / 16.110568773011007 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceEqual(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3432940037219767 > 143.52139393903667.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -4934.171671827542 (T) = (0 -1342.9682001418357) / Math.Sqrt((0.22268064915788277 / (21)) + (0.6882350753697668 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.82187498139734 = (136.73236552953702 - 1342.9682001418357) / 136.73236552953702 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.Clear(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.50015300653261 > 17.3336508504837.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -93.85005297227664 (T) = (0 -18.582422364554905) / Math.Sqrt((0.006656592997595537 / (21)) + (0.002371853796107338 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.12534730277942863 = (16.51261110117675 - 18.582422364554905) / 16.51261110117675 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.EndsWith(Size: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.14509658487124 > 15.198418819527948.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -171.38839902829727 (T) = (0 -35.34581171451658) / Math.Sqrt((0.18386445073212726 / (21)) + (0.08068389168110414 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4053452632311618 = (14.694693628737376 - 35.34581171451658) / 14.694693628737376 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceCompareTo(Size: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.624044875793857 > 15.571452684818349.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -52.99136516261747 (T) = (0 -21.51801525848296) / Math.Sqrt((0.23869728063588144 / (21)) + (0.061406275357549805 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4473597168837325 = (14.86708176790547 - 21.51801525848296) / 14.86708176790547 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.SequenceEqual(Size: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.05684506133057 > 10.772793897837683.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -44.36053720386783 (T) = (0 -24.811146150272883) / Math.Sqrt((1.77500537036692 / (21)) + (0.24232200635776155 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.328560214098363 = (10.655144754278968 - 24.811146150272883) / 10.655144754278968 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.EndsWith(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 70.93664535215356 > 18.64830945015777.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -236.60418459116926 (T) = (0 -71.2395434016338) / Math.Sqrt((0.09203791425373689 / (21)) + (0.6514636833584753 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9908138647294917 = (17.85088100230468 - 71.2395434016338) / 17.85088100230468 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.ToArray(Size: 33)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 72.39122813479086 > 46.24939950107759.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -38.489936169840924 (T) = (0 -71.20696242062448) / Math.Sqrt((2.28982123726598 / (21)) + (5.4431984421131805 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6165271121656654 = (44.04934620937371 - 71.20696242062448) / 44.04934620937371 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Char&gt;.StartsWith(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 686.2682782427088 > 79.52875956997084.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -3003.9682134264353 (T) = (0 -685.5028525937836) / Math.Sqrt((0.008377212499482582 / (21)) + (0.5711789219830502 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.045593584021631 = (75.78307009112962 - 685.5028525937836) / 75.78307009112962 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Numerics.Tests.Perf_Quaternion

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
CreateFromVector3WithScalarBenchmark - Duration of single invocation	4.13 ns	20.59 ns	4.99	0.38	False
SubtractBenchmark - Duration of single invocation	11.26 ns	45.43 ns	4.04	0.19	False
IdentityBenchmark - Duration of single invocation	4.64 ns	13.59 ns	2.93	0.06	False
ConcatenateBenchmark - Duration of single invocation	13.48 ns	58.38 ns	4.33	0.20	False
AddBenchmark - Duration of single invocation	11.18 ns	44.85 ns	4.01	0.32	False
CreateFromScalarXYZWBenchmark - Duration of single invocation	3.40 ns	8.97 ns	2.64	0.17	False
DivisionOperatorBenchmark - Duration of single invocation	21.00 ns	63.13 ns	3.01	0.07	False
DivideBenchmark - Duration of single invocation	11.25 ns	44.76 ns	3.98	0.08	False
MultiplyByQuaternionBenchmark - Duration of single invocation	13.54 ns	58.37 ns	4.31	0.15	False
AddOperatorBenchmark - Duration of single invocation	10.58 ns	44.14 ns	4.17	0.29	False
EqualityOperatorBenchmark - Duration of single invocation	10.92 ns	28.42 ns	2.60	0.08	False
InequalityOperatorBenchmark - Duration of single invocation	12.41 ns	32.60 ns	2.63	0.03	False
SlerpBenchmark - Duration of single invocation	19.70 ns	66.80 ns	3.39	0.08	False
EqualsBenchmark - Duration of single invocation	12.05 ns	40.81 ns	3.39	0.41	False
LengthSquaredBenchmark - Duration of single invocation	11.52 ns	17.21 ns	1.49	0.32	False
CreateFromYawPitchRollBenchmark - Duration of single invocation	45.23 ns	108.55 ns	2.40	0.16	False
LerpBenchmark - Duration of single invocation	19.74 ns	66.54 ns	3.37	0.12	False
LengthBenchmark - Duration of single invocation	8.97 ns	26.71 ns	2.98	0.40	False
CreateFromRotationMatrixBenchmark - Duration of single invocation	17.86 ns	150.64 ns	8.43	0.14	False
MultiplyByQuaternionOperatorBenchmark - Duration of single invocation	13.89 ns	58.37 ns	4.20	0.03	False
InverseBenchmark - Duration of single invocation	13.20 ns	43.74 ns	3.31	0.47	False
ConjugateBenchmark - Duration of single invocation	9.59 ns	31.33 ns	3.27	0.18	False
IsIdentityBenchmark - Duration of single invocation	9.22 ns	31.47 ns	3.41	0.43	False
SubtractionOperatorBenchmark - Duration of single invocation	11.01 ns	45.31 ns	4.12	0.26	False
CreateFromAxisAngleBenchmark - Duration of single invocation	22.21 ns	57.52 ns	2.59	0.09	False
NormalizeBenchmark - Duration of single invocation	14.87 ns	53.09 ns	3.57	0.45	False
NegationOperatorBenchmark - Duration of single invocation	8.02 ns	32.32 ns	4.03	0.39	False
NegateBenchmark - Duration of single invocation	7.58 ns	31.36 ns	4.13	0.36	False
MultiplyByScalarOperatorBenchmark - Duration of single invocation	8.87 ns	32.63 ns	3.68	0.35	False
DotBenchmark - Duration of single invocation	10.31 ns	28.11 ns	2.73	0.06	False
MultiplyByScalarBenchmark - Duration of single invocation	8.52 ns	35.49 ns	4.17	0.30	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Quaternion.CreateFromVector3WithScalarBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.594610967908313 > 4.781215157004568.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -95.25746189753836 (T) = (0 -20.192100140419313) / Math.Sqrt((0.08662288647026117 / (21)) + (0.3195502564468033 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.4337066989625433 = (4.5542255073264375 - 20.192100140419313) / 4.5542255073264375 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.SubtractBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.43125845142016 > 11.807196055756314.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -152.69432906143703 (T) = (0 -44.117543127975274) / Math.Sqrt((0.020634886550710517 / (21)) + (0.6360069133044348 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9313304312991915 = (11.2220389252286 - 44.117543127975274) / 11.2220389252286 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.IdentityBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.59462865337177 > 4.888048304466795.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -85.26983769343914 (T) = (0 -13.540896255463165) / Math.Sqrt((0.00707210877691319 / (21)) + (0.14634876115904805 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.891256098241232 = (4.683395657582935 - 13.540896255463165) / 4.683395657582935 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.ConcatenateBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.377040758741906 > 14.323438134769793.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -130.98833864433252 (T) = (0 -58.128315332856324) / Math.Sqrt((0.13355962544229066 / (21)) + (1.533876410710859 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.2961953639323966 = (13.530184362856877 - 58.128315332856324) / 13.530184362856877 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.AddBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.85443058876739 > 11.311879492643003.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -131.49028112774994 (T) = (0 -44.52737506035214) / Math.Sqrt((0.5248609240305031 / (21)) + (0.5511667572920719 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9868298364070927 = (11.168616892984815 - 44.52737506035214) / 11.168616892984815 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.CreateFromScalarXYZWBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.968270135453501 > 3.5662084311109705.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -61.89531968957955 (T) = (0 -9.78418362304407) / Math.Sqrt((0.010648688943596118 / (21)) + (0.13900683584014395 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.8268861668890857 = (3.4611169482679625 - 9.78418362304407) / 3.4611169482679625 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.DivisionOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.13031903535272 > 22.077313002159173.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -177.83892042937939 (T) = (0 -62.310460685264005) / Math.Sqrt((0.4759442409910971 / (21)) + (0.4309574179122083 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.9396301677462005 = (21.196700649264706 - 62.310460685264005) / 21.196700649264706 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.DivideBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.761222228502646 > 11.778674526115482.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -161.37712572585812 (T) = (0 -43.94332910863386) / Math.Sqrt((0.5098859677385321 / (21)) + (0.23204476020756848 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.8802672744030517 = (11.32482017373254 - 43.94332910863386) / 11.32482017373254 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.3743444278188 > 14.052552213811198.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -190.41312415969418 (T) = (0 -57.878394059098596) / Math.Sqrt((0.03156383204131957 / (21)) + (0.7378672201792582 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.272946844872424 = (13.545311037171738 - 57.878394059098596) / 13.545311037171738 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.AddOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.13591712693782 > 11.567533522745586.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -253.00485942372376 (T) = (0 -44.22094712411946) / Math.Sqrt((0.10384117363005137 / (21)) + (0.1720409911459357 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.0173791299765638 = (11.00741197019596 - 44.22094712411946) / 11.00741197019596 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.EqualityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.42112810438494 > 11.460111693186331.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -244.33358842783647 (T) = (0 -28.69894364604659) / Math.Sqrt((0.04718004779414728 / (21)) + (0.04187881236674092 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6053199199269925 = (11.015516146996184 - 28.69894364604659) / 11.015516146996184 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.InequalityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.60089875526112 > 13.031251305291708.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -105.89116134046662 (T) = (0 -32.60145955190308) / Math.Sqrt((0.7327216275275273 / (21)) + (0.011375190211246586 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5888993811038654 = (12.592787417640904 - 32.60145955190308) / 12.592787417640904 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.7953409051382 > 20.741167966485534.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -94.74558319400259 (T) = (0 -67.76781582183362) / Math.Sqrt((0.02184582434547946 / (21)) + (3.601099490982375 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.454258367916724 = (19.61862970392242 - 67.76781582183362) / 19.61862970392242 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.EqualsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.81419397805787 > 10.947100961452474.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -173.33960038657753 (T) = (0 -40.75248728097025) / Math.Sqrt((0.5555768214586915 / (21)) + (0.04596829335700066 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.752590189809599 = (10.859828870105844 - 40.75248728097025) / 10.859828870105844 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.LengthSquaredBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.208152825612764 > 7.884652600309388.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -42.00936161276711 (T) = (0 -17.09862263080758) / Math.Sqrt((0.8127040109397431 / (21)) + (0.16737041235576644 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.236957590084532 = (7.643695484705833 - 17.09862263080758) / 7.643695484705833 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 108.55264646103672 > 46.294849715174706.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -13.043589642319393 (T) = (0 -108.33355983991201) / Math.Sqrt((0.4551920611551806 / (21)) + (337.03236038741244 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4451004104400698 = (44.30638487374599 - 108.33355983991201) / 44.30638487374599 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.LerpBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.53787638123187 > 20.704715477346646.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -69.71074316621518 (T) = (0 -67.52535519847504) / Math.Sqrt((0.8628993505437184 / (21)) + (5.999607523018659 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.418538439475948 = (19.752697357068914 - 67.52535519847504) / 19.752697357068914 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.LengthBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.713713991997608 > 9.48093852819128.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -70.90039070458306 (T) = (0 -26.49996243358057) / Math.Sqrt((0.44370319268117137 / (21)) + (0.5736536490404608 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.0007512490064636 = (8.831109357150014 - 26.49996243358057) / 8.831109357150014 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 150.63526244681492 > 18.752676586970193.
IsChangePoint: Marked as a change because one of 1/6/2023 8:18:17 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -69.31490324046699 (T) = (0 -149.5231443505761) / Math.Sqrt((74.7538827567489 / (25)) + (3.9916949598688327 / (10))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (10) - 2, .025) and -5.823308884714299 = (21.913582819845747 - 149.5231443505761) / 21.913582819845747 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByQuaternionOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.37320236108626 > 14.767302932818154.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -248.0913400304947 (T) = (0 -58.029394849324426) / Math.Sqrt((0.04286803230681697 / (21)) + (0.4136667041424964 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.1641653358461643 = (13.935420467048475 - 58.029394849324426) / 13.935420467048475 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.InverseBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.74260049667605 > 13.85205757863437.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -158.5506489942288 (T) = (0 -43.52428861857539) / Math.Sqrt((0.6711531913548964 / (21)) + (0.09971574086845408 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.573407196259577 = (12.180052881780151 - 43.52428861857539) / 12.180052881780151 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.ConjugateBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.326924274609848 > 10.06389845124768.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -116.79789270736184 (T) = (0 -31.132362418774193) / Math.Sqrt((0.08080555495064556 / (21)) + (0.4300561320802015 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.3058624092072533 = (9.417319466190289 - 31.132362418774193) / 9.417319466190289 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.IsIdentityBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.46609877473791 > 9.568442574002416.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -123.20025122986081 (T) = (0 -32.29446406373671) / Math.Sqrt((0.5658647711987393 / (21)) + (0.09934293068125498 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.376853323235537 = (9.563478473146628 - 32.29446406373671) / 9.563478473146628 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.SubtractionOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.31365810549268 > 11.690445102947429.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -228.94916157473764 (T) = (0 -44.43297194828608) / Math.Sqrt((0.10032934095633046 / (21)) + (0.23068834410484812 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.019628126195167 = (11.054000657106732 - 44.43297194828608) / 11.054000657106732 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.51833811136271 > 23.337232341515353.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -50.52069633328181 (T) = (0 -57.723843246508075) / Math.Sqrt((0.008403870535030191 / (21)) + (6.921195074623605 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6016267276619636 = (22.18759618078781 - 57.723843246508075) / 22.18759618078781 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.NormalizeBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.087258210171086 > 15.627032060172306.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -112.64913853618852 (T) = (0 -54.3843476426419) / Math.Sqrt((0.3123829418285027 / (21)) + (1.4771878107621366 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.554909707948527 = (15.29837664260286 - 54.3843476426419) / 15.29837664260286 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.NegationOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.32213051327411 > 8.407546628420407.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -136.10040026266066 (T) = (0 -31.920321286432323) / Math.Sqrt((0.13208904372128105 / (21)) + (0.34795936945424444 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.0396744176989627 = (7.901706421334431 - 31.920321286432323) / 7.901706421334431 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.NegateBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.35647363965568 > 7.9605820912588765.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -105.6423253110799 (T) = (0 -31.747282594505418) / Math.Sqrt((0.17108108751544832 / (21)) + (0.5939905272020026 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9735803629564086 = (7.989591173358055 - 31.747282594505418) / 7.989591173358055 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.63113605680575 > 9.339497879098314.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -239.958129456484 (T) = (0 -33.088767399193706) / Math.Sqrt((0.045855327847583345 / (21)) + (0.11367754588122041 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.789523167667965 = (8.731644044692887 - 33.088767399193706) / 8.731644044692887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.DotBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.106548944215284 > 10.821387236914456.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -142.9419544976133 (T) = (0 -28.6391703319226) / Math.Sqrt((0.044931275816382746 / (21)) + (0.1968124239094437 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.7413855546266572 = (10.44696915528283 - 28.6391703319226) / 10.44696915528283 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Quaternion.MultiplyByScalarBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.494823563270494 > 9.066386641755285.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -171.9304080648884 (T) = (0 -34.58834261665876) / Math.Sqrt((0.008480979896062852 / (21)) + (0.31340212603215084 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.006400083841235 = (8.633272237628432 - 34.58834261665876) / 8.633272237628432 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Numerics.Tests.Perf_Plane

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
TransformByMatrix4x4Benchmark - Duration of single invocation	44.69 ns	244.20 ns	5.46	0.01	False
EqualsBenchmark - Duration of single invocation	6.27 ns	24.76 ns	3.95	0.15	False
DotBenchmark - Duration of single invocation	1.19 ns	21.13 ns	17.73	0.06	False
NormalizeBenchmark - Duration of single invocation	2.49 ns	33.58 ns	13.51	0.34	False
InequalityOperatorBenchmark - Duration of single invocation	0.95 ns	9.87 ns	10.40	0.55	False
TransformByQuaternionBenchmark - Duration of single invocation	7.39 ns	66.30 ns	8.97	0.03	False
CreateFromVector4Benchmark - Duration of single invocation	3.64 ns	34.63 ns	9.51	0.44	False
DotNormalBenchmark - Duration of single invocation	1.22 ns	18.02 ns	14.73	0.07	False
CreateFromScalarXYZDBenchmark - Duration of single invocation	0.46 ns	18.05 ns	39.37	0.35	False
EqualityOperatorBenchmark - Duration of single invocation	0.97 ns	11.10 ns	11.48	0.33	False
DotCoordinateBenchmark - Duration of single invocation	1.19 ns	19.54 ns	16.36	0.03	False
CreateFromVector3WithScalarDBenchmark - Duration of single invocation	0.46 ns	16.48 ns	36.12	0.19	False
CreateFromVerticesBenchmark - Duration of single invocation	0.40 ns	74.59 ns	185.86	0.38	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Plane*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Plane.TransformByMatrix4x4Benchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 244.19816315222383 > 46.8662721641674.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -18.389848474885344 (T) = (0 -226.47948487831403) / Math.Sqrt((0.049187203470342535 / (21)) + (1368.519985486274 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.071406349256882 = (44.65812228032177 - 226.47948487831403) / 44.65812228032177 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.EqualsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.762234805612543 > 6.572366371559983.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -137.80589566707152 (T) = (0 -24.81990387149339) / Math.Sqrt((0.001564024461068732 / (21)) + (0.2525863000736524 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.9574810157910676 = (6.2716419289081795 - 24.81990387149339) / 6.2716419289081795 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.DotBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.128914611943255 > 1.2239672335637286.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -243.48612769188875 (T) = (0 -21.38333533215564) / Math.Sqrt((0.0007772474005402152 / (21)) + (0.09600866640353968 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -17.346608607740578 = (1.1655197856640296 - 21.38333533215564) / 1.1655197856640296 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.NormalizeBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.58370442042052 > 2.8836811111906786.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -159.97596950227984 (T) = (0 -33.77351692754163) / Math.Sqrt((0.01068959243849271 / (21)) + (0.5220229045992609 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -11.639204647984705 = (2.6721235922805273 - 33.77351692754163) / 2.6721235922805273 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.InequalityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.868618487802525 > 0.9227609314308913.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -128.20088733376534 (T) = (0 -10.751904264929177) / Math.Sqrt((0.006226945418336706 / (21)) + (0.07864825313853431 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -11.043988320155922 = (0.8927195858315132 - 10.751904264929177) / 0.8927195858315132 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.TransformByQuaternionBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.29853340206121 > 7.756757297196992.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -119.33244697585077 (T) = (0 -70.16927058336833) / Math.Sqrt((0.012158829060122 / (21)) + (3.873843495206103 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.570682958042381 = (7.331688960023913 - 70.16927058336833) / 7.331688960023913 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.CreateFromVector4Benchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.62979463366724 > 3.8926444483996683.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -71.54988267610084 (T) = (0 -36.562640463719376) / Math.Sqrt((0.09875722678625859 / (21)) + (2.834419490652757 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -8.14813417371603 = (3.9967319859353787 - 36.562640463719376) / 3.9967319859353787 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.DotNormalBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.021966947642703 > 1.235210883554895.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -121.45129145114447 (T) = (0 -18.473272077879972) / Math.Sqrt((0.0005618294784443068 / (21)) + (0.2832075764687261 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -14.550584786074102 = (1.1879470985826335 - 18.473272077879972) / 1.1879470985826335 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.CreateFromScalarXYZDBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.051699895917658 > 0.4941058108336852.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -82.82913340908155 (T) = (0 -17.35567720892302) / Math.Sqrt((0.0004616221942546615 / (21)) + (0.5815647206356686 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -35.971386561648295 = (0.4694353883640022 - 17.35567720892302) / 0.4694353883640022 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.EqualityOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.095769622589595 > 0.9914158513090038.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -126.23151210356184 (T) = (0 -11.132769134597073) / Math.Sqrt((0.0004314303930883829 / (21)) + (0.09078308949773249 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -10.697696821523763 = (0.9517060755167441 - 11.132769134597073) / 0.9517060755167441 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.DotCoordinateBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.53992644836372 > 1.2542783020849115.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -203.681096019346 (T) = (0 -19.39114474794534) / Math.Sqrt((3.058525758556831E-05 / (21)) + (0.11166759482616556 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -15.176172662355684 = (1.1987473893049723 - 19.39114474794534) / 1.1987473893049723 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.CreateFromVector3WithScalarDBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.48423728200613 > 0.4985967968342967.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -262.9339648885365 (T) = (0 -16.643049488562518) / Math.Sqrt((0.000155051062259893 / (21)) + (0.052832719633539985 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -34.04063657097601 = (0.47496424486614136 - 16.643049488562518) / 0.47496424486614136 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Plane.CreateFromVerticesBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.59160619506268 > 0.4169610051865259.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -354.1871822007054 (T) = (0 -75.37643994288439) / Math.Sqrt((0.0003444975225249978 / (21)) + (0.6269993001864158 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -184.0124635203136 = (0.40741276835443235 - 75.37643994288439) / 0.40741276835443235 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Json.Tests.Perf_Base64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
WriteByteArrayAsBase64_NoEscaping - Duration of single invocation	1.78 μs	3.37 μs	1.90	0.01	False
WriteByteArrayAsBase64_HeavyEscaping - Duration of single invocation	274.43 ns	540.38 ns	1.97	0.06	False
WriteByteArrayAsBase64_NoEscaping - Duration of single invocation	274.00 ns	548.29 ns	2.00	0.06	False
WriteByteArrayAsBase64_HeavyEscaping - Duration of single invocation	1.78 μs	3.31 μs	1.86	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Base64*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes: 1000)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.372566243217863 > 1.881761435826882.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -82.80112427394452 (T) = (0 -3266.6796752015084) / Math.Sqrt((311.2003232114264 / (21)) + (4194.223502281004 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8163450564295384 = (1798.490690762773 - 3266.6796752015084) / 1798.490690762773 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_HeavyEscaping(NumberOfBytes: 100)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 540.3757538153585 > 288.3182760434912.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -128.9255537635996 (T) = (0 -540.0474229946029) / Math.Sqrt((24.246776181452088 / (21)) + (42.83718004056688 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.9611282333272911 = (275.3758850732301 - 540.0474229946029) / 275.3758850732301 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_NoEscaping(NumberOfBytes: 100)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 548.2939781373822 > 288.2192047325472.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -114.5086749487679 (T) = (0 -540.5160022589188) / Math.Sqrt((2.350101228635738 / (21)) + (74.23954567223748 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.972260686837648 = (274.05910682405283 - 540.5160022589188) / 274.05910682405283 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Base64.WriteByteArrayAsBase64_HeavyEscaping(NumberOfBytes: 1000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.3099421769594546 > 1.8781247701014623.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -105.1221252558909 (T) = (0 -3273.7334128404805) / Math.Sqrt((213.30541493589953 / (21)) + (2640.1965291040688 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8271031093914816 = (1791.7617216090232 - 3273.7334128404805) / 1791.7617216090232 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
InterfaceInterfaceMethodSwitchCallType - Duration of single invocation	668.73 μs	868.86 μs	1.30	0.01	False
InstanceDelegate - Duration of single invocation	334.44 μs	434.36 μs	1.30	0.03	False
EmptyStaticFunction5Arg - Duration of single invocation	2.23 ms	2.92 ms	1.31	0.00	False
TypeReflectionObjectGetType - Duration of single invocation	1.02 ns	167.82 μs	164795.01	0.75	False
StaticIntPlus - Duration of single invocation	66.93 μs	194.82 μs	2.91	0.00	False
IntegerFormatting - Duration of single invocation	3.16 ms	11.73 ms	3.71	0.09	False
TypeReflectionArrayGetType - Duration of single invocation	0.81 ns	169.77 μs	209487.15	0.76	False
GenericClassWithIntGenericInstanceField - Duration of single invocation	88.48 μs	167.08 μs	1.89	0.08	False
GenericClassGenericStaticField - Duration of single invocation	66.88 μs	156.01 μs	2.33	0.00	False
SealedClassInterfaceMethod - Duration of single invocation	165.20 μs	280.67 μs	1.70	0.00	False
StructWithInterfaceInterfaceMethod - Duration of single invocation	152.96 μs	264.39 μs	1.73	0.00	False
ClassVirtualMethod - Duration of single invocation	167.26 μs	280.61 μs	1.68	0.00	False
NewDelegateClassEmptyInstanceFn - Duration of single invocation	2.49 ms	2.75 ms	1.11	0.18	False
InterfaceInterfaceMethod - Duration of single invocation	2.87 ms	4.00 ms	1.39	0.05	False
EmptyInstanceFunction - Duration of single invocation	1.70 ms	2.40 ms	1.41	0.01	False
ObjectStringIsString - Duration of single invocation	100.21 μs	278.47 μs	2.78	0.00	False
GenericClassWithSTringGenericInstanceMethod - Duration of single invocation	534.61 μs	640.25 μs	1.20	0.01	False
StaticDelegate - Duration of single invocation	334.12 μs	434.12 μs	1.30	0.00	False
InterfaceInterfaceMethodLongHierarchy - Duration of single invocation	271.29 μs	441.11 μs	1.63	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'

Payloads

Baseline
Compare

Histogram

PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodSwitchCallType

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 868.8632960069446 > 701.5380177864583.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -40.37856899009404 (T) = (0 -854138.0277469156) / Math.Sqrt((96272.17275576707 / (21)) + (297042381.063743 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2784102450314801 = (668125.1429785616 - 854138.0277469156) / 668125.1429785616 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.InstanceDelegate

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 434.35539513888887 > 350.8876668972485.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -14.806139906875693 (T) = (0 -411003.3052524856) / Math.Sqrt((31680.552225992164 / (21)) + (376797450.78476644 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.22985410273896417 = (334188.6686698486 - 411003.3052524856) / 334188.6686698486 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.EmptyStaticFunction5Arg

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.9231864159722223 > 2.382304240178571.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -106.87984455010972 (T) = (0 -2919559.4790072283) / Math.Sqrt((754570864.3393707 / (21)) + (1609414.082757243 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.28170998385534085 = (2277862.7893849206 - 2919559.4790072283) / 2277862.7893849206 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.TypeReflectionObjectGetType

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 167.82239206560283 > 0.9028476984880268.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -856.7586170466601 (T) = (0 -168500.3895843018) / Math.Sqrt((0.07748377953671302 / (21)) + (541512.4819112854 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -198351.8952309743 = (0.8494980090312753 - 168500.3895843018) / 0.8494980090312753 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.StaticIntPlus

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 194.8203766075103 > 70.281697210203.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -232.73538476864942 (T) = (0 -193546.44708850048) / Math.Sqrt((3259.1706801059463 / (21)) + (4139931.746725456 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.890751874455124 = (66953.67001188296 - 193546.44708850048) / 66953.67001188296 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.IntegerFormatting

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.725815870833333 > 3.30986217121875.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -499.1804976137986 (T) = (0 -11769046.07171638) / Math.Sqrt((2564358909.114072 / (21)) + (2434537268.117448 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.7001361708638374 = (3180706.203298666 - 11769046.07171638) / 3180706.203298666 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.TypeReflectionArrayGetType

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 169.76723642473118 > 0.7597538266845423.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -704.3711312087335 (T) = (0 -168822.83811913122) / Math.Sqrt((0.021428259566498922 / (21)) + (804236.2859756763 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -237187.59447526012 = (0.7117662571112382 - 168822.83811913122) / 0.7117662571112382 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.GenericClassWithIntGenericInstanceField

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 167.07912801418442 > 92.87674924014016.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -773.2830093122781 (T) = (0 -167024.1810496273) / Math.Sqrt((211163.23125229115 / (21)) + (2859.4946020795733 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8830567706744721 = (88698.43100365088 - 167024.1810496273) / 88698.43100365088 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.GenericClassGenericStaticField

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 156.00673927283654 > 70.20411369439898.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -152.0218402248669 (T) = (0 -152801.3076426372) / Math.Sqrt((211575.44792593067 / (21)) + (4326214.283329337 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.2831011014860463 = (66927.08769803512 - 152801.3076426372) / 66927.08769803512 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.SealedClassInterfaceMethod

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 280.6736625478316 > 173.45819984868422.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -209.84038329074886 (T) = (0 -282060.4014084889) / Math.Sqrt((3167056.413468118 / (21)) + (2311399.7729171924 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7186504508388971 = (164117.3755086797 - 282060.4014084889) / 164117.3755086797 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.StructWithInterfaceInterfaceMethod

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 264.39196412429385 > 160.79253540071883.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -627.5237852455841 (T) = (0 -264575.68469841155) / Math.Sqrt((180820.35795487041 / (21)) + (318560.1914627793 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7242879686725594 = (153440.54444809168 - 264575.68469841155) / 153440.54444809168 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.ClassVirtualMethod

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 280.6119188988095 > 175.58193350897608.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -354.79852630185013 (T) = (0 -282023.63622594986) / Math.Sqrt((27833.47277612602 / (21)) + (1446415.0569068182 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6862136492680988 = (167252.61140446956 - 282023.63622594986) / 167252.61140446956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.NewDelegateClassEmptyInstanceFn

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.7538390229166674 > 2.6077168647321427.
IsChangePoint: Marked as a change because one of 10/26/2022 2:40:44 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -12.048879790220125 (T) = (0 -2744230.4536334327) / Math.Sqrt((6114570690.436267 / (21)) + (489333537.2400414 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.08611789268860415 = (2526641.4190454907 - 2744230.4536334327) / 2526641.4190454907 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.InterfaceInterfaceMethod

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.9965563989583335 > 2.9888455398958333.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -49.710375727383344 (T) = (0 -4000318.898289099) / Math.Sqrt((11117870243.959343 / (21)) + (33505497.066173688 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.40168214379023454 = (2853941.5416051396 - 4000318.898289099) / 2853941.5416051396 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.EmptyInstanceFunction

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.402345665816326 > 1.7874026721814904.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -13.283340700499663 (T) = (0 -2460713.904958348) / Math.Sqrt((1651419.9644169894 / (21)) + (45690148410.43571 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.44589921722759196 = (1701857.1388928408 - 2460713.904958348) / 1701857.1388928408 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.ObjectStringIsString

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 278.4734795797414 > 105.23544961981209.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -152.44930279133456 (T) = (0 -275046.77103192743) / Math.Sqrt((492.1137371215224 / (21)) + (18408334.186393224 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.744039837586107 = (100234.24852092606 - 275046.77103192743) / 100234.24852092606 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.GenericClassWithSTringGenericInstanceMethod

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 640.25143125 > 561.3202002343751.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -55.63928349906932 (T) = (0 -628642.0725554193) / Math.Sqrt((37360.701273782586 / (21)) + (40005708.1605221 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.17600231345295064 = (534558.5339110559 - 628642.0725554193) / 534558.5339110559 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.StaticDelegate

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 434.1159319444444 > 350.88741401007576.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -245.57927303212972 (T) = (0 -434227.3828408219) / Math.Sqrt((3397198.4767750264 / (21)) + (20147.773503506833 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.29614297715655785 = (335015.033444395 - 434227.3828408219) / 335015.033444395 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodLongHierarchy

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 441.1074070601853 > 287.15114686833596.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -345.7047675050651 (T) = (0 -441308.97038113594) / Math.Sqrt((2465158.301699715 / (21)) + (1657475.5398493265 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6138879443595429 = (273444.6167241589 - 441308.97038113594) / 273444.6167241589 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
SortedList - Duration of single invocation	890.37 μs	1.06 ms	1.19	0.35	False
Dictionary - Duration of single invocation	24.30 μs	31.60 μs	1.30	0.12	False
IDictionary - Duration of single invocation	26.97 μs	35.02 μs	1.30	0.04	False
ConcurrentDictionary - Duration of single invocation	24.57 μs	61.62 μs	2.51	0.08	False
ImmutableDictionary - Duration of single invocation	63.09 μs	108.14 μs	1.71	0.25	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;String, String&gt;*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsKeyFalse<String, String>.SortedList(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0615195644444446 > 932.6805990104167.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.417898086415432 (T) = (0 -1031563.4195915982) / Math.Sqrt((1739684655.1621823 / (21)) + (448068996.23712444 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1345816735318479 = (909201.5530097861 - 1031563.4195915982) / 909201.5530097861 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyFalse&lt;String, String&gt;.Dictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.595301605148876 > 24.37886866546698.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -53.273925524800575 (T) = (0 -31989.84657510572) / Math.Sqrt((240245.76006508153 / (21)) + (232518.86568740953 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3867836708825878 = (23067.654492027938 - 31989.84657510572) / 23067.654492027938 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyFalse&lt;String, String&gt;.IDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.02268254857998 > 28.354696542550766.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -47.3080068836662 (T) = (0 -34974.205035709405) / Math.Sqrt((260245.8064518897 / (21)) + (208368.97528983094 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2876600927145197 = (27161.053785537602 - 34974.205035709405) / 27161.053785537602 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyFalse&lt;String, String&gt;.ConcurrentDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 61.61607608267717 > 26.17823929463019.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -103.3453971066171 (T) = (0 -62624.663323635) / Math.Sqrt((165772.00241504854 / (21)) + (1749032.4466807342 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5089715041424736 = (24960.292781419656 - 62624.663323635) / 24960.292781419656 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsKeyFalse&lt;String, String&gt;.ImmutableDictionary(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 108.14183614942529 > 66.95843476137848.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -78.66210166134671 (T) = (0 -106003.60770201588) / Math.Sqrt((3241857.0291215777 / (21)) + (1724613.762688701 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6419080674632703 = (64561.23202183316 - 106003.60770201588) / 64561.23202183316 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Tests.Perf_Byte

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Parse - Duration of single invocation	25.37 ns	35.27 ns	1.39	0.54	False
TryParse - Duration of single invocation	25.42 ns	32.76 ns	1.29	0.44	False
Parse - Duration of single invocation	25.74 ns	41.02 ns	1.59	0.49	False
TryParse - Duration of single invocation	27.21 ns	42.92 ns	1.58	0.52	False
ToString - Duration of single invocation	4.96 ns	7.49 ns	1.51	0.37	False
ToString - Duration of single invocation	22.74 ns	61.45 ns	2.70	0.24	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Byte*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Byte.Parse(value: "0")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.27178162899414 > 26.187589387949732.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.362019795907994 (T) = (0 -34.67794567519219) / Math.Sqrt((0.5903899015239269 / (21)) + (1.335979042820811 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.42369712531050985 = (24.357670644048603 - 34.67794567519219) / 24.357670644048603 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Byte.TryParse(value: "0")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.76126284674102 > 27.170508011095187.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.167461037356176 (T) = (0 -33.408220368837604) / Math.Sqrt((0.3906441837935185 / (21)) + (0.39891105462205323 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2852602887406991 = (25.99334987745638 - 33.408220368837604) / 25.99334987745638 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Byte.Parse(value: "255")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.01543601629908 > 25.939916811279524.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -44.83541020042008 (T) = (0 -41.57489002149159) / Math.Sqrt((1.3418835583886897 / (21)) + (0.9177837452448845 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6340300110742293 = (25.443161838967573 - 41.57489002149159) / 25.443161838967573 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Byte.TryParse(value: "255")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.917862819422226 > 28.993403592707867.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -39.64156147992959 (T) = (0 -40.659485992262624) / Math.Sqrt((0.9654595432130707 / (21)) + (0.8253313295137866 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4615909899048309 = (27.81864849543859 - 40.659485992262624) / 27.81864849543859 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Byte.ToString(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.490953403856754 > 5.249175914905618.
IsChangePoint: Marked as a change because one of 12/1/2022 7:29:59 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.527871147306215 (T) = (0 -7.292144909814644) / Math.Sqrt((0.0778553517532784 / (21)) + (0.006763100999901974 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.44198414996836083 = (5.057021542140143 - 7.292144909814644) / 5.057021542140143 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Byte.ToString(value: 255)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 61.454377361249655 > 23.94544136988939.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -223.41665264039284 (T) = (0 -60.99996732127723) / Math.Sqrt((0.2691688992549051 / (21)) + (0.23229431790130056 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6889449464888524 = (22.685465316398258 - 60.99996732127723) / 22.685465316398258 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
TryParse - Duration of single invocation	23.43 ns	26.92 ns	1.15	0.44	False
ParseSpan - Duration of single invocation	32.74 ns	50.77 ns	1.55	0.31	False
TryFormat - Duration of single invocation	35.20 ns	233.67 ns	6.64	0.01	False
TryParse - Duration of single invocation	28.59 ns	41.39 ns	1.45	0.44	False
ParseSpan - Duration of single invocation	57.11 ns	97.17 ns	1.70	0.23	False
TryParseHex - Duration of single invocation	16.62 ns	24.20 ns	1.46	0.30	False
Parse - Duration of single invocation	56.91 ns	95.19 ns	1.67	0.21	False
ParseSpan - Duration of single invocation	25.13 ns	38.13 ns	1.52	0.29	False
ToString - Duration of single invocation	5.28 ns	10.17 ns	1.93	0.37	False
Parse - Duration of single invocation	29.71 ns	47.76 ns	1.61	0.47	False
TryParseHex - Duration of single invocation	51.36 ns	294.66 ns	5.74	0.16	False
TryFormat - Duration of single invocation	20.00 ns	103.26 ns	5.16	0.04	False
TryParse - Duration of single invocation	55.18 ns	90.44 ns	1.64	0.23	False
TryParseHex - Duration of single invocation	23.36 ns	89.15 ns	3.82	0.23	False
ToString - Duration of single invocation	45.36 ns	212.62 ns	4.69	0.07	False
TryFormat - Duration of single invocation	16.26 ns	54.15 ns	3.33	0.07	False
ToString - Duration of single invocation	25.60 ns	82.97 ns	3.24	0.25	False
Parse - Duration of single invocation	25.04 ns	34.05 ns	1.36	0.47	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_UInt64.TryParse(value: "0")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.917797993342656 > 24.43384152684456.
IsChangePoint: Marked as a change because one of 12/15/2022 2:06:03 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -11.257590313196925 (T) = (0 -26.899569930013314) / Math.Sqrt((0.07465628906417379 / (21)) + (1.4032455577772553 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.15583590493231433 = (23.2728277562796 - 26.899569930013314) / 23.2728277562796 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ParseSpan(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.76747795193975 > 33.31550065275854.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.15784836182364 (T) = (0 -50.49671913146718) / Math.Sqrt((5.232551763719901 / (21)) + (0.2039906983408563 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5323048730118926 = (32.954746813674895 - 50.49671913146718) / 32.954746813674895 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 233.67112018994385 > 36.98987102022594.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -272.3071294380918 (T) = (0 -233.02625234639277) / Math.Sqrt((0.007426902018745196 / (21)) + (7.382734267755335 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.617090270073431 = (35.215818862299855 - 233.02625234639277) / 35.215818862299855 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryParse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.39008419792455 > 30.01450911623865.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -44.26745171088511 (T) = (0 -41.74055053507549) / Math.Sqrt((0.7696140995214343 / (21)) + (0.6077699047807036 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.4287322413059066 = (29.21509666284517 - 41.74055053507549) / 29.21509666284517 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ParseSpan(value: "18446744073709551615")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 97.16659598426644 > 61.050817485324956.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -73.03073872575897 (T) = (0 -98.58782441392175) / Math.Sqrt((5.4398068583964925 / (21)) + (0.5741101873873136 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6828410999955135 = (58.584155339553206 - 98.58782441392175) / 58.584155339553206 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryParseHex(value: "0")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.19604557622588 > 17.453342469555704.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -76.93523240916649 (T) = (0 -23.69326535670016) / Math.Sqrt((0.0359415592443907 / (21)) + (0.08969863805675302 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.41358054746338163 = (16.761171055456906 - 23.69326535670016) / 16.761171055456906 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.Parse(value: "18446744073709551615")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 95.19196372272397 > 60.30423552537497.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -145.2926279941348 (T) = (0 -95.07583174455644) / Math.Sqrt((0.7985816238691457 / (21)) + (0.42796285729644723 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6673434525889252 = (57.02234389497248 - 95.07583174455644) / 57.02234389497248 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ParseSpan(value: "0")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.12747432825139 > 26.448447540293376.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -29.35998841280533 (T) = (0 -37.77121740657958) / Math.Sqrt((2.8080911761952887 / (21)) + (0.43057620626917525 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.46036923430902815 = (25.864155803344477 - 37.77121740657958) / 25.864155803344477 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ToString(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.174756440811281 > 5.576895244839066.
IsChangePoint: Marked as a change because one of 12/1/2022 8:17:56 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.454387758403843 (T) = (0 -9.607630716186017) / Math.Sqrt((0.012523002857177699 / (21)) + (0.3417877408447515 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.8245113893313119 = (5.265865026859185 - 9.607630716186017) / 5.265865026859185 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.Parse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.76324248931704 > 32.14047504278686.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -50.010766386417174 (T) = (0 -47.29059733754371) / Math.Sqrt((1.227599843866931 / (21)) + (0.7188919602664373 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5394829793653817 = (30.718493137896353 - 47.29059733754371) / 30.718493137896353 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryParseHex(value: "FFFFFFFFFFFFFFFF")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 294.6596910866675 > 54.00814609387764.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -401.1102639241517 (T) = (0 -295.1745916436357) / Math.Sqrt((1.2768588732345143 / (21)) + (4.297270746103921 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.683923323004626 = (51.931487261443394 - 295.1745916436357) / 51.931487261443394 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 103.26479236833114 > 20.521601041869218.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -236.09194567174765 (T) = (0 -103.50681997753536) / Math.Sqrt((1.7110094567911383 / (21)) + (0.6226585853002864 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.249257759199283 = (19.718372525361413 - 103.50681997753536) / 19.718372525361413 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryParse(value: "18446744073709551615")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 90.43873849875106 > 57.39626998385488.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -103.68082452733647 (T) = (0 -89.7098483582853) / Math.Sqrt((0.6755093839621311 / (21)) + (1.1326671804454063 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6356691873830802 = (54.84596093774486 - 89.7098483582853) / 54.84596093774486 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryParseHex(value: "3039")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 89.1515155460342 > 24.524050418762016.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -222.78079789974012 (T) = (0 -89.48713068118299) / Math.Sqrt((1.7755185183873057 / (21)) + (0.03889038535405898 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.78331637352571 = (23.65309211446915 - 89.48713068118299) / 23.65309211446915 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ToString(value: 18446744073709551615)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 212.61722449892923 > 47.51571723221657.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -455.63989592548506 (T) = (0 -213.70247945529243) / Math.Sqrt((0.13915037123852386 / (21)) + (1.8167169842112438 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.7041003187887647 = (45.42898003295933 - 213.70247945529243) / 45.42898003295933 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.145379049457695 > 17.106764442151785.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -121.82372301432885 (T) = (0 -54.60735794736844) / Math.Sqrt((0.030774109725426373 / (21)) + (1.359640999295953 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.338409205911459 = (16.357299114402434 - 54.60735794736844) / 16.357299114402434 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ToString(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 82.9732122551373 > 26.28270951371635.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -251.8601740746952 (T) = (0 -83.42946760617447) / Math.Sqrt((0.6658639349796047 / (21)) + (0.30241268900753626 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.3004409866842623 = (25.278278855090395 - 83.42946760617447) / 25.278278855090395 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.Parse(value: "0")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.04632369740117 > 25.130898559393536.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -39.81420344229125 (T) = (0 -33.74019475735969) / Math.Sqrt((0.6830217342797454 / (21)) + (0.40376128181130466 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.41305738096064315 = (23.877441363649357 - 33.74019475735969) / 23.877441363649357 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in BenchmarksGame.PiDigits_3

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
RunBench - Duration of single invocation	1.37 secs	2.29 secs	1.68	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'BenchmarksGame.PiDigits_3*'

Payloads

Baseline
Compare

Histogram

BenchmarksGame.PiDigits_3.RunBench(n: 3000, expected: "8649423196\t:3000")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.294877276071429 > 1.44940142963.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -113.57805171842388 (T) = (0 -2310008934.4232078) / Math.Sqrt((1309199814816878.5 / (21)) + (111359371935810.67 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7013727785397333 = (1357732393.253558 - 2310008934.4232078) / 1357732393.253558 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.IO.Tests.BinaryWriterExtendedTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
WriteAsciiCharArray - Duration of single invocation	1.18 ms	4.61 ms	3.92	0.01	False
WriteAsciiCharArray - Duration of single invocation	4.77 μs	17.87 μs	3.75	0.01	False
WriteAsciiCharArray - Duration of single invocation	99.14 ns	213.23 ns	2.15	0.01	False
WriteAsciiString - Duration of single invocation	44.20 ns	154.85 ns	3.50	0.05	False
WriteAsciiString - Duration of single invocation	1.69 ms	10.12 ms	5.97	0.01	False
WriteAsciiString - Duration of single invocation	4.78 μs	17.86 μs	3.74	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryWriterExtendedTests*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 2000000)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.606008405133928 > 1.2348629545312504.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2291.122778609161 (T) = (0 -4613898.283648531) / Math.Sqrt((590229.8424903636 / (21)) + (31117026.824176792 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.921246706150875 = (1176640.6526809856 - 4613898.283648531) / 1176640.6526809856 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 8000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.873228062841047 > 5.004294483410139.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -3719.726523445555 (T) = (0 -17863.660331940937) / Math.Sqrt((11.685851421603523 / (21)) + (165.78258989665872 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.748016058661333 = (4766.164299285645 - 17863.660331940937) / 4766.164299285645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiCharArray(StringLengthInChars: 32)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 213.23350631874018 > 103.150759821564.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -215.11958381111353 (T) = (0 -213.80487122629413) / Math.Sqrt((0.4313359179255901 / (21)) + (3.7324025167551906 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1699009882358358 = (98.53208620367555 - 213.80487122629413) / 98.53208620367555 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 32)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 154.85169003240006 > 46.60156731901926.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -331.4798324233237 (T) = (0 -154.53265796496476) / Math.Sqrt((0.040800696576515486 / (21)) + (1.5173276156714985 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.4779801163204223 = (44.431725540873636 - 154.53265796496476) / 44.431725540873636 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 2000000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.120034367788461 > 1.7797892126328125.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -936.0919958433245 (T) = (0 -10112873.04662235) / Math.Sqrt((862944.7309195421 / (21)) + (1131576173.1978319 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.966597649811936 = (1694914.5292109821 - 10112873.04662235) / 1694914.5292109821 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 8000)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.861955321428574 > 5.01442129264502.
IsChangePoint: Marked as a change because one of 10/25/2022 1:30:53 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -2305.555738779214 (T) = (0 -17871.703337416424) / Math.Sqrt((24.86370839647364 / (21)) + (435.0829870818655 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.7416983012417364 = (4776.36140024583 - 17871.703337416424) / 4776.36140024583 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Text.Encodings.Web.Tests.Perf_Encoders

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
EncodeUtf16 - Duration of single invocation	691.01 ns	2.33 μs	3.38	0.00	False
EncodeUtf8 - Duration of single invocation	3.06 μs	7.90 μs	2.58	0.01	False
EncodeUtf8 - Duration of single invocation	3.07 μs	8.13 μs	2.65	0.01	False
EncodeUtf8 - Duration of single invocation	224.16 ns	769.78 ns	3.43	0.01	False
EncodeUtf8 - Duration of single invocation	250.09 ns	635.24 ns	2.54	0.01	False
EncodeUtf16 - Duration of single invocation	74.52 ns	209.01 ns	2.80	0.02	False
EncodeUtf16 - Duration of single invocation	640.15 ns	2.23 μs	3.48	0.01	False
EncodeUtf16 - Duration of single invocation	624.21 ns	2.19 μs	3.51	0.01	False
EncodeUtf16 - Duration of single invocation	60.32 ns	197.27 ns	3.27	0.39	False
EncodeUtf8 - Duration of single invocation	3.08 μs	8.07 μs	2.62	0.01	False
EncodeUtf16 - Duration of single invocation	624.01 ns	2.20 μs	3.53	0.00	False
EncodeUtf8 - Duration of single invocation	3.02 μs	7.91 μs	2.62	0.01	False
EncodeUtf8 - Duration of single invocation	3.02 μs	7.85 μs	2.60	0.01	False
EncodeUtf8 - Duration of single invocation	3.00 μs	7.82 μs	2.61	0.01	False
EncodeUtf8 - Duration of single invocation	181.66 ns	536.31 ns	2.95	0.00	False
EncodeUtf8 - Duration of single invocation	176.43 ns	573.37 ns	3.25	0.00	False
EncodeUtf8 - Duration of single invocation	226.94 ns	576.77 ns	2.54	0.00	False
EncodeUtf16 - Duration of single invocation	638.97 ns	2.22 μs	3.47	0.00	False
EncodeUtf8 - Duration of single invocation	162.55 ns	458.85 ns	2.82	0.01	False
EncodeUtf16 - Duration of single invocation	63.86 ns	184.61 ns	2.89	0.43	False
EncodeUtf16 - Duration of single invocation	716.50 ns	2.41 μs	3.36	0.00	False
EncodeUtf16 - Duration of single invocation	151.39 ns	387.86 ns	2.56	0.00	False
EncodeUtf16 - Duration of single invocation	70.91 ns	207.67 ns	2.93	0.02	False
EncodeUtf16 - Duration of single invocation	127.50 ns	312.47 ns	2.45	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'

Payloads

Baseline
Compare

Histogram

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.332905879869158 > 723.1264316733835.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1288.456195307477 (T) = (0 -2338.056135872267) / Math.Sqrt((2.112985759603674 / (21)) + (21.538555021753325 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.395935170269531 = (688.4866814718075 - 2338.056135872267) / 688.4866814718075 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.904707166793122 > 3.215193109277535.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -123.58970295645847 (T) = (0 -7925.8238111326955) / Math.Sqrt((2.781005371489231 / (21)) + (21676.04720309929 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5879644858757467 = (3062.5705470029507 - 7925.8238111326955) / 3062.5705470029507 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.125947412896515 > 3.2240517302671754.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1787.8258904802265 (T) = (0 -8116.156397709776) / Math.Sqrt((11.525774414061498 / (21)) + (103.79641322073422 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.642693969295627 = (3071.1677144641244 - 8116.156397709776) / 3071.1677144641244 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 769.7815552503051 > 236.3606195272798.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -442.7098498067954 (T) = (0 -771.8655274034173) / Math.Sqrt((9.15781779662618 / (21)) + (15.409324459262276 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.4604019997180404 = (223.05660656372012 - 771.8655274034173) / 223.05660656372012 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no &lt;escaping /&gt; required,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 635.2392858593654 > 263.0282188432792.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -886.8015690447636 (T) = (0 -632.4895422828835) / Math.Sqrt((0.5923334814985212 / (21)) + (2.200427393722371 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5231910155137118 = (250.6704955724928 - 632.4895422828835) / 250.6704955724928 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 209.01299106737494 > 76.81037106593614.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -630.118665251414 (T) = (0 -209.02880259066583) / Math.Sqrt((0.7552039253957019 / (21)) + (0.14380593920596538 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.842375338489785 = (73.54018301528303 - 209.02880259066583) / 73.54018301528303 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.228307600314151 > 667.4654366779198.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1428.3420994383323 (T) = (0 -2226.6528486832203) / Math.Sqrt((2.0317508152601644 / (21)) + (16.011801460411707 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.5019640367835048 = (635.8297302014454 - 2226.6528486832203) / 635.8297302014454 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.1881813519609223 > 653.4891228025435.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1192.3105532530199 (T) = (0 -2190.554407308948) / Math.Sqrt((3.875248481035176 / (21)) + (21.663341486014456 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.52493118596875 = (621.4460061032148 - 2190.554407308948) / 621.4460061032148 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no &lt;escaping /&gt; required,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 197.2655629266787 > 63.26055792109823.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -409.76060295059904 (T) = (0 -197.3479105040565) / Math.Sqrt((1.8399914016620997 / (21)) + (0.32666778860932844 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.2427154868470747 = (60.858842320434306 - 197.3479105040565) / 60.858842320434306 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no &lt;escaping /&gt; required,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.072343906118142 > 3.239995804675138.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -471.38895162401826 (T) = (0 -7966.00272826542) / Math.Sqrt((7.256227324175455 / (21)) + (1495.322082067824 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5809980577728926 = (3086.403999520702 - 7966.00272826542) / 3086.403999520702 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,no &lt;escaping /&gt; required,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.2016614971532094 > 654.2806147867312.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1270.5088722706228 (T) = (0 -2203.0671914030513) / Math.Sqrt((3.100485808946282 / (21)) + (19.586098776570925 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.5361834109486256 = (623.0070489505664 - 2203.0671914030513) / 623.0070489505664 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+&lt;World&gt;!,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.914077348638593 > 3.169710971180824.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1453.7092742548452 (T) = (0 -7918.4946820750865) / Math.Sqrt((4.570269116795432 / (21)) + (156.0055279566414 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6232035436859078 = (3018.635248924937 - 7918.4946820750865) / 3018.635248924937 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.847527753313203 > 3.1725331056579495.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1258.3534966646316 (T) = (0 -7850.360055742206) / Math.Sqrt((2.807730367435771 / (21)) + (204.3422559840515 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.598675045270137 = (3020.908701159343 - 7850.360055742206) / 3020.908701159343 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.822649787393696 > 3.1492924992247433.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -880.5635676919228 (T) = (0 -7800.780153121741) / Math.Sqrt((2.5273144589935628 / (21)) + (414.57524084905367 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.6009048688125258 = (2999.2562383426507 - 7800.780153121741) / 2999.2562383426507 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 536.3051800318824 > 190.88470364837866.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -465.96168863735136 (T) = (0 -535.8066259059335) / Math.Sqrt((0.5398957356118698 / (21)) + (7.734962358916956 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.9522681116616254 = (181.4898260051203 - 535.8066259059335) / 181.4898260051203 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+&lt;World&gt;!,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 573.3682715062756 > 185.10458567010014.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -353.021489426322 (T) = (0 -577.1300348893536) / Math.Sqrt((1.772942592215431 / (21)) + (16.936387683375628 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.287974932480834 = (175.52750454027915 - 577.1300348893536) / 175.52750454027915 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 576.7727302605257 > 238.27421701804795.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -506.47386663349755 (T) = (0 -576.0057105279902) / Math.Sqrt((0.7967279781312334 / (21)) + (6.100445548376625 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5327170547626383 = (227.42600064418662 - 576.0057105279902) / 227.42600064418662 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,�2020,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.2199651926994504 > 664.1061807253101.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -1798.095363892028 (T) = (0 -2222.514951436143) / Math.Sqrt((4.3900200035548815 / (21)) + (8.008551782407254 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.5090145046683117 = (633.3729736595162 - 2222.514951436143) / 633.3729736595162 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 458.8544709530283 > 169.9815978675051.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -351.9639718567947 (T) = (0 -460.21375948525423) / Math.Sqrt((1.0530406966129555 / (21)) + (9.370036721484038 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.846448013800437 = (161.68001567356907 - 460.21375948525423) / 161.68001567356907 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,no escaping required,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 184.61191944525837 > 67.06258069492392.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -303.1681836361031 (T) = (0 -184.13097130309623) / Math.Sqrt((3.3256510361443974 / (21)) + (0.06560500462894042 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.983657507247005 = (61.71317279408262 - 184.13097130309623) / 61.71317279408262 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.4076565135503447 > 749.3268200910384.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -478.2383617655101 (T) = (0 -2411.8002733883345) / Math.Sqrt((1.983631183557279 / (21)) + (175.20972109659849 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.3798275737675625 = (713.58677942847 - 2411.8002733883345) / 713.58677942847 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 387.864016045793 > 159.26672948699607.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -585.429614840545 (T) = (0 -387.29437700973847) / Math.Sqrt((0.845733613582491 / (21)) + (1.7016191162729777 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.5514061164359838 = (151.79644452320412 - 387.29437700973847) / 151.79644452320412 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,�2020,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 207.67079403417398 > 73.84772756786903.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -328.6249246542268 (T) = (0 -207.95641512433056) / Math.Sqrt((1.6575472802622557 / (21)) + (1.339646286569848 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.94421771489941 = (70.6321458742515 - 207.95641512433056) / 70.6321458742515 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+&lt;World&gt;!,16)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 312.4729709695565 > 133.11874237547224.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -286.8602824050417 (T) = (0 -315.1566439211421) / Math.Sqrt((0.6174148881953668 / (21)) + (5.621577663644039 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.4846031925876813 = (126.8438537233427 - 315.1566439211421) / 126.8438537233427 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in Microsoft.Extensions.Logging.LoggingOverhead

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
NoArguments_DefineMessage - Duration of single invocation	45.10 ns	50.31 ns	1.12	0.03	False
NoArguments_FilteredByLevel - Duration of single invocation	38.47 ns	48.24 ns	1.25	0.15	False
NoArguments - Duration of single invocation	48.84 ns	60.41 ns	1.24	0.00	False
TwoArguments - Duration of single invocation	170.02 ns	268.00 ns	1.58	0.08	False
TwoArguments_FilteredByLevel - Duration of single invocation	159.55 ns	259.31 ns	1.63	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Logging.LoggingOverhead*'

Payloads

Baseline
Compare

Histogram

Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.314856195771235 > 47.44071449361913.
IsChangePoint: Marked as a change because one of 11/5/2022 3:05:12 PM, 11/6/2022 4:58:03 PM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -34.42744487773388 (T) = (0 -50.210907313481506) / Math.Sqrt((0.39804776475580556 / (21)) + (0.013086442779425963 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.1070494933017392 = (45.35561202754278 - 50.210907313481506) / 45.35561202754278 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_FilteredByLevel

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.24467887624228 > 38.61620705623503.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -56.10572111927361 (T) = (0 -48.462327162621534) / Math.Sqrt((0.586827466141737 / (21)) + (0.16775555214125323 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.30095078797013336 = (37.25146839584689 - 48.462327162621534) / 37.25146839584689 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.Extensions.Logging.LoggingOverhead.NoArguments

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 60.4104716366867 > 51.44416939111547.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -101.49821330343029 (T) = (0 -60.588649938848334) / Math.Sqrt((0.16419085620875867 / (21)) + (0.07085216633623316 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.23474315298201281 = (49.069840794436836 - 60.588649938848334) / 49.069840794436836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 268.0034671186921 > 180.33850319628607.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -71.66354885354178 (T) = (0 -273.6752842734418) / Math.Sqrt((5.233453174602902 / (21)) + (24.518322440259244 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.588231063065834 = (172.31452692100987 - 273.6752842734418) / 172.31452692100987 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_FilteredByLevel

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 259.3086996805865 > 168.73269923049818.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -64.91437703636267 (T) = (0 -261.1518720681197) / Math.Sqrt((11.575828696644201 / (21)) + (25.99120975857871 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6278770011901524 = (160.42481826156995 - 261.1518720681197) / 160.42481826156995 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2023-01-11T05:24:39Z

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	524045bb01369c26a0dfc349c1c6a8e26a8a9833
Compare	75f9609c5bb962d86afae1952536813a95b4a6d7
Diff	Diff

Regressions in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
TryParseSpan - Duration of single invocation	32.21 ns	55.97 ns	1.74	0.31	False
ToStringHex - Duration of single invocation	43.10 ns	89.11 ns	2.07	0.05	False
ToString - Duration of single invocation	5.99 ns	11.34 ns	1.89	0.22	False
ToStringHex - Duration of single invocation	33.01 ns	68.25 ns	2.07	0.05	False
ToString - Duration of single invocation	46.59 ns	189.04 ns	4.06	0.30	False
TryParseSpan - Duration of single invocation	22.43 ns	32.84 ns	1.46	0.47	False
TryParse - Duration of single invocation	33.11 ns	56.82 ns	1.72	0.27	False
ParseSpan - Duration of single invocation	37.85 ns	66.16 ns	1.75	0.27	False
TryFormat - Duration of single invocation	15.14 ns	49.57 ns	3.27	0.06	False
TryParseSpan - Duration of single invocation	27.62 ns	41.20 ns	1.49	0.50	False
TryFormat - Duration of single invocation	19.22 ns	98.99 ns	5.15	0.19	False
ToString - Duration of single invocation	28.51 ns	75.60 ns	2.65	0.16	False
ParseHex - Duration of single invocation	29.89 ns	101.47 ns	3.39	0.41	False
Parse - Duration of single invocation	38.82 ns	63.64 ns	1.64	0.13	False
Parse - Duration of single invocation	25.58 ns	34.96 ns	1.37	0.43	False
ToString - Duration of single invocation	28.67 ns	123.37 ns	4.30	0.14	False
ParseHex - Duration of single invocation	40.73 ns	169.52 ns	4.16	0.27	False
ParseSpan - Duration of single invocation	40.05 ns	67.62 ns	1.69	0.24	False
ParseSpan - Duration of single invocation	28.51 ns	38.88 ns	1.36	0.32	False
ParseSpan - Duration of single invocation	32.21 ns	51.25 ns	1.59	0.26	False
TryFormat - Duration of single invocation	21.44 ns	141.45 ns	6.60	0.06	False
TryParseSpan - Duration of single invocation	32.93 ns	57.06 ns	1.73	0.30	False
TryParse - Duration of single invocation	26.33 ns	42.69 ns	1.62	0.48	False
ToStringHex - Duration of single invocation	43.18 ns	89.41 ns	2.07	0.05	False
ToStringHex - Duration of single invocation	37.28 ns	77.88 ns	2.09	0.04	False
ParseHex - Duration of single invocation	37.05 ns	170.39 ns	4.60	0.17	False
Parse - Duration of single invocation	30.01 ns	47.89 ns	1.60	0.32	False
ParseHex - Duration of single invocation	25.46 ns	49.74 ns	1.95	0.35	False
TryParse - Duration of single invocation	31.56 ns	59.64 ns	1.89	0.25	False
TryParse - Duration of single invocation	22.35 ns	27.97 ns	1.25	0.43	False
Parse - Duration of single invocation	38.85 ns	62.08 ns	1.60	0.13	False
TryFormat - Duration of single invocation	39.79 ns	207.74 ns	5.22	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Int32.TryParseSpan(value: "2147483647")

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.973756993730674 > 33.47963234688536.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -108.40177793512244 (T) = (0 -56.64912707424802) / Math.Sqrt((0.05110930726514644 / (21)) + (0.6851952971007235 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7659579994750452 = (32.07841131617385 - 56.64912707424802) / 32.07841131617385 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToStringHex(value: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 89.10677407710978 > 45.337000226446456.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -233.9078690996743 (T) = (0 -89.16834767656334) / Math.Sqrt((0.03518853465375604 / (21)) + (0.5181537613621431 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0659374336441803 = (43.16120431550346 - 89.16834767656334) / 43.16120431550346 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 11.341918223767925 > 6.26956997169638.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -22.000801499007352 (T) = (0 -10.2302528984924) / Math.Sqrt((0.014527434012252847 / (21)) + (0.5178500988944483 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.716617225147771 = (5.959542260571079 - 10.2302528984924) / 5.959542260571079 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToStringHex(value: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.25052108392933 > 34.08428737019341.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -264.80348965827096 (T) = (0 -68.12902131006477) / Math.Sqrt((0.22781394142736314 / (21)) + (0.10284717366431259 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.1020685330767455 = (32.41046628025301 - 68.12902131006477) / 32.41046628025301 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 189.03954878283122 > 47.65954304923539.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -200.24932796081058 (T) = (0 -189.21965057901622) / Math.Sqrt((3.23349811775696 / (21)) + (5.085921171990928 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.1863418083744492 = (45.19928358465549 - 189.21965057901622) / 45.19928358465549 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryParseSpan(value: "4")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.83881234817146 > 23.939779765331203.
IsChangePoint: Marked as a change because one of 12/15/2022 5:36:17 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -8.081099374857105 (T) = (0 -29.28352344642011) / Math.Sqrt((0.5295059962178947 / (21)) + (8.11960926031869 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.2733664344362749 = (22.996933682631628 - 29.28352344642011) / 22.996933682631628 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryParse(value: "-2147483648")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.82359419613919 > 35.13895871014159.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -69.11999614630588 (T) = (0 -57.636990860585556) / Math.Sqrt((0.5046503953297031 / (21)) + (1.4285674055656548 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7415689577149904 = (33.09486575610973 - 57.636990860585556) / 33.09486575610973 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseSpan(value: "2147483647")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.15707532391251 > 40.08811704660312.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -74.4721296603589 (T) = (0 -66.38172696717137) / Math.Sqrt((2.318021823710388 / (21)) + (0.36527865463711245 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7077876492919553 = (38.87001231956039 - 66.38172696717137) / 38.87001231956039 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.56639451153564 > 15.972564274662219.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -258.6040463101217 (T) = (0 -48.883119744748775) / Math.Sqrt((0.010782510684986294 / (21)) + (0.230106565236851 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.2127692055509667 = (15.215260299522722 - 48.883119744748775) / 15.215260299522722 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryParseSpan(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.202967183142285 > 28.17953527912421.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -53.87750109046907 (T) = (0 -41.81652912566553) / Math.Sqrt((0.24140168267358839 / (21)) + (0.930782269370585 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5619901761043629 = (26.77131377993481 - 41.81652912566553) / 26.77131377993481 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 98.98747570703817 > 19.256642781962245.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -362.0366452009563 (T) = (0 -98.31857330867331) / Math.Sqrt((0.15292380454583476 / (21)) + (0.5792958365589861 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.327022514823766 = (18.456571759379166 - 98.31857330867331) / 18.456571759379166 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 75.59937781818353 > 26.688375994010773.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -199.78814452513691 (T) = (0 -76.07449500630709) / Math.Sqrt((0.6766419730286719 / (21)) + (0.4559784354647726 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.0164000139173535 = (25.22029394487049 - 76.07449500630709) / 25.22029394487049 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseHex(value: "3039")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.47437314785091 > 31.485839802095555.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -189.00411096744295 (T) = (0 -102.22439742293908) / Math.Sqrt((2.0126622557747873 / (21)) + (0.6784204282058925 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -2.359573222260459 = (30.427792656996562 - 102.22439742293908) / 30.427792656996562 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.Parse(value: "-2147483648")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.642389738816476 > 38.60337163664338.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -119.3838881649288 (T) = (0 -63.72919378993544) / Math.Sqrt((0.32656306542975416 / (21)) + (0.49301717391212396 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.730342046617034 = (36.830402355725816 - 63.72919378993544) / 36.830402355725816 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.Parse(value: "4")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.958201566321364 > 27.421986411564244.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -37.00403721404146 (T) = (0 -35.65215260083952) / Math.Sqrt((0.5412594450629459 / (21)) + (0.5887652225865738 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3704551355906666 = (26.01482651635541 - 35.65215260083952) / 26.01482651635541 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: 2147483647)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 123.37040550886174 > 30.052748842142954.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -129.45773793792821 (T) = (0 -122.47519272134785) / Math.Sqrt((1.007245641411974 / (21)) + (6.6578012792736265 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.2516747857599047 = (28.80634076988976 - 122.47519272134785) / 28.80634076988976 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseHex(value: "80000000")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 169.5230399906648 > 40.724725949354514.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -355.7182458207511 (T) = (0 -170.01167689425935) / Math.Sqrt((2.378468671411094 / (21)) + (0.34473275312726886 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.482995589148017 = (37.92367703992537 - 170.01167689425935) / 37.92367703992537 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseSpan(value: "-2147483648")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.62302376930715 > 41.43418790739643.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -90.31076404905654 (T) = (0 -67.79060593151664) / Math.Sqrt((1.7095360028994597 / (21)) + (0.18945763753753891 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6962972011848025 = (39.963873007729624 - 67.79060593151664) / 39.963873007729624 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseSpan(value: "4")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.87547490158954 > 29.41834197996317.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -19.9627248113651 (T) = (0 -39.50836034130507) / Math.Sqrt((5.470683618680644 / (21)) + (0.20946038748623058 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.3609084344980893 = (29.030873304768647 - 39.50836034130507) / 29.030873304768647 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseSpan(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.25042441330685 > 33.77720028430248.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -39.13091654265639 (T) = (0 -51.560430994123166) / Math.Sqrt((4.364782847827824 / (21)) + (0.1381632577004334 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.5482709339431681 = (33.30194338971927 - 51.560430994123166) / 33.30194338971927 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: 2147483647)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 141.44903115020833 > 22.514357009030928.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -257.9807835540555 (T) = (0 -141.8019359158896) / Math.Sqrt((0.4269371051880377 / (21)) + (2.753968630743621 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -5.560547642021845 = (21.614344358634785 - 141.8019359158896) / 21.614344358634785 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryParseSpan(value: "-2147483648")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.06071217837106 > 34.56651744118947.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -84.53469887719251 (T) = (0 -58.07724820007638) / Math.Sqrt((0.02417161266823105 / (21)) + (1.2208945261727862 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7626258276803749 = (32.949277883046996 - 58.07724820007638) / 32.949277883046996 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryParse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.68968038333599 > 27.639907496393658.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -47.353612733765786 (T) = (0 -41.80461027875128) / Math.Sqrt((1.012602577716879 / (21)) + (0.9315290925172955 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.6226484255418216 = (25.763196525330013 - 41.80461027875128) / 25.763196525330013 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToStringHex(value: 2147483647)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 89.41378033472384 > 45.29510987257873.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -332.14191523161577 (T) = (0 -89.06169882901054) / Math.Sqrt((0.1561077475906196 / (21)) + (0.1640283971706695 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0664585664529793 = (43.0987101676481 - 89.06169882901054) / 43.0987101676481 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToStringHex(value: 12345)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 77.87986047538404 > 38.37780511907036.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -219.98897762756062 (T) = (0 -77.44895941659665) / Math.Sqrt((0.17170940073031696 / (21)) + (0.3729968327846376 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.127766148321802 = (36.39918770099886 - 77.44895941659665) / 36.39918770099886 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseHex(value: "7FFFFFFF")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 170.38840967908902 > 38.92318158939826.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -442.8313918983789 (T) = (0 -170.4704863172304) / Math.Sqrt((1.0961930833515012 / (21)) + (0.534160791419147 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -3.562909001534566 = (37.360045150998836 - 170.4704863172304) / 37.360045150998836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.Parse(value: "12345")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.88649105348205 > 32.55187383248547.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -64.25778194609718 (T) = (0 -47.86925511571955) / Math.Sqrt((0.6027996797278109 / (21)) + (0.622421009669014 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.570084014965074 = (30.48833989739357 - 47.86925511571955) / 30.48833989739357 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ParseHex(value: "4")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.7417365915758 > 26.475744539942305.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -53.37866563445404 (T) = (0 -51.042331827308246) / Math.Sqrt((0.8811723987810087 / (21)) + (2.636974448873985 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -1.0075450532056707 = (25.42524848735189 - 51.042331827308246) / 25.42524848735189 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryParse(value: "2147483647")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.63978845078481 > 33.76550717885425.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -54.54373525001383 (T) = (0 -56.631452629665546) / Math.Sqrt((0.46262920083537373 / (21)) + (2.608581077365427 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.784548405375897 = (31.73433259589095 - 56.631452629665546) / 31.73433259589095 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryParse(value: "4")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.966947342909915 > 23.931438366179613.
IsChangePoint: Marked as a change because one of 12/15/2022 1:21:30 AM, 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -27.248237597684984 (T) = (0 -28.222401456698584) / Math.Sqrt((0.14152771105816558 / (21)) + (0.48902143739579607 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.24546193028762905 = (22.660187975541618 - 28.222401456698584) / 22.660187975541618 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.Parse(value: "2147483647")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 62.08073106685696 > 37.98773600397824.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -107.56077838139086 (T) = (0 -62.259142282917864) / Math.Sqrt((0.620578282612333 / (21)) + (0.4028442782371831 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -0.7159601980109165 = (36.282393003687716 - 62.259142282917864) / 36.282393003687716 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: -2147483648)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 207.73701384703787 > 41.8547000504518.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 1/10/2023 3:04:25 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 3:04:25 AM.
IsRegressionStdDev: Marked as regression because -353.80206175977247 (T) = (0 -209.83141650935087) / Math.Sqrt((0.11297456737715343 / (21)) + (3.1487856714288607 / (14))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (14) - 2, .025) and -4.239777441457989 = (40.04586432414664 - 209.83141650935087) / 40.04586432414664 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

kotlarmilos · 2023-02-02T18:15:47Z

@kotlarmilos The report I got is here: https://pvscmdupload.blob.core.windows.net/drewtest/reports/report_Daily_ca%3Dx64_cb%3Drefs-heads-main_co%3DUbuntu1804_cr%3Ddotnetruntime_cc%3DCompilationMode%3Dtiered-LLVM%3Dfalse-MonoAOT%3Dtrue-MonoInterpreter%3Dfalse-RunKind%3Dmicro_mono_2023-01-31.html, but it doesn't cover arm64, only x64; I am getting another one for arm64.

To use the mini compiler instead of llvm, you can use --aotcompilermode mini.

Let me know if you get different results. @naricc Are we sure that the range is correctly reported?

naricc · 2023-02-14T22:04:59Z

@kotlarmilos The range seems to be correct. Whatever is going on is still happening, from looking at a some random benchmarks:

https://pvscmdupload.blob.core.windows.net/reports/allTestHistory%2frefs%2fheads%2fmain_arm64_ubuntu%2020.04_LLVM%3dfalse_MonoAOT%3dtrue_MonoInterpreter%3dfalse_RunKind%3dmicro_mono%2fSystem.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring%3a%20).html

naricc · 2023-02-14T22:08:46Z

@kotlarmilos You did it in the nollvm configuration, but can you repeat with llvm?

kotlarmilos · 2023-02-15T09:53:22Z

I can repeat the measurements on osx-arm64 in llvm and nollvm configurations for the benchmark. The only PR within the range that changed the codebase is dotnet/runtime@5a10aa6.

kotlarmilos · 2023-02-16T13:26:35Z

Local run for System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ) microbenchmark on osx-arm64 in range dotnet/runtime@9197fd5...92d7381 using Mono AOT nollvm release configuration.

Commit	Method	Mean	Error	StdDev	Median	Min	Max	Gen0	Allocated
dotnet/runtime@`b592364`	ToString	257.5 ns	2.02 ns	1.89 ns	257.0 ns	254.8 ns	260.0 ns	0.0154	64 B
dotnet/runtime@`5a10aa6`	ToString	265.8 ns	0.68 ns	0.64 ns	265.9 ns	264.8 ns	267.2 ns	0.0149	64 B
dotnet/runtime@`1928cd2`	ToString	266.2 ns	1.07 ns	1.00 ns	266.4 ns	264.5 ns	267.7 ns	0.0150	64 B
dotnet/runtime@`5c36a27`	ToString	267.4 ns	0.86 ns	0.80 ns	267.3 ns	266.1 ns	268.9 ns	0.0151	64 B

Local run for System.Globalization.Tests.Perf_DateTimeCultureInfo.ToString(culturestring: ) microbenchmark on osx-arm64 in range dotnet/runtime@9197fd5...92d7381 using Mono AOT llvm release configuration.

Commit	Method	Mean	Error	StdDev	Median	Min	Max	Gen0	Allocated
dotnet/runtime@`b592364`	ToString	265.9 ns	1.03 ns	0.91 ns	265.7 ns	264.7 ns	267.9 ns	0.0150	64 B
dotnet/runtime@`5a10aa6`	ToString	270.8 ns	3.78 ns	3.54 ns	271.0 ns	265.2 ns	276.9 ns	0.0149	64 B
dotnet/runtime@`1928cd2`	ToString	269.1 ns	2.64 ns	2.34 ns	269.2 ns	265.5 ns	273.3 ns	0.0145	64 B
dotnet/runtime@`5c36a27`	ToString	270.7 ns	4.32 ns	4.04 ns	269.6 ns	265.5 ns	278.7 ns	0.0151	64 B

There is a slight increase with dotnet/runtime@5a10aa6 but not ~ 1.7x as reported on linux-arm64 using Mono AOT nollvm release configuration.

naricc · 2023-02-16T15:19:55Z

@kotlarmilos Ok, considering those are within two standard deviations and in laboratory conditions, I'm going to say there is no real regression here. Or possibly it only happens on linux for some strange reason. I will follow up with @DrewScoggins to try to figure out what is going on with these results.

kotlarmilos · 2023-03-17T15:27:57Z

After a thorough investigation, we didn't manage to find a cause of the regressions. As it only happened on arm64 machines, it might be related to the hardware changes. We could look back at the regressions once benchmarks_ci.py support range bisect, as it might help us identify the cause.

kotlarmilos · 2023-12-08T16:38:19Z

This was the same issue as dotnet/runtime#91819 (comment). The Mono AOT compilation failed and CoreCLR was utilized instead.

naricc mentioned this issue Feb 22, 2023

Mono-LLVM is not tested? dotnet/performance#2912

Open

kotlarmilos mentioned this issue Feb 24, 2023

Performance triage by bisecting the range dotnet/performance#2916

Open

kotlarmilos unassigned naricc Feb 28, 2023

kotlarmilos added the Observation Observe these benchmarks in the future to see if the regression is real label Mar 17, 2023

performanceautofiler bot added perf-regression os-linux branch-refs/heads/main arch-arm64 runtime-mono mono-aot kind-micro_mono and removed refs/heads/main labels Mar 23, 2023

kotlarmilos mentioned this issue May 24, 2023

[Perf] Linux/arm64: 3189 Improvements on 5/11/2023 10:01:37 AM #17878

Closed

kotlarmilos closed this as completed Dec 8, 2023

[Perf] Linux/arm64: 2158 Regressions on 1/6/2023 2:21:07 AM #11536

[Perf] Linux/arm64: 2158 Regressions on 1/6/2023 2:21:07 AM #11536

Comments

performanceautofiler bot commented Jan 11, 2023 • edited Loading

Run Information

Regressions in System.ComponentModel.Tests.Perf_TypeDescriptorTests

Repro

Payloads

Histogram

System.ComponentModel.Tests.Perf_TypeDescriptorTests.GetConverter(typeToConvert: typeof(System.Enum))

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Docs

performanceautofiler bot commented Jan 11, 2023 • edited Loading

Run Information

Regressions in System.Text.Json.Tests.Perf_Segment

Repro

Payloads

Histogram

System.Text.Json.Tests.Perf_Segment.ReadMultiSegmentSequence(segmentSize: 8192, TestCase: Json4KB)

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Docs

performanceautofiler bot commented Jan 11, 2023 • edited Loading

Run Information

Regressions in ByteMark

Repro

Payloads

Histogram

ByteMark.BenchFourier

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Description of detection logic

Docs

performanceautofiler bot commented Jan 11, 2023 • edited Loading

Run Information

Regressions in System.Xml.Linq.Perf_XName

Repro

Payloads

Histogram

System.Xml.Linq.Perf_XName.CreateElement

Description of detection logic

Description of detection logic

performanceautofiler bot commented Jan 11, 2023 •

edited

Loading

performanceautofiler bot commented Jan 11, 2023 •

edited

Loading

performanceautofiler bot commented Jan 11, 2023 •

edited

Loading

performanceautofiler bot commented Jan 11, 2023 •

edited

Loading

performanceautofiler bot commented Jan 11, 2023 •

edited

Loading

performanceautofiler bot commented Jan 11, 2023 •

edited

Loading