[Perf] Windows/x86: 36 Improvements on 10/11/2022 6:23:40 AM

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Int16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	20.54 ns	17.01 ns	0.83	0.19	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int16*'

Related Issues

Regressions

• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Int16.ToString(value: -32768)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 17.005944587470765 < 19.48114208102172.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 53.21567568298766 (T) = (0 -16.950271150930558) / Math.Sqrt((0.8798036024116653 / (299)) + (0.09134492335372739 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.19544871407527248 = (21.067980932313613 - 16.950271150930558) / 21.067980932313613 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Version

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToStringL - Duration of single invocation	129.24 ns	61.15 ns	0.47	0.01	False
ToString4 - Duration of single invocation	44.83 ns	38.65 ns	0.86	0.02	False
TryFormat2 - Duration of single invocation	17.19 ns	14.47 ns	0.84	0.06	False
TryFormat3 - Duration of single invocation	24.70 ns	20.52 ns	0.83	0.07	False
TryFormat4 - Duration of single invocation	31.52 ns	25.69 ns	0.81	0.08	False
TryFormatL - Duration of single invocation	113.41 ns	43.97 ns	0.39	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Version*'

Related Issues

Regressions

• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Version.ToStringL

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 61.14871195924722 < 122.85093797014025.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 299.33211380532794 (T) = (0 -62.312554579187044) / Math.Sqrt((3.94428064085358 / (299)) + (1.0909008347683093 / (25))) is greater than 1.9673585853226652 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (25) - 2, .975) and 0.5338293051176608 = (133.66896560264183 - 62.312554579187044) / 133.66896560264183 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.ToString4

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.65454814812803 < 41.9456615481736.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 13.385304376351325 (T) = (0 -41.32433361022903) / Math.Sqrt((0.8459047525452402 / (299)) + (1.3548898813280688 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06625741324081856 = (44.25666580514107 - 41.32433361022903) / 44.25666580514107 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.TryFormat2

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 14.46716874032442 < 16.27627294921085.
IsChangePoint: Marked as a change because one of 8/30/2022 9:25:07 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 13.282624517765765 (T) = (0 -14.800750270152498) / Math.Sqrt((0.2097325221844241 / (299)) + (1.098677179928679 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.14986722954893958 = (17.40992793666755 - 14.800750270152498) / 17.40992793666755 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.TryFormat3

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.524641990443133 < 23.490649579059028.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 20.812236175695915 (T) = (0 -20.783210463441467) / Math.Sqrt((0.3660217813537203 / (299)) + (0.9189722053147343 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.15163169308025076 = (24.497862890353634 - 20.783210463441467) / 24.497862890353634 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.TryFormat4

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.6885370748665 < 29.440773139240275.
IsChangePoint: Marked as a change because one of 8/30/2022 6:17:03 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 33.59465767780856 (T) = (0 -25.557111215686255) / Math.Sqrt((0.6166652231288572 / (299)) + (0.7010583919934447 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.17329666170274535 = (30.914488948751263 - 25.557111215686255) / 30.914488948751263 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Version.TryFormatL

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.97006474589994 < 107.72226103005822.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 351.5777292720054 (T) = (0 -44.427148698121144) / Math.Sqrt((2.928700524340415 / (299)) + (1.0103261859341515 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.6226395628458942 = (117.7313367378204 - 44.427148698121144) / 117.7313367378204 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryFormat - Duration of single invocation	96.72 ns	59.01 ns	0.61	0.04	False
ToString - Duration of single invocation	91.27 ns	55.46 ns	0.61	0.00	False
ToString - Duration of single invocation	99.05 ns	65.56 ns	0.66	0.00	False
ToString - Duration of single invocation	17.17 ns	13.38 ns	0.78	0.10	False
TryFormat - Duration of single invocation	84.58 ns	51.90 ns	0.61	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int64*'

Related Issues

Regressions

• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Int64.TryFormat(value: -9223372036854775808)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 59.01089007059783 < 91.68621936742426.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 320.43177173121336 (T) = (0 -58.83942968048321) / Math.Sqrt((1.7161147056368604 / (136)) + (0.03999625239364322 / (30))) is greater than 1.9745345758582833 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (136) + (30) - 2, .975) and 0.39145034737709217 = (96.6879685607897 - 58.83942968048321) / 96.6879685607897 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ToString(value: 9223372036854775807)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 55.45740569072573 < 85.7924632553258.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 533.2737022705886 (T) = (0 -55.255303175831756) / Math.Sqrt((0.12354662470539872 / (299)) + (0.1227074753914567 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.3895382736128365 = (90.51395163271556 - 55.255303175831756) / 90.51395163271556 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ToString(value: -9223372036854775808)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 65.56032911904977 < 94.2816345414645.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 573.7819452047028 (T) = (0 -65.74121762705731) / Math.Sqrt((0.2122475384985604 / (299)) + (0.0818551030183613 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.3385289113194282 = (99.38638098029425 - 65.74121762705731) / 99.38638098029425 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.ToString(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.382143818740058 < 16.328654828221094.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 92.6458748979704 (T) = (0 -13.48438096357663) / Math.Sqrt((0.14986950490764417 / (299)) + (0.04793081547736493 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.23941098072780118 = (17.728866210137664 - 13.48438096357663) / 17.728866210137664 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int64.TryFormat(value: 9223372036854775807)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 51.898844746228185 < 80.31917541831557.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 339.2160332180853 (T) = (0 -52.00162581887937) / Math.Sqrt((1.9214645666384036 / (299)) + (0.08844465278590699 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.38709944437176547 = (84.84512755185338 - 52.00162581887937) / 84.84512755185338 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IntegerFormatting - Duration of single invocation	2.13 ms	1.25 ms	0.59	0.01	False
InterfaceInterfaceMethodLongHierarchy - Duration of single invocation	374.20 μs	343.02 μs	0.92	0.04	False
TypeReflectionObjectGetType - Duration of single invocation	155.92 μs	132.86 μs	0.85	0.03	False
StaticDelegate - Duration of single invocation	311.84 μs	280.66 μs	0.90	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'PerfLabTests.LowLevelPerf*'

Related Issues

Regressions

• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

PerfLabTests.LowLevelPerf.IntegerFormatting

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.2487673763736262 < 2.028782618489583.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 409.0176212788633 (T) = (0 -1241875.8522270552) / Math.Sqrt((1136575780.445474 / (299)) + (46015167.72553275 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.4320562367924144 = (2186617.641882872 - 1241875.8522270552) / 2186617.641882872 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.InterfaceInterfaceMethodLongHierarchy

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 343.0160848662207 < 355.4891282242064.
IsChangePoint: Marked as a change because one of 8/16/2022 10:54:40 PM, 8/20/2022 7:42:33 PM, 8/27/2022 12:34:40 AM, 9/9/2022 3:12:19 AM, 10/10/2022 3:36:43 PM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 20.380159519446817 (T) = (0 -343291.2081297617) / Math.Sqrt((237336867.83918947 / (299)) + (327092.9241190966 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.05055114022904699 = (361568.9298026836 - 343291.2081297617) / 361568.9298026836 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.TypeReflectionObjectGetType

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 132.85536723163844 < 148.13026347036876.
IsChangePoint: Marked as a change because one of 9/22/2022 3:11:11 PM, 9/23/2022 1:16:35 AM, 10/13/2022 10:51:15 PM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 46.43012029433748 (T) = (0 -132621.090109786) / Math.Sqrt((78324409.66294484 / (299)) + (156616.35326219813 / (15))) is greater than 1.9675964973877862 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (15) - 2, .975) and 0.15449170380974073 = (156853.68281702008 - 132621.090109786) / 156853.68281702008 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### PerfLabTests.LowLevelPerf.StaticDelegate

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 280.6555505952381 < 296.24186518036703.
IsChangePoint: Marked as a change because one of 8/18/2022 3:00:51 AM, 9/9/2022 3:12:19 AM, 9/13/2022 12:23:36 PM, 10/10/2022 3:36:43 PM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 30.61639251076566 (T) = (0 -280962.83735609625) / Math.Sqrt((176206257.6308234 / (299)) + (285562.18371258 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.07774941603164023 = (304649.1292498172 - 280962.83735609625) / 304649.1292498172 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryFormat - Duration of single invocation	16.71 ns	9.37 ns	0.56	0.00	False
ToString - Duration of single invocation	18.46 ns	11.20 ns	0.61	0.03	False
TryFormat - Duration of single invocation	24.44 ns	18.23 ns	0.75	0.17	False
TryFormat - Duration of single invocation	8.55 ns	7.23 ns	0.85	0.04	False
ToString - Duration of single invocation	29.40 ns	21.89 ns	0.74	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int32*'

Related Issues

Regressions

• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Int32.TryFormat(value: 2147483647)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 9.369065832477718 < 15.924223807410096.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 434.9292812518601 (T) = (0 -9.418841020750582) / Math.Sqrt((0.09519299710264785 / (299)) + (0.000652524492947004 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.45992821903467046 = (17.439979929918305 - 9.418841020750582) / 17.439979929918305 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: 2147483647)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.196172156396962 < 17.576121500602763.
IsChangePoint: Marked as a change because one of 10/3/2022 8:45:37 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 124.68034362783717 (T) = (0 -10.597762637699638) / Math.Sqrt((2.7095928708047943 / (299)) + (0.03393706866746091 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.5429200695093843 = (23.185797342544273 - 10.597762637699638) / 23.185797342544273 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: -2147483648)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 18.22945531596097 < 23.761004667051598.
IsChangePoint: Marked as a change because one of 10/3/2022 8:45:37 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 16.32363189705744 (T) = (0 -18.89553954367578) / Math.Sqrt((2.039375484256751 / (299)) + (1.433349957566889 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.16795617795453283 = (22.70978888734929 - 18.89553954367578) / 22.70978888734929 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.TryFormat(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.2312645997016585 < 8.123383040051745.
IsChangePoint: Marked as a change because one of 10/3/2022 8:45:37 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 40.760297868746804 (T) = (0 -7.122148536328042) / Math.Sqrt((0.14052920198235777 / (299)) + (0.09720578811733839 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.25848897561387085 = (9.604912539532663 - 7.122148536328042) / 9.604912539532663 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_Int32.ToString(value: -2147483648)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.88848344544304 < 28.07656418449037.
IsChangePoint: Marked as a change because one of 10/11/2022 1:45:10 PM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 45.57866307502335 (T) = (0 -22.336909755411234) / Math.Sqrt((0.7264559865057801 / (299)) + (0.8879939181786557 / (28))) is greater than 1.967290077109849 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (28) - 2, .975) and 0.273807555585286 = (30.75893990251305 - 22.336909755411234) / 30.75893990251305 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	15.48 ns	11.90 ns	0.77	0.05	False
TryFormat - Duration of single invocation	15.39 ns	10.92 ns	0.71	0.03	False
TryFormat - Duration of single invocation	89.78 ns	50.95 ns	0.57	0.01	False
Parse - Duration of single invocation	27.43 ns	0.77 ns	0.03	0.18	False
TryFormat - Duration of single invocation	10.25 ns	8.44 ns	0.82	0.03	False
ParseSpan - Duration of single invocation	10.38 ns	0.00 ns	0.00	0.17	False
ToString - Duration of single invocation	91.43 ns	55.22 ns	0.60	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt64*'

Related Issues

Regressions

• [Perf] Windows/x64: 3 Regressions on 10/11/2022 6:23:40 AM
• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_UInt64.ToString(value: 12345)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 11.9023615420104 < 14.711775509982386.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 121.83355225294537 (T) = (0 -11.965967115800877) / Math.Sqrt((0.07106067655269861 / (299)) + (0.013659873750437387 / (24))) is greater than 1.967381707010986 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (24) - 2, .975) and 0.22432909832522102 = (15.426603073500278 - 11.965967115800877) / 15.426603073500278 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.91682466243792 < 14.641200692352337.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 93.08532537482144 (T) = (0 -11.255877902301146) / Math.Sqrt((0.18152302598220557 / (299)) + (0.042575064305583596 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.2712769661064867 = (15.446030081088315 - 11.255877902301146) / 15.446030081088315 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 50.94635361826018 < 85.08189800625952.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 773.0805639107778 (T) = (0 -50.94587827284874) / Math.Sqrt((0.5209432382142164 / (299)) + (0.02426715564908087 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.43263250517562374 = (89.79343853425829 - 50.94587827284874) / 89.79343853425829 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.Parse(value: "12345")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.7716655241893604 < 26.254835157018935.
IsChangePoint: Marked as a change because one of 10/11/2022 5:13:36 PM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 135.1071780761643 (T) = (0 -0.7188845401253063) / Math.Sqrt((1.6844204704323833 / (299)) + (0.9283299256514332 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.9740902907991343 = (27.745758725122457 - 0.7188845401253063) / 27.745758725122457 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.TryFormat(value: 0)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.444491840134894 < 9.748802073703024.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 51.68879770437151 (T) = (0 -8.512038237886356) / Math.Sqrt((0.007973734354342685 / (299)) + (0.03398951157790304 / (31))) is greater than 1.9672228266464409 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (31) - 2, .975) and 0.16909287509180437 = (10.244271571057746 - 8.512038237886356) / 10.244271571057746 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ParseSpan(value: "0")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.0019139935637911346 < 9.909229190443872.
IsChangePoint: Marked as a change because one of 10/11/2022 5:13:36 PM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 14.75005936824495 (T) = (0 -1.604343750862032) / Math.Sqrt((0.3362027012156942 / (299)) + (9.511151695677778 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.845330856082736 = (10.372746045069155 - 1.604343750862032) / 10.372746045069155 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt64.ToString(value: 18446744073709551615)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 55.21611561251727 < 86.64125440141255.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 474.42431155197136 (T) = (0 -54.86852804327085) / Math.Sqrt((0.21428707785275686 / (299)) + (0.1513366810746365 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.3962441051178667 = (90.87866223481332 - 54.86852804327085) / 90.87866223481332 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_UInt16

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	9.77 ns	7.30 ns	0.75	0.03	False
ToString - Duration of single invocation	9.77 ns	7.29 ns	0.75	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt16*'

Related Issues

Regressions

• [Perf] Windows/x64: 3 Regressions on 10/11/2022 6:23:40 AM
• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_UInt16.ToString(value: 65535)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.30121005935251 < 9.287339014760702.
IsChangePoint: Marked as a change because one of 10/3/2022 8:45:37 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 92.74902395283623 (T) = (0 -7.654284998735523) / Math.Sqrt((0.29885000111140025 / (299)) + (0.02150869532216224 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.3342298479094004 = (11.496888189865727 - 7.654284998735523) / 11.496888189865727 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt16.ToString(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 7.294827952367526 < 9.27762623779404.
IsChangePoint: Marked as a change because one of 10/3/2022 8:45:37 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 78.8395093359914 (T) = (0 -7.673574400668569) / Math.Sqrt((0.3085302247791859 / (299)) + (0.04036714254762823 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.3337589083273995 = (11.517714077653233 - 7.673574400668569) / 11.517714077653233 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_DateTime

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	337.44 ns	318.42 ns	0.94	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTime*'

Related Issues

Regressions

• [Perf] Windows/x64: 3 Regressions on 10/11/2022 6:23:40 AM
• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

• [Perf] Alpine/x64: 20 Improvements on 10/11/2022 6:23:40 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_DateTime.ToString(format: "G")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 318.4210074982677 < 318.9266173969983.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 55.03262395742419 (T) = (0 -316.07977129178875) / Math.Sqrt((7.592993596274225 / (281)) + (2.6399215009286223 / (30))) is greater than 1.9676708853560316 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (281) + (30) - 2, .975) and 0.05575604778419113 = (334.74376039164514 - 316.07977129178875) / 334.74376039164514 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	18.27 ns	10.94 ns	0.60	0.04	False
ToString - Duration of single invocation	10.23 ns	8.21 ns	0.80	0.03	False
TryFormat - Duration of single invocation	16.45 ns	8.40 ns	0.51	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt32*'

Related Issues

Regressions

• [Perf] Windows/x64: 3 Regressions on 10/11/2022 6:23:40 AM
• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

• [Perf] Alpine/x64: 20 Improvements on 10/11/2022 6:23:40 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_UInt32.ToString(value: 4294967295)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 10.935898630579686 < 17.44126093607613.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 222.8572351453177 (T) = (0 -10.458959632220548) / Math.Sqrt((0.1588296097904544 / (299)) + (0.03119974457499941 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.45787825087416345 = (19.292639797398774 - 10.458959632220548) / 19.292639797398774 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt32.ToString(value: 12345)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.209793670860856 < 9.712179161660208.
IsChangePoint: Marked as a change because one of 10/3/2022 8:45:37 PM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 78.6290496607813 (T) = (0 -7.530267762176364) / Math.Sqrt((0.29007363148064197 / (299)) + (0.061810459597740515 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.3650054563692982 = (11.858791288379628 - 7.530267762176364) / 11.858791288379628 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_UInt32.TryFormat(value: 4294967295)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.402388187886194 < 15.6044922607107.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 535.5709090630089 (T) = (0 -8.372632596429478) / Math.Sqrt((0.076485589996879 / (299)) + (0.00024410239920527097 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.5096171142173651 = (17.073663945402647 - 8.372632596429478) / 17.073663945402647 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Tests.Perf_Byte

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	7.54 ns	5.91 ns	0.78	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Byte*'

Related Issues

Regressions

• [Perf] Windows/x64: 3 Regressions on 10/11/2022 6:23:40 AM
• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

• [Perf] Alpine/x64: 20 Improvements on 10/11/2022 6:23:40 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_Byte.ToString(value: 255)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.906477209974484 < 7.166224067519388.
IsChangePoint: Marked as a change because one of 8/18/2022 3:00:51 AM, 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 47.46449477231258 (T) = (0 -5.90869661122689) / Math.Sqrt((0.1466129142849513 / (299)) + (0.05085749069060882 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.2730153866473115 = (8.12767767391571 - 5.90869661122689) / 8.12767767391571 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6dc320ed049427c93a6d04c51494d1072c376d62
Compare	2b07c8c46523b816b1eac5c8af092e52b20a69d2
Diff	Diff

Improvements in System.Text.Tests.Perf_StringBuilder

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Append_Primitives - Duration of single invocation	1.82 μs	1.69 μs	0.93	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

Related Issues

Regressions

• [Perf] Windows/x64: 3 Regressions on 10/11/2022 6:23:40 AM
• [Perf] Windows/x64: 1 Regression on 10/11/2022 6:23:40 AM
• [Perf] Windows/x86: 1 Regression on 10/11/2022 6:23:40 AM

Improvements

• [Perf] Alpine/x64: 20 Improvements on 10/11/2022 6:23:40 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Tests.Perf_StringBuilder.Append_Primitives

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.6901871235890227 < 1.7422342961948947.
IsChangePoint: Marked as a change because one of 10/11/2022 2:16:14 AM, 10/18/2022 1:35:00 AM falls between 10/7/2022 9:25:17 PM and 10/18/2022 1:35:00 AM.
IsImprovementStdDev: Marked as improvement because 66.68202374656103 (T) = (0 -1680.9558022820347) / Math.Sqrt((205.36633592456732 / (299)) + (154.42261311626558 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.0874394137347277 = (1842.021042308524 - 1680.9558022820347) / 1842.021042308524 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

dotnet/runtime#76726