[Perf] Changes at 2/4/2022 1:40:45 AM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	64f3bae738087a1ec1fd394bfd97c4e4feba5767
Compare	607dccee09d06ef3f0d4c015da39fcc81117b4eb
Diff	Diff

Improvements in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToByteArray - Duration of single invocation	18.26 ns	15.57 ns	0.85	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_BigInteger.ToByteArray(numberString: 123)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 15.569038119534481 < 17.354462299094166.
IsChangePoint: Marked as a change because one of 11/18/2021 5:43:05 PM, 11/22/2021 3:34:51 PM, 11/26/2021 9:19:07 PM, 12/7/2021 2:09:29 PM, 1/11/2022 6:41:22 PM, 2/3/2022 8:57:20 PM, 2/8/2022 11:58:21 PM falls between 1/31/2022 9:06:05 AM and 2/8/2022 11:58:21 PM.
IsImprovementStdDev: Marked as improvement because 37.195745048149256 (T) = (0 -15.623955214453275) / Math.Sqrt((0.5742844751783756 / (299)) + (0.020426352943692584 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.1162922449790615 = (17.68000238278217 - 15.623955214453275) / 17.68000238278217 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	64f3bae738087a1ec1fd394bfd97c4e4feba5767
Compare	607dccee09d06ef3f0d4c015da39fcc81117b4eb
Diff	Diff

Improvements in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Parse - Duration of single invocation	18.40 ns	16.76 ns	0.91	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int64*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Int64.Parse(value: "12345")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 16.762382943944402 < 17.48460330574926.
IsChangePoint: Marked as a change because one of 12/2/2021 4:22:41 PM, 1/27/2022 1:01:32 PM, 2/3/2022 8:57:20 PM, 2/8/2022 11:58:21 PM falls between 1/31/2022 9:06:05 AM and 2/8/2022 11:58:21 PM.
IsImprovementStdDev: Marked as improvement because 52.68690833732182 (T) = (0 -16.04487865631569) / Math.Sqrt((1.2176397281690066 / (299)) + (0.0860499742589288 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.2360378214630644 = (21.00218977730448 - 16.04487865631569) / 21.00218977730448 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	64f3bae738087a1ec1fd394bfd97c4e4feba5767
Compare	607dccee09d06ef3f0d4c015da39fcc81117b4eb
Diff	Diff

Improvements in System.Collections.Tests.Perf_PriorityQueue<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dequeue_And_Enqueue - Duration of single invocation	203.44 μs	169.17 μs	0.83	0.01	True
K_Max_Elements - Duration of single invocation	734.43 ns	605.71 ns	0.82	0.01	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_PriorityQueue<Int32, Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_PriorityQueue<Int32, Int32>.Dequeue_And_Enqueue(Size: 1000)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 169.16619623655916 < 193.11882224025976.
IsChangePoint: Marked as a change because one of 2/3/2022 8:57:20 PM, 2/8/2022 11:58:21 PM falls between 1/31/2022 9:06:05 AM and 2/8/2022 11:58:21 PM.
IsImprovementStdDev: Marked as improvement because 45.869119471837735 (T) = (0 -170333.764517883) / Math.Sqrt((291569.3789029437 / (299)) + (8939420.357253835 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.15963619818830588 = (202690.5063624466 - 170333.764517883) / 202690.5063624466 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Collections.Tests.Perf_PriorityQueue&lt;Int32, Int32&gt;.K_Max_Elements(Size: 100)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 605.7137938392303 < 697.6733119512963.
IsChangePoint: Marked as a change because one of 11/8/2021 12:05:30 PM, 11/17/2021 1:03:18 AM, 2/3/2022 8:57:20 PM, 2/8/2022 11:58:21 PM falls between 1/31/2022 9:06:05 AM and 2/8/2022 11:58:21 PM.
IsImprovementStdDev: Marked as improvement because 13.629175034903511 (T) = (0 -627.9864906110149) / Math.Sqrt((97.81886986687512 / (299)) + (1113.6732818492733 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.1461470868033394 = (735.4738514154091 - 627.9864906110149) / 735.4738514154091 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	64f3bae738087a1ec1fd394bfd97c4e4feba5767
Compare	607dccee09d06ef3f0d4c015da39fcc81117b4eb
Diff	Diff

Improvements in System.Threading.Tests.Perf_Interlocked

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CompareExchange_long - Duration of single invocation	5.48 ns	2.43 ns	0.44	0.18	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_Interlocked*'

Payloads

Baseline
Compare

Histogram

System.Threading.Tests.Perf_Interlocked.CompareExchange_long

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.4257608796573127 < 5.212698995174971.
IsChangePoint: Marked as a change because one of 2/3/2022 8:57:20 PM, 2/8/2022 11:58:21 PM falls between 1/31/2022 9:06:05 AM and 2/8/2022 11:58:21 PM.
IsImprovementStdDev: Marked as improvement because 41.0309096930819 (T) = (0 -2.690383147118295) / Math.Sqrt((0.07137169927991792 / (299)) + (0.07293617546072911 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.49974766432610257 = (5.378052145411854 - 2.690383147118295) / 5.378052145411854 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository