[Perf] Windows/arm64: 8 Improvements on 8/16/2023 6:13:11 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.19041
Queue	SurfaceWindows
Baseline	067a3572a555f1cdef7ca29a54efb7b38cfa086f
Compare	2ed506c010b41c41c01997c81df977831f0fa217
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Improvements in System.Memory.ReadOnlySequence

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Slice_Repeat_StartPosition_And_EndPosition - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	74.61 ns	68.32 ns	0.92	0.01	False
Slice_StartPosition_And_Length - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	14.89 ns	13.72 ns	0.92	0.10	False
Slice_StartPosition_And_EndPosition - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	15.28 ns	14.15 ns	0.93	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'

Payloads

Baseline
Compare

System.Memory.ReadOnlySequence.Slice_Repeat_StartPosition_And_EndPosition(Segment: Multiple)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 68.32249766558556 < 70.81392757189643.
IsChangePoint: Marked as a change because one of 4/1/2023 3:05:46 AM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 53.707778257375516 (T) = (0 -68.03198107130243) / Math.Sqrt((0.42331431832916216 / (299)) + (0.1429541780222461 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.0808423956014771 = (74.01557768302543 - 68.03198107130243) / 74.01557768302543 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Multiple)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 13.720484194246996 < 14.041309699988387.
IsChangePoint: Marked as a change because one of 4/3/2023 6:15:03 PM, 5/19/2023 4:22:12 AM, 8/3/2023 11:36:41 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 9.198036419455018 (T) = (0 -13.693393165564704) / Math.Sqrt((0.13730825302920255 / (299)) + (0.10483162606961899 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.05839226307505668 = (14.542566536553661 - 13.693393165564704) / 14.542566536553661 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Memory.ReadOnlySequence.Slice_StartPosition_And_EndPosition(Segment: Multiple)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 14.150065589029635 < 14.51765301882002.
IsChangePoint: Marked as a change because one of 5/10/2023 2:36:50 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 22.246070324518016 (T) = (0 -14.26720548630663) / Math.Sqrt((0.1516771841265255 / (299)) + (0.040207183155083745 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.08555254766122566 = (15.601995992024563 - 14.26720548630663) / 15.601995992024563 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.19041
Queue	SurfaceWindows
Baseline	067a3572a555f1cdef7ca29a54efb7b38cfa086f
Compare	2ed506c010b41c41c01997c81df977831f0fa217
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Improvements in PerfLabTests.CastingPerf2.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IntObj - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	190.99 μs	159.19 μs	0.83	0.00	True
IFooObjIsIFooInterAlia - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	477.68 μs	446.22 μs	0.93	0.08	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'

Payloads

Baseline
Compare

PerfLabTests.CastingPerf2.CastingPerf.IntObj

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 159.1921875 < 181.50767727841898.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 1659.798448870265 (T) = (0 -159253.7368646057) / Math.Sqrt((13897.372599238026 / (299)) + (4195.645174467447 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.16685197436351562 = (191146.9894475758 - 159253.7368646057) / 191146.9894475758 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 446.22255494505487 < 453.87516200113726.
IsChangePoint: Marked as a change because one of 4/11/2023 2:19:19 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 33.65117202433701 (T) = (0 -451897.32817383483) / Math.Sqrt((56984111.73175929 / (299)) + (6365251.8474338455 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.05786266082287072 = (479651.2242774772 - 451897.32817383483) / 479651.2242774772 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	Windows 10.0.19041
Queue	SurfaceWindows
Baseline	067a3572a555f1cdef7ca29a54efb7b38cfa086f
Compare	2ed506c010b41c41c01997c81df977831f0fa217
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Improvements in PerfLabTests.CastingPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ScalarValueTypeObj - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	318.36 μs	286.62 μs	0.90	0.10	False
FooObjIsFoo - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	318.89 μs	286.52 μs	0.90	0.06	True
IntObj - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	318.43 μs	286.93 μs	0.90	0.08	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf*'

Payloads

Baseline
Compare

PerfLabTests.CastingPerf.ScalarValueTypeObj

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 286.6180587121212 < 302.49360026552694.
IsChangePoint: Marked as a change because one of 3/22/2023 9:02:35 AM, 3/23/2023 3:52:33 AM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 23.974507295690596 (T) = (0 -286691.1880727446) / Math.Sqrt((735729798.6946676 / (299)) + (54788.917890415556 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.11605309159182856 = (324330.7775000012 - 286691.1880727446) / 324330.7775000012 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

PerfLabTests.CastingPerf.FooObjIsFoo

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 286.52122159090914 < 302.536247695292.
IsChangePoint: Marked as a change because one of 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 26.777409484667174 (T) = (0 -286717.0611840083) / Math.Sqrt((553382229.3784314 / (299)) + (40660.36181081947 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.11281639072209979 = (323176.68877739314 - 286717.0611840083) / 323176.68877739314 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

PerfLabTests.CastingPerf.IntObj

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 286.93449810606063 < 302.75452512448487.
IsChangePoint: Marked as a change because one of 5/19/2023 9:46:56 PM, 5/20/2023 7:49:01 PM, 8/15/2023 10:39:13 PM, 8/23/2023 3:20:56 PM falls between 8/15/2023 2:45:30 AM and 8/23/2023 3:20:56 PM.
IsImprovementStdDev: Marked as improvement because 25.287866509598047 (T) = (0 -286785.5747481759) / Math.Sqrt((630594835.206264 / (299)) + (132239.61361994667 / (13))) is greater than 1.9676459287777595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (13) - 2, .975) and 0.1137602549942791 = (323598.18701916223 - 286785.5747481759) / 323598.18701916223 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository