[Perf] Linux/x64: 6 Improvements on 10/6/2023 11:50:29 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	52806bc157decf345005249c9ea7969c8b9e7e1b
Compare	f21a2666c577306e437f80fe934d76cdb15072a5
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
AbsBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	30.13 ns	25.83 ns	0.86	0.48	False
MultiplyBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	32.17 ns	29.01 ns	0.90	0.32	False
AddOperatorBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	32.14 ns	28.84 ns	0.90	0.37	False
LessThanOrEqualAnyBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	31.30 ns	25.85 ns	0.83	0.56	False
SumBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	13.43 ns	10.12 ns	0.75	0.72	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AbsBenchmark

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 25.82973080966568 < 27.20886706351184.
IsChangePoint: Marked as a change because one of 10/6/2023 6:15:21 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 12.412106529303548 (T) = (0 -26.194573736106356) / Math.Sqrt((3.0978824247512184 / (206)) + (0.3551205405432864 / (19))) is greater than 1.9706589608356722 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (206) + (19) - 2, .975) and 0.08005637822763752 = (28.47410766938078 - 26.194573736106356) / 28.47410766938078 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MultiplyBenchmark

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 29.005109225154122 < 30.108827080915084.
IsChangePoint: Marked as a change because one of 10/6/2023 9:14:38 AM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 10.933533727837164 (T) = (0 -29.439651375218233) / Math.Sqrt((2.87905473995233 / (203)) + (0.39810693039363393 / (20))) is greater than 1.9707562704893595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (203) + (20) - 2, .975) and 0.06416900723526212 = (31.45829920447952 - 29.439651375218233) / 31.45829920447952 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddOperatorBenchmark

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 28.837797347305802 < 30.527364508055502.
IsChangePoint: Marked as a change because one of 9/15/2023 4:40:29 AM, 9/26/2023 11:02:05 PM, 10/6/2023 9:14:38 AM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 5.748672663187106 (T) = (0 -30.033351486758562) / Math.Sqrt((4.0666325597456225 / (204)) + (1.2368113945606216 / (20))) is greater than 1.9707073953201992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (204) + (20) - 2, .975) and 0.05189557695894262 = (31.67726123502957 - 30.033351486758562) / 31.67726123502957 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 25.84720656371913 < 30.155480695629297.
IsChangePoint: Marked as a change because one of 9/26/2023 5:24:05 PM, 10/4/2023 9:32:56 AM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 7.088507689938569 (T) = (0 -26.841723512027485) / Math.Sqrt((5.564667137123641 / (195)) + (1.5836479585518437 / (30))) is greater than 1.9706589608356722 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (195) + (30) - 2, .975) and 0.07003619616576236 = (28.863191665481118 - 26.841723512027485) / 28.863191665481118 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SumBenchmark

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 10.115971540173133 < 12.604138242434313.
IsChangePoint: Marked as a change because one of 9/19/2023 12:42:36 AM, 9/28/2023 1:14:28 AM, 10/5/2023 8:44:34 AM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 8.615521382003683 (T) = (0 -10.831519635745881) / Math.Sqrt((2.7359283644726307 / (200)) + (0.5784968846788142 / (25))) is greater than 1.9706589608356722 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (200) + (25) - 2, .975) and 0.13241660511354597 = (12.484701412667619 - 10.831519635745881) / 12.484701412667619 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	52806bc157decf345005249c9ea7969c8b9e7e1b
Compare	f21a2666c577306e437f80fe934d76cdb15072a5
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Numerics.Tests.Perf_Vector3

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
EqualsBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	20.98 ns	17.60 ns	0.84	0.65	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector3*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector3.EqualsBenchmark

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 17.60077092431028 < 19.947281835042702.
IsChangePoint: Marked as a change because one of 9/16/2023 5:31:18 PM, 9/24/2023 8:25:02 PM, 10/6/2023 6:15:21 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 10.159355988051296 (T) = (0 -17.063932196735617) / Math.Sqrt((4.32956320373118 / (204)) + (0.938843536352927 / (19))) is greater than 1.9707562704893595 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (204) + (19) - 2, .975) and 0.13661682943953765 = (19.764031519931784 - 17.063932196735617) / 19.764031519931784 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository