[Perf] Linux/x64: 5 Improvements on 10/6/2023 11:50:29 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	52806bc157decf345005249c9ea7969c8b9e7e1b
Compare	f21a2666c577306e437f80fe934d76cdb15072a5
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Improvements in System.Reflection.Attributes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IsDefinedMethodBaseMissInherit - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.30 μs	1.24 μs	0.95	0.07	False
IsDefinedMethodBaseMiss - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.12 μs	1.04 μs	0.93	0.08	False
IsDefinedClassMissInherit - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	2.56 μs	2.26 μs	0.88	0.08	False
GetCustomAttributesClassMissInherit - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	4.22 μs	3.84 μs	0.91	0.10	False
GetCustomAttributesMethodBaseMiss - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	2.39 μs	2.12 μs	0.89	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Reflection.Attributes*'

Payloads

Baseline
Compare

System.Reflection.Attributes.IsDefinedMethodBaseMissInherit

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.2354703577120758 < 1.2428277435218245.
IsChangePoint: Marked as a change because one of 9/26/2023 10:37:55 AM, 10/6/2023 6:15:21 PM, 10/9/2023 8:09:24 PM falls between 10/1/2023 7:44:15 AM and 10/9/2023 8:09:24 PM.
IsImprovementStdDev: Marked as improvement because 6.634137502489029 (T) = (0 -1020.6312496943124) / Math.Sqrt((2876.974980956318 / (197)) + (7831.997629545892 / (8))) is greater than 1.971718848463318 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (197) + (8) - 2, .975) and 0.1700491832372654 = (1229.7490755841852 - 1020.6312496943124) / 1229.7490755841852 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Reflection.Attributes.IsDefinedMethodBaseMiss

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.0399938075553872 < 1.079452575167927.
IsChangePoint: Marked as a change because one of 9/26/2023 3:02:05 PM, 10/6/2023 6:15:21 PM, 10/9/2023 8:09:24 PM falls between 10/1/2023 7:44:15 AM and 10/9/2023 8:09:24 PM.
IsImprovementStdDev: Marked as improvement because 5.814909976015443 (T) = (0 -873.0458348535511) / Math.Sqrt((2103.967269422832 / (202)) + (9250.933045461225 / (9))) is greater than 1.9713794615474485 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (202) + (9) - 2, .975) and 0.1766960953497901 = (1060.4174593638963 - 873.0458348535511) / 1060.4174593638963 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Reflection.Attributes.IsDefinedClassMissInherit

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.2560451866463977 < 2.439121416929429.
IsChangePoint: Marked as a change because one of 9/26/2023 3:02:05 PM, 10/5/2023 8:44:34 AM, 10/9/2023 8:09:24 PM falls between 10/1/2023 7:44:15 AM and 10/9/2023 8:09:24 PM.
IsImprovementStdDev: Marked as improvement because 4.674705099880963 (T) = (0 -2112.6124750709782) / Math.Sqrt((24776.47908217787 / (194)) + (21540.105801987313 / (15))) is greater than 1.9714903918671234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (194) + (15) - 2, .975) and 0.08046078226023763 = (2297.468595481771 - 2112.6124750709782) / 2297.468595481771 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Reflection.Attributes.GetCustomAttributesClassMissInherit

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 3.838732766035882 < 3.9367214641433605.
IsChangePoint: Marked as a change because one of 9/26/2023 3:02:05 PM, 10/6/2023 6:15:21 PM, 10/9/2023 8:09:24 PM falls between 10/1/2023 7:44:15 AM and 10/9/2023 8:09:24 PM.
IsImprovementStdDev: Marked as improvement because 5.3645628111331325 (T) = (0 -3385.5779596449606) / Math.Sqrt((35251.45826711169 / (199)) + (62888.336876884874 / (9))) is greater than 1.9715466694451473 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (199) + (9) - 2, .975) and 0.1182610276804632 = (3839.6601102236955 - 3385.5779596449606) / 3839.6601102236955 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Reflection.Attributes.GetCustomAttributesMethodBaseMiss

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.124120484965163 < 2.1623263077560226.
IsChangePoint: Marked as a change because one of 9/26/2023 6:21:18 AM, 10/6/2023 6:15:21 PM, 10/9/2023 8:09:24 PM falls between 10/1/2023 7:44:15 AM and 10/9/2023 8:09:24 PM.
IsImprovementStdDev: Marked as improvement because 5.442740462356708 (T) = (0 -1959.4648568474934) / Math.Sqrt((5873.137002346294 / (199)) + (11160.531929375125 / (9))) is greater than 1.9715466694451473 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (199) + (9) - 2, .975) and 0.09005805439546914 = (2153.3954625486567 - 1959.4648568474934) / 2153.3954625486567 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository