[Perf] Linux/x64: 3 Regressions on 10/8/2023 11:25:37 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	a2d0a12769879de68bdfa75e4401d330e2925a1e
Compare	d3a782e3bb6ad0c1cb590b41c3f03e733f7d0d61
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToArray - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	172.70 ns	192.22 ns	1.11	0.22	False
LastIndexOfValue - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	100.95 ns	790.02 ns	7.83	0.33	True
LastIndexOfValue - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	47.14 ns	152.33 ns	3.23	0.49	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Byte>*'

Payloads

Baseline
Compare

System.Memory.Span<Byte>.ToArray(Size: 512)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 192.21591993331126 > 182.8945927041184.
IsChangePoint: Marked as a change because one of 10/8/2023 9:33:54 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsRegressionStdDev: Marked as regression because -2.876584137611313 (T) = (0 -195.17283207770575) / Math.Sqrt((18.19114565385522 / (36)) + (553.1162793685585 / (12))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (36) + (12) - 2, .025) and -0.11186521177743498 = (175.53641395587977 - 195.17283207770575) / 175.53641395587977 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Memory.Span<Byte>.LastIndexOfValue(Size: 512)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 790.0158504311416 > 108.22396183797026.
IsChangePoint: Marked as a change because one of 10/3/2023 2:46:17 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsRegressionStdDev: Marked as regression because -752.5524413603114 (T) = (0 -790.9452079112747) / Math.Sqrt((8.994566430155492 / (16)) + (8.719558117788143 / (32))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (32) - 2, .025) and -6.6478303455040555 = (103.42086215030241 - 790.9452079112747) / 103.42086215030241 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

System.Memory.Span<Byte>.LastIndexOfValue(Size: 33)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 152.32888376093882 > 49.86671296689385.
IsChangePoint: Marked as a change because one of 10/3/2023 2:46:17 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsRegressionStdDev: Marked as regression because -60.59961416964099 (T) = (0 -152.22742360364617) / Math.Sqrt((29.299640582552957 / (16)) + (31.470832115256822 / (32))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (32) - 2, .025) and -2.010874694021209 = (50.559202581870665 - 152.22742360364617) / 50.559202581870665 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository