[Perf] Linux/x64: 2 Regressions on 7/26/2023 12:02:55 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	8f5364695b107f37af899aba3ad1b9f98d577c33
Compare	7ebf9676b4e37c183072f97efaa21e6b4a7d33f3
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IsPrefix_FirstHalf - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	24.54 ns	28.21 ns	1.15	0.15	False
IsSuffix_SecondHalf - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	25.02 ns	28.38 ns	1.13	0.12	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringSearch*'

Payloads

Baseline
Compare

System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, OrdinalIgnoreCase, False))

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.209316393189734 > 25.756247052041513.
IsChangePoint: Marked as a change because one of 4/26/2023 8:04:03 AM, 5/19/2023 10:30:38 AM, 7/25/2023 7:04:35 PM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsRegressionStdDev: Marked as regression because -27.168781487900855 (T) = (0 -28.413156818883625) / Math.Sqrt((0.18642222428216895 / (12)) + (0.0646147477581603 / (25))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (12) + (25) - 2, .025) and -0.14772926284074225 = (24.755974896517216 - 28.413156818883625) / 24.755974896517216 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, OrdinalIgnoreCase, False))

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.38312961135578 > 26.701965451278763.
IsChangePoint: Marked as a change because one of 5/16/2023 5:40:18 PM, 7/25/2023 7:04:35 PM, 8/3/2023 7:53:20 AM falls between 7/25/2023 7:04:35 PM and 8/3/2023 7:53:20 AM.
IsRegressionStdDev: Marked as regression because -28.528007229869093 (T) = (0 -28.445015878634766) / Math.Sqrt((0.12616739298519591 / (11)) + (0.014425751251219672 / (26))) is less than -2.0301079282477414 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (26) - 2, .025) and -0.12356605354980216 = (25.316727742677337 - 28.445015878634766) / 25.316727742677337 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[cincuranet]

dotnet/runtime#89059