[Perf] Windows/x64: 1 Regression on 9/22/2023 12:22:36 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	aba7c43598dc13e7e43843dceb57a397f13107cb
Compare	a54ccf39b17586e7c2a38b882e80a3cc62d83d7d
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
BitArrayCopyToBoolArray - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	151.58 ns	170.64 ns	1.13	0.02	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_BitArray*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_BitArray.BitArrayCopyToBoolArray(Size: 512)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 170.6383085197187 > 161.6065324408566.
IsChangePoint: Marked as a change because one of 9/21/2023 3:30:33 PM, 9/25/2023 11:21:57 AM falls between 9/16/2023 7:32:07 PM and 9/25/2023 11:21:57 AM.
IsRegressionStdDev: Marked as regression because -19.019298250773364 (T) = (0 -177.67693964102955) / Math.Sqrt((9.812496741382795 / (30)) + (18.52370345468312 / (15))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (15) - 2, .025) and -0.15444618486776243 = (153.90664542876183 - 177.67693964102955) / 153.90664542876183 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository