[Perf] Alpine/x64: 2 Regressions on 10/17/2022 8:10:07 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in System.Collections.ContainsFalse<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableHashSet - Duration of single invocation	16.82 μs	18.15 μs	1.08	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse<Int32>*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.ContainsFalse<Int32>.ImmutableHashSet(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 18.14501603197674 > 17.58210508296608.
IsChangePoint: Marked as a change because one of 7/28/2022 3:42:13 AM, 9/29/2022 7:42:19 AM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -18.637978000196696 (T) = (0 -17900.997050911585) / Math.Sqrt((3726.6627707398275 / (17)) + (102737.08567829084 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.06943206465019985 = (16738.78841174153 - 17900.997050911585) / 16738.78841174153 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	alpine 3.15
Baseline	59f14ac45408d557bd6b423e7a9c175adc85e125
Compare	8393c4eb74afecaa70267b2a94b9b94c1d1ae384
Diff	Diff

Regressions in System.Text.Json.Reader.Tests.Perf_Base64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadBase64EncodedByteArray_HeavyEscaping - Duration of single invocation	74.64 ns	87.96 ns	1.18	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Reader.Tests.Perf_Base64*'

Related Issues

Regressions

Improvements

• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM
• [Perf] Windows/arm64: 2 Improvements on 10/17/2022 8:10:07 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 100)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 87.96439957906996 > 78.53404535506068.
IsChangePoint: Marked as a change because one of 7/14/2022 11:03:46 PM, 7/28/2022 3:42:13 AM, 10/14/2022 9:06:25 AM, 10/17/2022 3:19:47 PM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsRegressionStdDev: Marked as regression because -5.880574007639856 (T) = (0 -88.1412880878175) / Math.Sqrt((38.80267924182863 / (17)) + (6.7040027268491595 / (28))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (28) - 2, .025) and -0.11850771312300672 = (78.80257512191537 - 88.1412880878175) / 78.80257512191537 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository