[Perf] Windows/x64: 8 Regressions on 3/18/2024 6:21:23 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	21f23f91a0c29d91f69013d561e82bd0960c95e1
Compare	a184e7de59f58591d464685b2355ba87aef281e3
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ImmutableDictionary - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	35.60 μs	37.99 μs	1.07	0.04	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse<String, String>*'

System.Collections.ContainsKeyFalse<String, String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	21f23f91a0c29d91f69013d561e82bd0960c95e1
Compare	a184e7de59f58591d464685b2355ba87aef281e3
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FixedTimeEquals_256Bit_FirstBitDifferent - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	126.26 ns	135.62 ns	1.07	0.04	False
FixedTimeEquals_256Bit_VersusZero - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	126.25 ns	135.62 ns	1.07	0.04	False
FixedTimeEquals_256Bit_Equal - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	126.25 ns	135.63 ns	1.07	0.04	False
FixedTimeEquals_256Bit_AllBitsDifferent - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	126.24 ns	135.63 ns	1.07	0.04	False
FixedTimeEquals_256Bit_CascadingErrors - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	126.23 ns	135.62 ns	1.07	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals*'

System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_FirstBitDifferent

ETL Files

Histogram

JIT Disasms

System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_VersusZero

ETL Files

Histogram

JIT Disasms

System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_Equal

ETL Files

Histogram

JIT Disasms

System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_AllBitsDifferent

ETL Files

Histogram

JIT Disasms

System.Security.Cryptography.Primitives.Tests.Performance.Perf_FixedTimeEquals.FixedTimeEquals_256Bit_CascadingErrors

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	21f23f91a0c29d91f69013d561e82bd0960c95e1
Compare	a184e7de59f58591d464685b2355ba87aef281e3
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ImmutableDictionary - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	18.92 μs	20.31 μs	1.07	0.01	False
ConcurrentDictionary - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.34 μs	2.51 μs	1.87	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue<Int32, Int32>*'

System.Collections.TryGetValueTrue<Int32, Int32>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<Int32, Int32>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[LoopedBard3]

Immutable dictionary looks like potential regression, the rest look like noise.