[Perf] Linux/arm64: 25 Regressions on 1/3/2024 11:26:14 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	9.30 μs	9.77 μs	1.05	0.00	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse<String, String>*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyFalse<String, String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
LastIndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	777.39 ns	955.31 ns	1.23	0.02	True
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	764.65 ns	918.99 ns	1.20	0.02	False
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	548.58 ns	627.24 ns	1.14	0.01	True
LastIndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	550.64 ns	624.74 ns	1.13	0.01	True
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	548.93 ns	627.03 ns	1.14	0.01	True
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	765.15 ns	914.83 ns	1.20	0.03	False
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	548.20 ns	626.93 ns	1.14	0.01	True
LastIndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	550.88 ns	624.49 ns	1.13	0.00	True
LastIndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	551.30 ns	622.67 ns	1.13	0.01	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringSearch*'

Payloads

Baseline
Compare

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, False))

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Memory.ReadOnlySpan

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexOfString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	281.85 ns	305.54 ns	1.08	0.00	True
IndexOfString - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	39.53 ns	41.72 ns	1.06	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySpan*'

Payloads

Baseline
Compare

System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "x", comparisonType: InvariantCultureIgnoreCase)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "foobardzsdzs", value: "rddzs", comparisonType: InvariantCulture)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsTrue<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenSet - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	9.81 μs	10.39 μs	1.06	0.00	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<String>*'

Payloads

Baseline
Compare

System.Collections.ContainsTrue<String>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexOfAnyFiveValues - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.12 μs	1.37 μs	1.23	0.01	True
SequenceEqual - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	10.19 ns	14.66 ns	1.44	0.37	False
IndexOfAnyFiveValues - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	70.45 ns	91.03 ns	1.29	0.01	True
IndexOfAnyFourValues - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	10.17 ns	11.76 ns	1.16	0.10	False
IndexOfAnyFiveValues - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	11.71 ns	13.54 ns	1.16	0.04	False
IndexOfAnyFourValues - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	949.71 ns	1.20 μs	1.27	0.00	True
IndexOfAnyFourValues - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	59.72 ns	79.48 ns	1.33	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Int32>*'

Payloads

Baseline
Compare

System.Memory.Span<Int32>.IndexOfAnyFiveValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.SequenceEqual(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFiveValues(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFiveValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionaryOptimized - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	9.30 μs	9.98 μs	1.07	0.00	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<String, String>*'

Payloads

Baseline
Compare

System.Collections.TryGetValueFalse<String, String>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.Perf_DefaultFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	19.47 μs	21.31 μs	1.09	0.01	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_DefaultFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsKeyTrue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	10.05 μs	10.68 μs	1.06	0.00	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue<String, String>*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyTrue<String, String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateFor<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadOnlySpan - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	205.29 ns	222.17 ns	1.08	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateFor<String>*'

Payloads

Baseline
Compare

System.Collections.IterateFor<String>.ReadOnlySpan(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 20.04
Queue	AmpereUbuntu
Baseline	653739cc0e4f6c7a44e4cda6c9ac8bb2a265505a
Compare	db90a849eab60d9843b8151ab14ba998faee3825
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateForEach<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadOnlySpan - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	205.29 ns	222.18 ns	1.08	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<String>*'

Payloads

Baseline
Compare

System.Collections.IterateForEach<String>.ReadOnlySpan(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository