[Perf] Linux/x64: 9 Regressions on 1/30/2025 8:36:04 AM +00:00

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f3d90b2f622691253225ddcd61b8ae8a087955ae
Compare	4e01649f4a39bc2d9ee0e758736a7d90954fed14
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Boolean

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryParse - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	20.25 ns	28.83 ns	1.42	0.40	False
Parse - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	51.54 ns	55.78 ns	1.08	0.22	False
Parse - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	25.41 ns	30.54 ns	1.20	0.25	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Boolean*'

System.Tests.Perf_Boolean.TryParse(value: "False")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.Parse(value: " True ")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.Parse(value: "false")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f3d90b2f622691253225ddcd61b8ae8a087955ae
Compare	7afd807da79b99c2d1b4b2e03b5e147836178fe2
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.SearchValuesByteTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ContainsAny - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	51.34 ns	59.72 ns	1.16	0.21	False
Contains - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	8.91 ns	10.78 ns	1.21	0.50	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.SearchValuesByteTests*'

System.Buffers.Tests.SearchValuesByteTests.ContainsAny(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesByteTests.Contains(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f3d90b2f622691253225ddcd61b8ae8a087955ae
Compare	4e01649f4a39bc2d9ee0e758736a7d90954fed14
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Binary.Tests.BinaryReadAndWriteTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadStructFieldByFieldUsingBitConverterBE - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	80.53 ns	97.40 ns	1.21	0.15	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'

System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterBE

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	d551abb68de9ed473a505a84fd60244ba11bca74
Compare	4e01649f4a39bc2d9ee0e758736a7d90954fed14
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
MaxMagnitude_Vector - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.29 μs	1.41 μs	1.09	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.MaxMagnitude_Vector(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	d551abb68de9ed473a505a84fd60244ba11bca74
Compare	7afd807da79b99c2d1b4b2e03b5e147836178fe2
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SubstringFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_True_FrozenDictionary - Duration of single invocation ADX - Test Multi Config Graph	550.37 μs	610.69 μs	1.11	0.18	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SubstringFrozenDictionary*'

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f3d90b2f622691253225ddcd61b8ae8a087955ae
Compare	7afd807da79b99c2d1b4b2e03b5e147836178fe2
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.BinaryReaderTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadBool - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	10.97 ns	15.02 ns	1.37	0.50	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryReaderTests*'

System.IO.Tests.BinaryReaderTests.ReadBool

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

this is dotnet/runtime#111743, looks like mixed results, there are also improvements in #49554