Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Perf] Linux/x64: 543 Regressions on 2/26/2024 3:11:13 PM #30270

Open
performanceautofiler bot opened this issue Feb 29, 2024 · 23 comments
Open

[Perf] Linux/x64: 543 Regressions on 2/26/2024 3:11:13 PM #30270

performanceautofiler bot opened this issue Feb 29, 2024 · 23 comments
Labels
arch-wasm arch-x64 branch-refs/heads/main kind-micro os-linux perf-regression untriaged

Comments

@performanceautofiler
Copy link

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
18.20 ns 27.05 ns 1.49 0.42 False
6.67 ns 8.73 ns 1.31 0.53 False
19.44 ns 26.80 ns 1.38 0.49 False
10.49 ns 13.91 ns 1.33 0.67 False
13.17 ns 14.56 ns 1.11 0.16 False
32.51 ns 37.48 ns 1.15 0.26 False
34.34 ns 41.52 ns 1.21 0.32 False
38.39 ns 41.33 ns 1.08 0.19 False
14.29 ns 17.04 ns 1.19 0.47 False
19.05 ns 23.19 ns 1.22 0.43 False
18.19 ns 22.63 ns 1.24 0.40 False
32.89 ns 39.92 ns 1.21 0.30 False
18.02 ns 24.81 ns 1.38 0.37 False
9.81 ns 15.60 ns 1.59 0.63 False
6.30 ns 7.46 ns 1.18 0.57 False
34.99 ns 42.34 ns 1.21 0.27 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_String

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
353.13 ns 389.06 ns 1.10 0.09 False
450.22 ns 542.34 ns 1.20 0.10 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'

Payloads

Baseline
Compare

System.Tests.Perf_String.Concat_str_str_str(size: 100)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Concat_str_str_str_str(size: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_PriorityQueue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
786.27 ns 880.99 ns 1.12 0.11 False
6.40 μs 7.17 μs 1.12 0.12 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;String, String&gt;*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_PriorityQueue<String, String>.Enumerate(Size: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.Enumerate(Size: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.07 ns 30.01 ns 1.15 0.31 False
10.20 ns 13.22 ns 1.30 0.64 False
26.50 ns 30.58 ns 1.15 0.34 False
25.69 ns 38.25 ns 1.49 0.35 False
7.29 ns 17.87 ns 2.45 0.55 False
10.27 ns 13.21 ns 1.29 0.55 False
6.32 ns 14.77 ns 2.34 0.58 False
14.41 ns 17.79 ns 1.23 0.56 False
26.77 ns 30.58 ns 1.14 0.37 False
26.34 ns 29.27 ns 1.11 0.35 False
27.55 ns 35.79 ns 1.30 0.31 False
12.90 ns 15.81 ns 1.23 0.55 False
26.75 ns 31.37 ns 1.17 0.31 False
25.18 ns 32.69 ns 1.30 0.30 False
26.32 ns 36.08 ns 1.37 0.33 False
34.12 ns 39.36 ns 1.15 0.16 False
14.29 ns 17.84 ns 1.25 0.49 False
25.98 ns 31.58 ns 1.22 0.29 False
10.98 ns 14.30 ns 1.30 0.49 False
6.78 ns 10.68 ns 1.57 0.59 False
14.38 ns 22.21 ns 1.54 0.56 False
9.99 ns 12.94 ns 1.30 0.63 False
9.78 ns 12.59 ns 1.29 0.53 False
17.33 ns 21.02 ns 1.21 0.38 False
5.20 ns 7.26 ns 1.40 0.57 False
26.20 ns 30.73 ns 1.17 0.32 False
26.92 ns 31.63 ns 1.17 0.29 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.NegateBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
16.11 ns 22.39 ns 1.39 0.59 False
15.23 ns 22.19 ns 1.46 0.61 False
16.31 ns 22.75 ns 1.39 0.59 False
41.28 ns 44.96 ns 1.09 0.35 False
24.20 ns 31.71 ns 1.31 0.44 False
39.69 ns 48.13 ns 1.21 0.28 False
42.79 ns 46.43 ns 1.08 0.32 False
40.48 ns 48.80 ns 1.21 0.31 False
38.52 ns 45.53 ns 1.18 0.16 False
13.80 ns 20.62 ns 1.49 0.50 False
16.18 ns 20.38 ns 1.26 0.63 False
15.50 ns 21.95 ns 1.42 0.64 False
14.45 ns 21.03 ns 1.46 0.64 False
6.90 ns 8.72 ns 1.26 0.56 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualsAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualsBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
32.25 ns 41.08 ns 1.27 0.13 False
11.62 ns 18.95 ns 1.63 0.58 False
11.80 ns 17.21 ns 1.46 0.59 False
23.42 ns 25.90 ns 1.11 0.38 False
8.25 ns 11.37 ns 1.38 0.57 False
23.77 ns 29.10 ns 1.22 0.36 False
23.41 ns 27.79 ns 1.19 0.30 False
13.35 ns 15.95 ns 1.19 0.57 False
24.65 ns 28.09 ns 1.14 0.32 False
7.93 ns 12.36 ns 1.56 0.58 False
23.95 ns 27.23 ns 1.14 0.38 False
5.96 ns 7.65 ns 1.28 0.57 False
24.07 ns 30.29 ns 1.26 0.32 False
8.02 ns 12.24 ns 1.53 0.57 False
33.01 ns 37.45 ns 1.13 0.17 False
24.87 ns 26.82 ns 1.08 0.34 False
23.13 ns 25.77 ns 1.11 0.33 False
15.15 ns 18.41 ns 1.21 0.17 False
24.27 ns 30.43 ns 1.25 0.34 False
12.83 ns 15.05 ns 1.17 0.60 False
23.42 ns 27.36 ns 1.17 0.35 False
23.67 ns 29.95 ns 1.27 0.33 False
24.21 ns 27.22 ns 1.12 0.34 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt64&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<UInt64>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsStaticBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt64>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
10.12 ns 14.95 ns 1.48 0.52 False
26.93 ns 32.37 ns 1.20 0.33 False
26.64 ns 33.41 ns 1.25 0.33 False
25.34 ns 33.94 ns 1.34 0.33 False
10.58 ns 14.63 ns 1.38 0.60 False
27.69 ns 30.70 ns 1.11 0.33 False
37.62 ns 43.30 ns 1.15 0.21 False
26.24 ns 29.69 ns 1.13 0.35 False
25.87 ns 34.39 ns 1.33 0.39 False
13.54 ns 18.09 ns 1.34 0.57 False
9.71 ns 14.79 ns 1.52 0.55 False
26.16 ns 31.26 ns 1.19 0.30 False
26.54 ns 35.76 ns 1.35 0.36 False
27.49 ns 29.46 ns 1.07 0.37 False
29.36 ns 31.42 ns 1.07 0.35 False
27.13 ns 29.42 ns 1.08 0.32 False
25.39 ns 29.59 ns 1.17 0.27 False
13.32 ns 23.40 ns 1.76 0.49 False
9.78 ns 13.08 ns 1.34 0.60 False
14.36 ns 19.88 ns 1.38 0.54 False
12.66 ns 15.45 ns 1.22 0.51 False
26.95 ns 29.33 ns 1.09 0.33 False
15.05 ns 18.17 ns 1.21 0.55 False
9.85 ns 13.04 ns 1.32 0.60 False
26.44 ns 30.07 ns 1.14 0.36 False
25.73 ns 29.12 ns 1.13 0.48 False
39.48 ns 44.37 ns 1.12 0.21 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.48 ns 13.27 ns 1.40 0.55 False
71.34 ns 81.07 ns 1.14 0.06 False
68.33 ns 80.80 ns 1.18 0.08 False
43.15 ns 54.76 ns 1.27 0.12 False
9.87 ns 14.04 ns 1.42 0.58 False
40.26 ns 49.58 ns 1.23 0.21 False
45.35 ns 55.89 ns 1.23 0.17 False
33.14 ns 37.40 ns 1.13 0.29 False
14.40 ns 15.62 ns 1.08 0.12 False
16.66 ns 20.39 ns 1.22 0.33 False
9.94 ns 15.19 ns 1.53 0.58 False
5.82 ns 7.05 ns 1.21 0.57 False
45.06 ns 54.19 ns 1.20 0.09 False
30.30 ns 37.08 ns 1.22 0.28 False
10.34 ns 13.43 ns 1.30 0.60 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.77 ns 11.36 ns 1.16 0.49 False
31.94 ns 39.46 ns 1.24 0.31 False
6.11 ns 9.43 ns 1.54 0.54 False
43.17 ns 53.64 ns 1.24 0.22 False
8.44 ns 12.64 ns 1.50 0.47 False
15.74 ns 18.47 ns 1.17 0.23 False
45.06 ns 49.08 ns 1.09 0.23 False
29.94 ns 40.05 ns 1.34 0.24 False
44.41 ns 50.56 ns 1.14 0.18 False
44.12 ns 53.89 ns 1.22 0.22 False
8.15 ns 16.83 ns 2.06 0.52 False
54.21 ns 59.28 ns 1.09 0.19 False
7.86 ns 11.46 ns 1.46 0.54 False
43.85 ns 50.12 ns 1.14 0.20 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAnyBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
11.47 ns 17.41 ns 1.52 0.70 False
37.01 ns 42.41 ns 1.15 0.26 False
19.17 ns 25.50 ns 1.33 0.39 False
20.11 ns 25.45 ns 1.27 0.42 False
20.81 ns 23.00 ns 1.11 0.43 False
12.70 ns 18.60 ns 1.46 0.58 False
11.05 ns 14.80 ns 1.34 0.63 False
19.03 ns 22.04 ns 1.16 0.39 False
6.95 ns 14.62 ns 2.10 0.62 False
37.47 ns 41.76 ns 1.11 0.39 False
12.98 ns 16.60 ns 1.28 0.56 False
19.45 ns 26.80 ns 1.38 0.35 False
18.08 ns 20.51 ns 1.13 0.45 False
57.61 ns 67.02 ns 1.16 0.24 False
10.89 ns 16.63 ns 1.53 0.56 False
18.99 ns 26.43 ns 1.39 0.43 False
10.31 ns 16.65 ns 1.62 0.47 False
10.67 ns 14.36 ns 1.34 0.61 False
16.59 ns 23.60 ns 1.42 0.46 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector4*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector4.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.DivideByScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.MultiplyByScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.DistanceSquaredJitOptimizeCanaryBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.LengthSquaredBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.MultiplyFunctionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.EqualsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.DistanceBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.MultiplyByScalarOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.ClampBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.DivideOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.DistanceSquaredBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector4.AbsBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.77 ns 31.67 ns 1.18 0.37 False
6.31 ns 7.72 ns 1.22 0.60 False
23.87 ns 30.10 ns 1.26 0.35 False
42.73 ns 45.03 ns 1.05 0.16 False
32.89 ns 35.30 ns 1.07 0.37 False
41.56 ns 46.58 ns 1.12 0.19 False
8.44 ns 14.25 ns 1.69 0.51 False
24.34 ns 30.30 ns 1.25 0.33 False
41.54 ns 47.91 ns 1.15 0.19 False
15.64 ns 18.98 ns 1.21 0.26 False
52.27 ns 60.74 ns 1.16 0.11 False
53.28 ns 61.48 ns 1.15 0.14 False
37.94 ns 45.65 ns 1.20 0.25 False
9.67 ns 12.29 ns 1.27 0.45 False
5.73 ns 10.36 ns 1.81 0.57 False
22.23 ns 30.29 ns 1.36 0.36 False
22.52 ns 33.56 ns 1.49 0.31 False
8.02 ns 11.46 ns 1.43 0.55 False
7.79 ns 11.30 ns 1.45 0.55 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int16&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsStaticBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
15.53 ns 16.57 ns 1.07 0.20 False
18.79 ns 28.38 ns 1.51 0.49 False
8.06 ns 11.27 ns 1.40 0.52 False
16.53 ns 20.02 ns 1.21 0.52 False
30.91 ns 33.44 ns 1.08 0.30 False
15.61 ns 20.23 ns 1.30 0.53 False
31.85 ns 40.76 ns 1.28 0.21 False
16.47 ns 20.51 ns 1.25 0.52 False
31.23 ns 33.53 ns 1.07 0.24 False
31.85 ns 39.87 ns 1.25 0.22 False
17.59 ns 20.31 ns 1.15 0.54 False
8.65 ns 13.26 ns 1.53 0.55 False
6.66 ns 7.67 ns 1.15 0.55 False
8.11 ns 14.62 ns 1.80 0.54 False
29.43 ns 32.70 ns 1.11 0.27 False
29.06 ns 33.37 ns 1.15 0.29 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<UInt32>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsStaticBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
30.75 ns 35.95 ns 1.17 0.25 False
65.66 ns 76.96 ns 1.17 0.07 False
9.64 ns 16.17 ns 1.68 0.57 False
43.42 ns 55.18 ns 1.27 0.10 False
6.39 ns 7.65 ns 1.20 0.53 False
10.97 ns 14.63 ns 1.33 0.58 False
9.85 ns 12.94 ns 1.31 0.59 False
9.88 ns 13.25 ns 1.34 0.55 False
14.62 ns 16.00 ns 1.09 0.12 False
59.10 ns 62.21 ns 1.05 0.10 False
65.31 ns 79.19 ns 1.21 0.08 False
71.70 ns 80.90 ns 1.13 0.05 False
38.01 ns 49.61 ns 1.31 0.20 False
44.16 ns 54.13 ns 1.23 0.13 False
43.63 ns 58.10 ns 1.33 0.14 False
44.21 ns 59.23 ns 1.34 0.19 False
30.51 ns 36.84 ns 1.21 0.26 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
18.51 ns 23.17 ns 1.25 0.40 False
33.44 ns 39.96 ns 1.19 0.29 False
33.59 ns 39.41 ns 1.17 0.27 False
10.33 ns 13.88 ns 1.34 0.67 False
37.16 ns 40.28 ns 1.08 0.30 False
17.65 ns 23.60 ns 1.34 0.43 False
5.57 ns 6.76 ns 1.21 0.52 False
9.88 ns 15.32 ns 1.55 0.64 False
33.00 ns 38.02 ns 1.15 0.33 False
9.64 ns 17.12 ns 1.78 0.67 False
18.33 ns 23.60 ns 1.29 0.46 False
18.34 ns 24.46 ns 1.33 0.42 False
13.95 ns 19.17 ns 1.37 0.15 False
36.27 ns 40.62 ns 1.12 0.34 False
9.67 ns 14.74 ns 1.53 0.60 False
40.37 ns 44.40 ns 1.10 0.24 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Matrix4x4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
31.00 ns 38.98 ns 1.26 0.44 False
22.42 ns 25.93 ns 1.16 0.35 False
21.89 ns 26.53 ns 1.21 0.40 False
22.44 ns 25.36 ns 1.13 0.33 False
26.83 ns 30.98 ns 1.15 0.47 False
42.50 ns 55.61 ns 1.31 0.27 False
42.13 ns 49.91 ns 1.18 0.29 False
41.74 ns 47.54 ns 1.14 0.26 False
56.81 ns 59.69 ns 1.05 0.25 False
48.45 ns 53.90 ns 1.11 0.20 False
48.42 ns 58.29 ns 1.20 0.22 False
40.97 ns 45.53 ns 1.11 0.22 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromScalarXYZ

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.IdentityBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateTranslationFromVectorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZWithCenterBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYWithCenterBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateOrthographicOffCenterBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
19.58 ns 21.30 ns 1.09 0.45 False
18.18 ns 21.71 ns 1.19 0.39 False
18.37 ns 25.03 ns 1.36 0.40 False
23.90 ns 31.77 ns 1.33 0.46 False
14.39 ns 18.74 ns 1.30 0.21 False
10.37 ns 13.81 ns 1.33 0.55 False
18.64 ns 22.61 ns 1.21 0.38 False
9.78 ns 13.40 ns 1.37 0.61 False
19.15 ns 24.61 ns 1.29 0.41 False
16.00 ns 22.91 ns 1.43 0.42 False
20.31 ns 25.81 ns 1.27 0.42 False
22.20 ns 26.23 ns 1.18 0.30 False
29.97 ns 40.54 ns 1.35 0.30 False
32.44 ns 37.58 ns 1.16 0.28 False
18.08 ns 25.81 ns 1.43 0.42 False
17.96 ns 26.49 ns 1.47 0.41 False
17.73 ns 24.87 ns 1.40 0.42 False
17.94 ns 21.64 ns 1.21 0.35 False
13.55 ns 19.17 ns 1.42 0.23 False
18.87 ns 24.94 ns 1.32 0.38 False
10.24 ns 17.36 ns 1.70 0.54 False
18.67 ns 23.81 ns 1.28 0.37 False
19.87 ns 21.80 ns 1.10 0.41 False
11.70 ns 18.10 ns 1.55 0.45 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector3*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector3.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.SubtractFunctionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.NormalizeBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.CreateFromVector2WithScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.LengthSquaredBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.AddFunctionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.MultiplyByScalarOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.DivideByScalarOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.CrossBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.NegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.DivideByVector3OperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.SubtractOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.DivideByVector3Benchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.CreateFromScalar

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.MultiplyFunctionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.MultiplyByScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector3.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
10.44 ns 13.01 ns 1.25 0.62 False
34.21 ns 45.85 ns 1.34 0.27 False
38.41 ns 43.06 ns 1.12 0.24 False
19.56 ns 25.00 ns 1.28 0.48 False
34.46 ns 38.92 ns 1.13 0.33 False
14.51 ns 16.47 ns 1.14 0.52 False
18.43 ns 23.16 ns 1.26 0.44 False
9.47 ns 19.88 ns 2.10 0.64 False
10.42 ns 13.25 ns 1.27 0.63 False
34.44 ns 37.64 ns 1.09 0.27 False
10.56 ns 13.10 ns 1.24 0.64 False
5.51 ns 7.06 ns 1.28 0.54 False
19.67 ns 23.73 ns 1.21 0.39 False
18.47 ns 22.81 ns 1.23 0.42 False
19.28 ns 24.71 ns 1.28 0.41 False
38.02 ns 42.73 ns 1.12 0.13 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.80 μs 4.46 μs 1.17 0.25 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;Guid, Guid&gt;*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
56.87 ns 60.93 ns 1.07 0.22 False
45.37 ns 48.30 ns 1.06 0.26 False
67.82 ns 99.74 ns 1.47 0.24 False
69.70 ns 97.82 ns 1.40 0.13 False
71.54 ns 76.91 ns 1.08 0.19 False
152.18 ns 165.18 ns 1.09 0.15 False
21.48 ns 47.15 ns 2.20 0.52 True
23.06 ns 372.53 ns 16.15 0.54 True
59.60 ns 87.28 ns 1.46 0.15 False
34.76 ns 42.49 ns 1.22 0.39 False
18.28 ns 66.59 ns 3.64 0.54 True
63.50 ns 92.14 ns 1.45 0.23 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Byte>.BinarySearch(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.BinarySearch(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceCompareTo(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceCompareTo(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.BinarySearch(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceEqual(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Fill(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Fill(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceCompareToDifferent(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.LastIndexOfValue(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Fill(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceCompareToDifferent(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Double

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
10.88 ms 13.80 ms 1.27 0.18 False
10.80 ms 12.65 ms 1.17 0.24 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Double*'

Payloads

Baseline
Compare

System.Tests.Perf_Double.IsNaN(value: NaN)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Double.IsNaN(value: 0)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
40.39 ns 45.18 ns 1.12 0.34 False
19.82 ns 26.90 ns 1.36 0.45 False
55.60 ns 61.15 ns 1.10 0.23 False
14.22 ns 21.55 ns 1.52 0.61 False
14.62 ns 21.69 ns 1.48 0.54 False
29.51 ns 32.85 ns 1.11 0.36 False
40.44 ns 44.53 ns 1.10 0.34 False
38.26 ns 43.73 ns 1.14 0.35 False
14.21 ns 20.31 ns 1.43 0.56 False
17.24 ns 22.71 ns 1.32 0.53 False
30.35 ns 32.86 ns 1.08 0.34 False
38.56 ns 44.58 ns 1.16 0.35 False
18.06 ns 19.78 ns 1.10 0.56 False
15.12 ns 20.31 ns 1.34 0.53 False
38.08 ns 44.62 ns 1.17 0.30 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.82 ns 33.31 ns 1.20 0.30 False
25.48 ns 32.87 ns 1.29 0.30 False
26.07 ns 32.47 ns 1.25 0.36 False
48.30 ns 52.46 ns 1.09 0.17 False
43.24 ns 50.41 ns 1.17 0.19 False
21.51 ns 30.32 ns 1.41 0.42 False
10.24 ns 15.29 ns 1.49 0.56 False
9.84 ns 13.25 ns 1.35 0.62 False
43.76 ns 53.70 ns 1.23 0.20 False
47.55 ns 53.44 ns 1.12 0.15 False
5.38 ns 6.59 ns 1.23 0.53 False
10.29 ns 15.18 ns 1.48 0.53 False
59.02 ns 64.86 ns 1.10 0.13 False
27.43 ns 32.86 ns 1.20 0.28 False
33.74 ns 40.55 ns 1.20 0.30 False
9.62 ns 13.31 ns 1.38 0.56 False
44.69 ns 51.34 ns 1.15 0.14 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
23.28 ns 30.47 ns 1.31 0.32 False
12.56 ns 15.13 ns 1.20 0.58 False
24.50 ns 27.88 ns 1.14 0.33 False
8.61 ns 11.97 ns 1.39 0.52 False
22.50 ns 25.93 ns 1.15 0.36 False
24.41 ns 30.95 ns 1.27 0.36 False
8.02 ns 12.03 ns 1.50 0.51 False
24.74 ns 27.07 ns 1.09 0.34 False
31.42 ns 38.54 ns 1.23 0.28 False
23.20 ns 26.59 ns 1.15 0.42 False
13.21 ns 16.33 ns 1.24 0.49 False
8.04 ns 11.80 ns 1.47 0.51 False
23.29 ns 27.34 ns 1.17 0.34 False
23.23 ns 29.11 ns 1.25 0.32 False
23.55 ns 27.07 ns 1.15 0.34 False
15.27 ns 18.25 ns 1.19 0.22 False
23.87 ns 29.06 ns 1.22 0.38 False
24.82 ns 27.68 ns 1.12 0.36 False
23.72 ns 31.45 ns 1.33 0.35 False
11.81 ns 15.08 ns 1.28 0.63 False
35.49 ns 42.13 ns 1.19 0.21 False
14.42 ns 15.56 ns 1.08 0.17 False
12.83 ns 15.32 ns 1.19 0.57 False
8.36 ns 11.17 ns 1.34 0.51 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int64&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Int64>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsStaticBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.AndNotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.CastingPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.12 ms 1.29 ms 1.15 0.29 False
1.16 ms 1.29 ms 1.11 0.26 False
1.02 ms 1.41 ms 1.39 0.44 False
1.39 ms 1.60 ms 1.16 0.21 False
1.38 ms 1.73 ms 1.25 0.22 False
1.02 ms 1.33 ms 1.30 0.39 False
5.23 ms 5.53 ms 1.06 0.07 False
1.38 ms 1.60 ms 1.16 0.25 False
5.21 ms 5.51 ms 1.06 0.09 False
804.69 μs 995.40 μs 1.24 0.11 False
1.38 ms 1.89 ms 1.37 0.24 False
1.65 ms 1.96 ms 1.18 0.28 False
1.38 ms 1.49 ms 1.08 0.24 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf*'

Payloads

Baseline
Compare

PerfLabTests.CastingPerf.CheckObjIsInterfaceYes

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.CheckIsInstAnyIsInterfaceYes

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.CheckIsInstAnyIsInterfaceNo

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.FooObjIsFoo

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.IntObj

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.CheckObjIsInterfaceNo

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.IFooObjIsIFooInterAlia

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.FooObjIsFoo2

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.IFooObjIsIFoo

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.ObjObjrefValueType

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.ScalarValueTypeObj

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.FooObjCastIfIsa

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf.ObjrefValueTypeObj

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.LowLevelPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
483.47 μs 1.03 ms 2.12 0.45 False
576.67 μs 1.01 ms 1.74 0.52 False
460.91 μs 591.96 μs 1.28 0.59 False
517.54 μs 919.32 μs 1.78 0.32 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'

Payloads

Baseline
Compare

PerfLabTests.LowLevelPerf.StaticIntPlus

ETL Files

Histogram

JIT Disasms

PerfLabTests.LowLevelPerf.ObjectStringIsString

ETL Files

Histogram

JIT Disasms

PerfLabTests.LowLevelPerf.GenericClassWithIntGenericInstanceField

ETL Files

Histogram

JIT Disasms

PerfLabTests.LowLevelPerf.GenericClassGenericStaticField

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
155.39 ns 168.98 ns 1.09 0.18 False
273.87 ns 297.76 ns 1.09 0.11 False
59.90 ns 88.62 ns 1.48 0.33 False
45.14 ns 48.41 ns 1.07 0.25 False
46.71 ns 51.91 ns 1.11 0.36 False
58.87 ns 90.53 ns 1.54 0.29 False
58.84 ns 95.68 ns 1.63 0.26 False
57.69 ns 90.55 ns 1.57 0.36 False
136.63 ns 226.79 ns 1.66 0.16 False
162.73 ns 171.61 ns 1.05 0.17 False
95.16 ns 122.15 ns 1.28 0.18 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Char&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Char>.StartsWith(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceEqual(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceCompareToDifferent(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.BinarySearch(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfValue(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceCompareToDifferent(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceCompareTo(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceCompareToDifferent(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.Clear(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.EndsWith(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceCompareTo(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.CastingPerf2.CastingPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.75 ms 2.55 ms 1.46 0.19 False
5.95 ms 6.30 ms 1.06 0.08 False
5.04 ms 5.39 ms 1.07 0.15 False
2.78 ms 3.83 ms 1.38 0.25 False
1.76 ms 2.18 ms 1.24 0.19 False
1.70 ms 2.36 ms 1.39 0.38 False
1.56 ms 1.82 ms 1.16 0.18 False
1.74 ms 2.11 ms 1.22 0.28 False
1.81 ms 2.24 ms 1.23 0.17 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'

Payloads

Baseline
Compare

PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFooInterAlia

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.ObjObjrefValueType

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.ObjInt

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.FooObjIsFoo

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsIFoo

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.IntObj

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.FooObjCastIfIsa

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.FooObjIsDescendant

ETL Files

Histogram

JIT Disasms

PerfLabTests.CastingPerf2.CastingPerf.IFooObjIsDescendantOfIFoo

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_LengthBucketsFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.38 ms 1.52 ms 1.10 0.22 False
1.22 ms 1.32 ms 1.08 0.18 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_LengthBucketsFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_LengthBucketsFrozenDictionary.ToFrozenDictionary(Count: 10000, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.ToFrozenDictionary(Count: 10000, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.73 ns 21.59 ns 1.57 0.54 False
25.33 ns 29.89 ns 1.18 0.38 False
22.74 ns 28.17 ns 1.24 0.45 False
26.25 ns 29.95 ns 1.14 0.42 False
14.34 ns 19.80 ns 1.38 0.52 False
15.79 ns 20.21 ns 1.28 0.48 False
14.22 ns 20.37 ns 1.43 0.52 False
22.69 ns 29.88 ns 1.32 0.35 False
22.52 ns 28.76 ns 1.28 0.45 False
25.98 ns 28.27 ns 1.09 0.43 False
25.41 ns 30.38 ns 1.20 0.32 False
26.73 ns 33.21 ns 1.24 0.41 False
26.99 ns 32.89 ns 1.22 0.35 False
37.05 ns 46.99 ns 1.27 0.24 False
15.27 ns 18.43 ns 1.21 0.22 False
15.23 ns 19.08 ns 1.25 0.57 False
25.41 ns 29.08 ns 1.14 0.43 False
12.82 ns 38.21 ns 2.98 0.53 False
14.54 ns 20.80 ns 1.43 0.58 False
26.02 ns 28.40 ns 1.09 0.37 False
13.97 ns 19.95 ns 1.43 0.57 False
21.59 ns 28.61 ns 1.33 0.45 False
24.59 ns 34.80 ns 1.42 0.37 False
26.98 ns 34.33 ns 1.27 0.38 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Double&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Double>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.MathBenchmarks.Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
44.77 μs 47.43 μs 1.06 0.07 False
54.71 μs 59.01 μs 1.08 0.10 False
40.86 μs 43.28 μs 1.06 0.16 False
51.47 μs 55.42 μs 1.08 0.07 False
78.10 μs 87.55 μs 1.12 0.07 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.Single*'

Payloads

Baseline
Compare

System.MathBenchmarks.Single.Acos

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.AsinPi

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.Tan

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.AcosPi

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.Min

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
36.45 ns 42.12 ns 1.16 0.21 False
18.31 ns 21.68 ns 1.18 0.64 False
14.60 ns 18.91 ns 1.30 0.12 False
41.11 ns 45.18 ns 1.10 0.33 False
16.02 ns 22.50 ns 1.40 0.64 False
15.20 ns 20.89 ns 1.37 0.65 False
14.95 ns 20.71 ns 1.39 0.62 False
38.13 ns 41.73 ns 1.09 0.18 False
7.02 ns 8.24 ns 1.17 0.56 False
18.68 ns 24.46 ns 1.31 0.62 False
14.68 ns 25.17 ns 1.71 0.61 False
40.53 ns 48.22 ns 1.19 0.36 False
15.78 ns 18.57 ns 1.18 0.53 False
17.53 ns 21.71 ns 1.24 0.61 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
43.38 ns 48.63 ns 1.12 0.37 False
65.63 ns 75.38 ns 1.15 0.26 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0)

ETL Files

Histogram

JIT Disasms

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 0)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.63 ns 32.35 ns 1.17 0.34 False
15.21 ns 25.07 ns 1.65 0.64 False
15.19 ns 23.34 ns 1.54 0.59 False
15.71 ns 20.46 ns 1.30 0.58 False
29.49 ns 33.25 ns 1.13 0.27 False
30.33 ns 34.04 ns 1.12 0.26 False
14.62 ns 21.22 ns 1.45 0.65 False
24.86 ns 32.23 ns 1.30 0.55 False
12.15 ns 15.00 ns 1.23 0.56 False
14.53 ns 23.90 ns 1.65 0.64 False
25.26 ns 31.01 ns 1.23 0.58 False
28.88 ns 32.32 ns 1.12 0.32 False
27.76 ns 29.78 ns 1.07 0.30 False
29.86 ns 33.47 ns 1.12 0.34 False
28.14 ns 32.79 ns 1.17 0.35 False
15.42 ns 20.73 ns 1.34 0.64 False
30.21 ns 33.76 ns 1.12 0.24 False
28.79 ns 32.70 ns 1.14 0.37 False
14.94 ns 22.86 ns 1.53 0.57 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
45.63 ns 53.43 ns 1.17 0.10 False
28.10 ns 33.23 ns 1.18 0.27 False
25.61 ns 33.96 ns 1.33 0.30 False
43.77 ns 51.00 ns 1.17 0.12 False
25.88 ns 36.56 ns 1.41 0.24 False
34.54 ns 44.18 ns 1.28 0.26 False
19.07 ns 20.22 ns 1.06 0.34 False
10.01 ns 13.36 ns 1.34 0.52 False
5.19 ns 7.11 ns 1.37 0.57 False
48.32 ns 54.25 ns 1.12 0.12 False
59.20 ns 62.83 ns 1.06 0.12 False
43.24 ns 50.63 ns 1.17 0.15 False
27.72 ns 32.69 ns 1.18 0.28 False
10.79 ns 16.56 ns 1.54 0.55 False
22.39 ns 27.75 ns 1.24 0.38 False
49.49 ns 52.22 ns 1.06 0.14 False
6.23 ns 8.71 ns 1.40 0.52 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanAnyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MinBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanOrEqualAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanAllBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SumBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MaxBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IndexerSetReverse<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.84 μs 4.26 μs 1.11 0.28 False
23.31 μs 28.57 μs 1.23 0.19 False
6.02 μs 7.29 μs 1.21 0.16 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSetReverse&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.IndexerSetReverse<String>.Span(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IndexerSetReverse<String>.IList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IndexerSetReverse<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Primitives.StringSegmentBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
46.09 ns 50.20 ns 1.09 0.26 False
9.42 ns 16.92 ns 1.80 0.55 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Primitives.StringSegmentBenchmark*'

Payloads

Baseline
Compare

Microsoft.Extensions.Primitives.StringSegmentBenchmark.Ctor_String

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.StringSegmentBenchmark.Equals_Object_Invalid

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
227.81 ns 252.20 ns 1.11 0.09 False
136.06 ns 155.51 ns 1.14 0.15 False
91.66 ns 107.43 ns 1.17 0.28 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 16,16 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: -2147483648)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 123)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
11.06 ms 12.87 ms 1.16 0.22 False
10.50 ms 12.16 ms 1.16 0.22 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'

Payloads

Baseline
Compare

System.Tests.Perf_Single.IsNaN(value: 0)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Single.IsNaN(value: NaN)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
37.78 ns 44.82 ns 1.19 0.20 False
27.91 ns 31.53 ns 1.13 0.34 False
32.22 ns 37.14 ns 1.15 0.33 False
27.07 ns 32.01 ns 1.18 0.30 False
25.73 ns 29.54 ns 1.15 0.32 False
25.90 ns 38.76 ns 1.50 0.35 False
28.19 ns 30.68 ns 1.09 0.32 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertFloatToIntBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertDoubleToLongBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertIntToFloatBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.CeilingDoubleBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertLongToDoubleBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertULongToDoubleBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.FloorDoubleBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Guid

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.83 ns 7.42 ns 1.27 0.71 False
33.96 ns 47.27 ns 1.39 0.44 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Guid*'

Payloads

Baseline
Compare

System.Tests.Perf_Guid.NotEqualsOperator

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Guid.TryWriteBytes

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.76 μs 3.27 μs 1.18 0.27 False
2.23 μs 2.77 μs 1.24 0.33 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_BitArray*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_BitArray.BitArraySetLengthGrow(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_BitArray.BitArrayByteArrayCtor(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.90 μs 34.29 μs 1.28 0.20 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
10.15 ns 16.23 ns 1.60 0.76 False
10.60 ns 14.94 ns 1.41 0.76 False
7.04 ns 9.71 ns 1.38 0.70 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark*'

Payloads

Baseline
Compare

Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.Indexer_FirstElement_String

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.Count_Array

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.Count_String

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Plane

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
23.96 ns 30.68 ns 1.28 0.32 False
14.03 ns 15.96 ns 1.14 0.58 False
11.42 ns 17.55 ns 1.54 0.59 False
6.86 ns 11.52 ns 1.68 0.59 False
19.66 ns 26.11 ns 1.33 0.42 False
16.37 ns 22.68 ns 1.39 0.40 False
12.57 ns 14.23 ns 1.13 0.60 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Plane*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Plane.NormalizeBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Plane.DotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Plane.DotCoordinateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Plane.EqualsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Plane.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Plane.EqualityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Plane.DotNormalBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.MemoryMarshal<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
105.18 ns 123.19 ns 1.17 0.11 False
26.50 ns 30.61 ns 1.16 0.38 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.MemoryMarshal&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Memory.MemoryMarshal<Int32>.TryGetArray

ETL Files

Histogram

JIT Disasms

System.Memory.MemoryMarshal<Int32>.CastToByte

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Perf_Convert

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.97 μs 5.43 μs 1.09 0.10 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Perf_Convert*'

Payloads

Baseline
Compare

System.Perf_Convert.ToBase64CharArray(binaryDataSize: 1024, formattingOptions: None)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Matrix3x2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
53.14 ns 62.62 ns 1.18 0.26 False
19.08 ns 22.58 ns 1.18 0.43 False
18.68 ns 22.97 ns 1.23 0.44 False
28.50 ns 31.90 ns 1.12 0.37 False
19.28 ns 23.37 ns 1.21 0.45 False
40.80 ns 49.78 ns 1.22 0.20 False
39.33 ns 42.15 ns 1.07 0.17 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Matrix3x2.IsIdentityBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix3x2.IdentityBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromVectorWithCenterBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix3x2.CreateScaleFromScalarXYBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix3x2.CreateSkewFromScalarXYWithCenterBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix3x2.CreateSkewFromScalarXYBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
57.67 ns 68.14 ns 1.18 0.20 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Quaternion.CreateFromAxisAngleBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IndexerSet<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.18 μs 4.77 μs 1.14 0.23 False
6.56 μs 7.01 μs 1.07 0.12 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSet&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.IndexerSet<String>.Span(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IndexerSet<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.MemoryMarshal<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
107.76 ns 123.60 ns 1.15 0.16 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.MemoryMarshal&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.MemoryMarshal<Byte>.TryGetArray

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Strings

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
620.90 ms 675.43 ms 1.09 0.11 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

Payloads

Baseline
Compare

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: AllEscaped)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.SearchValuesByteTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
780.12 ns 864.61 ns 1.11 0.07 False
118.11 ns 155.86 ns 1.32 0.15 False
129.68 ns 156.33 ns 1.21 0.13 False
115.17 ns 149.65 ns 1.30 0.16 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.SearchValuesByteTests*'

Payloads

Baseline
Compare

System.Buffers.Tests.SearchValuesByteTests.IndexOfAnyExcept(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesByteTests.IndexOfAny(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesByteTests.IndexOfAnyExcept(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesByteTests.ContainsAny(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.MathBenchmarks.MathTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.58 ns 16.08 ns 1.18 0.54 False
0.00 ns 11.41 ns ∞ 0.55 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.MathTests*'

Payloads

Baseline
Compare

System.MathBenchmarks.MathTests.DivRemInt64

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.MathTests.DivRemInt32

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddDefaultSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
68.55 μs 73.54 μs 1.07 0.07 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.TryAddDefaultSize<Int32>.Dictionary(Count: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorDefaultSize<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
494.51 ns 520.60 ns 1.05 0.19 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorDefaultSize&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.CtorDefaultSize<String>.ConcurrentQueue

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Uri

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.56 μs 3.80 μs 1.07 0.11 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Uri*'

Payloads

Baseline
Compare

System.Tests.Perf_Uri.DnsSafeHost

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Hashing.Tests.Crc32_GetCurrentHashPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
76.64 ns 151.09 ns 1.97 0.31 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Hashing.Tests.Crc32_GetCurrentHashPerf*'

Payloads

Baseline
Compare

System.IO.Hashing.Tests.Crc32_GetCurrentHashPerf.GetCurrentHash

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

performanceautofiler bot commented Feb 29, 2024 •
edited
Loading

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
396.23 ns 432.86 ns 1.09 0.12 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Char&gt;*'

Payloads

Baseline
Compare

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetMemory

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.32 secs 1.58 secs 1.20 0.32 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests*'

Payloads

Baseline
Compare

System.Buffers.Text.Tests.Base64EncodeDecodeInPlaceTests.Base64DecodeInPlace(NumberOfBytes: 200000000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyTrue<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
25.84 μs 33.67 μs 1.30 0.18 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyTrue<Int32, Int32>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
28.81 μs 33.49 μs 1.16 0.13 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.AddGivenSize<Int32>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in Lowering.InstructionReplacement

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
7.23 ns 10.26 ns 1.42 0.36 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Lowering.InstructionReplacement*'

Payloads

Baseline
Compare

Lowering.InstructionReplacement.TESTtoBT

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
193.17 μs 203.63 μs 1.05 0.15 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

Payloads

Baseline
Compare

System.Text.Json.Document.Tests.Perf_EnumerateObject.Parse(TestCase: StringProperties)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Xml.Linq.Perf_XName

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
22.84 ns 27.40 ns 1.20 0.58 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Linq.Perf_XName*'

Payloads

Baseline
Compare

System.Xml.Linq.Perf_XName.EmptyNameSpaceToString

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Char

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.97 ns 14.58 ns 1.12 0.55 False
11.98 ns 14.75 ns 1.23 0.46 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Char*'

Payloads

Baseline
Compare

System.Tests.Perf_Char.GetUnicodeCategory(c: '.')

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.GetUnicodeCategory(c: 'a')

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Text.Tests.Base64Tests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.85 μs 5.78 μs 1.19 0.10 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Base64Tests*'

Payloads

Baseline
Compare

System.Buffers.Text.Tests.Base64Tests.ConvertToBase64CharArray(NumberOfBytes: 1000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.ReadOnlySpan

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
17.33 ns 19.19 ns 1.11 0.42 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySpan*'

Payloads

Baseline
Compare

System.Memory.ReadOnlySpan.StringAsSpan

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Tests.Perf_Thread

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
17.37 ns 24.60 ns 1.42 0.51 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_Thread*'

Payloads

Baseline
Compare

System.Threading.Tests.Perf_Thread.GetCurrentProcessorId

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Xml.Linq.Perf_XDocument

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
30.05 ns 37.38 ns 1.24 0.48 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Linq.Perf_XDocument*'

Payloads

Baseline
Compare

System.Xml.Linq.Perf_XDocument.GetRootElement

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in ByteMark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.34 secs 4.46 secs 1.34 0.47 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'ByteMark*'

Payloads

Baseline
Compare

ByteMark.BenchNumericSortJagged

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Globalization.Tests.Perf_CultureInfo

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
25.60 ns 38.37 ns 1.50 0.48 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.Perf_CultureInfo*'

Payloads

Baseline
Compare

System.Globalization.Tests.Perf_CultureInfo.GetCurrentCulture

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 5ef47c852ffd51aaeb52e34391fe4fed261c9f26
Compare 597d647327a446f052d210d799a3440d23d7bdba
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Hashing

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
22.39 μs 27.20 μs 1.21 0.11 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Hashing*'

Payloads

Baseline
Compare

System.Hashing.GetStringHashCode(BytesCount: 10000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler performanceautofiler bot mentioned this issue Feb 29, 2024
Closed
@lewing
Copy link
Member

lewing commented Feb 29, 2024 •
edited
Loading

I expect dotnet/runtime#99115 will help at least a few of these regressions and we're assuming the interpreter SSA are responsible for the rest at the moment but since there are no recent AOT runs results I'm not entirely confident.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-wasm arch-x64 branch-refs/heads/main kind-micro os-linux perf-regression untriaged
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@lewing