Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	7568ca398689b60841a9753f2777e5b3407a6d45
Compare	64f7fab10afa8dc7fca817a554070607648eae38
Diff	Diff

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterInt32 - Duration of single invocation	1.83 ns	4.71 ns	2.58	0.54	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.705460713835775 > 1.9172362760235513.
IsChangePoint: Marked as a change because one of 1/21/2023 1:51:00 AM, 1/25/2023 11:59:01 PM falls between 1/17/2023 11:08:46 AM and 1/25/2023 11:59:01 PM.
IsRegressionStdDev: Marked as regression because -17.948001637125667 (T) = (0 -5.15830760168831) / Math.Sqrt((0.4702231425596768 / (26)) + (0.08762632214038191 / (17))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (17) - 2, .025) and -1.1296012944001799 = (2.422194058226843 - 5.15830760168831) / 2.422194058226843 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[ghost]

Tagging subscribers to this area: @dotnet/area-system-buffers
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	7568ca398689b60841a9753f2777e5b3407a6d45
Compare	64f7fab10afa8dc7fca817a554070607648eae38
Diff	Diff

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterInt32 - Duration of single invocation	1.83 ns	4.71 ns	2.58	0.54	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.705460713835775 > 1.9172362760235513.
IsChangePoint: Marked as a change because one of 1/21/2023 1:51:00 AM, 1/25/2023 11:59:01 PM falls between 1/17/2023 11:08:46 AM and 1/25/2023 11:59:01 PM.
IsRegressionStdDev: Marked as regression because -17.948001637125667 (T) = (0 -5.15830760168831) / Math.Sqrt((0.4702231425596768 / (26)) + (0.08762632214038191 / (17))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (17) - 2, .025) and -1.1296012944001799 = (2.422194058226843 - 5.15830760168831) / 2.422194058226843 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Author:	performanceautofiler[bot]
Assignees:	tannergooding
Labels:	area-System.Buffers
Milestone:	-

[cincuranet]

Related regression #80745. Although it's a different commit range and different OS.

Maybe cause by #80888 or #80932.

[tannergooding]

The general code here had a number of refactorings to allow sharing between UTF-8 and UTF-16. Some minor regressions were expected and while this isn't the fastest its been all release, its still faster than it was in .NET 6/7.