[Perf] Linux/x64: 878 Regressions on 4/17/2023 1:30:24 AM

[performanceautofiler]

No description provided.

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
LessThanOrEqualBenchmark - Duration of single invocation	2.64 ns	54.17 ns	20.55	0.52	False
LessThanAnyBenchmark - Duration of single invocation	2.22 ns	24.01 ns	10.82	0.68	False
BitwiseAndOperatorBenchmark - Duration of single invocation	6.62 ns	51.96 ns	7.85	0.63	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	4.02 ns	21.47 ns	5.35	0.66	False
SubtractionOperatorBenchmark - Duration of single invocation	3.67 ns	32.77 ns	8.92	0.55	False
GreaterThanOrEqualBenchmark - Duration of single invocation	3.14 ns	42.00 ns	13.37	0.58	False
GreaterThanAnyBenchmark - Duration of single invocation	2.60 ns	30.39 ns	11.68	0.56	False
DotBenchmark - Duration of single invocation	3.21 ns	47.35 ns	14.73	0.65	False
OneBenchmark - Duration of single invocation	2.17 ns	23.04 ns	10.62	0.69	False
BitwiseOrBenchmark - Duration of single invocation	3.50 ns	53.74 ns	15.34	0.62	True
LessThanBenchmark - Duration of single invocation	3.42 ns	56.11 ns	16.40	0.55	False
AndNotBenchmark - Duration of single invocation	3.03 ns	86.90 ns	28.71	0.62	True
DivisionOperatorBenchmark - Duration of single invocation	27.38 ns	38.92 ns	1.42	0.36	False
DivideBenchmark - Duration of single invocation	26.86 ns	59.78 ns	2.23	0.42	False
MaxBenchmark - Duration of single invocation	5.08 ns	35.24 ns	6.94	0.56	False
EqualsAnyBenchmark - Duration of single invocation	2.97 ns	32.03 ns	10.80	0.66	False
AddBenchmark - Duration of single invocation	3.13 ns	42.21 ns	13.47	0.61	False
EqualsStaticBenchmark - Duration of single invocation	3.31 ns	42.23 ns	12.74	0.57	False
MultiplyBenchmark - Duration of single invocation	3.16 ns	38.74 ns	12.25	0.52	False
InequalityOperatorBenchmark - Duration of single invocation	2.41 ns	18.66 ns	7.74	0.63	False
LessThanAllBenchmark - Duration of single invocation	2.14 ns	37.09 ns	17.31	0.62	False
CountBenchmark - Duration of single invocation	0.00 ns	15.02 ns	∞	0.89	True
AbsBenchmark - Duration of single invocation	2.72 ns	36.57 ns	13.45	0.58	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.51 ns	52.18 ns	14.88	0.64	True
XorBenchmark - Duration of single invocation	3.38 ns	52.66 ns	15.58	0.62	True
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.36 ns	33.99 ns	14.43	0.60	False
EqualityOperatorBenchmark - Duration of single invocation	2.28 ns	24.07 ns	10.55	0.65	False
MultiplyOperatorBenchmark - Duration of single invocation	3.40 ns	37.05 ns	10.89	0.57	False
AddOperatorBenchmark - Duration of single invocation	3.33 ns	35.98 ns	10.80	0.54	False
GreaterThanAllBenchmark - Duration of single invocation	2.65 ns	18.27 ns	6.90	0.71	False
EqualsAllBenchmark - Duration of single invocation	1.85 ns	25.23 ns	13.62	0.69	False
BitwiseAndBenchmark - Duration of single invocation	3.22 ns	55.50 ns	17.26	0.59	True
NegateBenchmark - Duration of single invocation	3.23 ns	21.17 ns	6.55	0.56	False
SquareRootBenchmark - Duration of single invocation	23.59 ns	35.28 ns	1.50	0.55	False
MinBenchmark - Duration of single invocation	4.02 ns	37.36 ns	9.29	0.57	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	4.28 ns	52.22 ns	12.21	0.60	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.42 ns	21.63 ns	8.93	0.66	False
ZeroBenchmark - Duration of single invocation	0.54 ns	16.49 ns	30.36	0.68	True
LessThanOrEqualAllBenchmark - Duration of single invocation	2.72 ns	34.79 ns	12.80	0.61	False
GreaterThanBenchmark - Duration of single invocation	3.20 ns	40.87 ns	12.78	0.61	False
ConditionalSelectBenchmark - Duration of single invocation	3.61 ns	188.22 ns	52.19	0.52	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.16798541812665 > 3.0653890813298394.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.89920327018151 (T) = (0 -56.18857948445784) / Math.Sqrt((1.8718292391634987 / (26)) + (16.608575929091508 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.722793189311478 = (3.5737021283632626 - 56.18857948445784) / 3.5737021283632626 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.01048189002807 > 2.4958080005851735.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.275459939363472 (T) = (0 -21.359832338193442) / Math.Sqrt((0.16804964314305806 / (25)) + (10.815677324944305 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.941847766390955 = (2.388749271540612 - 21.359832338193442) / 2.388749271540612 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.95657877838576 > 4.223760865324427.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -75.33519657635391 (T) = (0 -52.95489758034532) / Math.Sqrt((1.55589153022133 / (26)) + (2.952287075655654 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.633251793667295 = (3.6188058763030475 - 52.95489758034532) / 3.6188058763030475 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.472309001015955 > 2.553366858471512.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.03436430289079 (T) = (0 -21.4833332923002) / Math.Sqrt((0.33058312864771033 / (27)) + (1.1112668933339231 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.87884666694536 = (2.419608548065087 - 21.4833332923002) / 2.419608548065087 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.76638227639365 > 3.5404655053298173.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.07369376180106 (T) = (0 -33.174710077346326) / Math.Sqrt((0.41359576359552963 / (26)) + (6.73754674466326 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.57796305202318 = (3.4636498279598955 - 33.174710077346326) / 3.4636498279598955 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.9997121222025 > 3.3725580284466763.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -47.967538796303735 (T) = (0 -42.1288465860344) / Math.Sqrt((0.45358173246250266 / (26)) + (5.084782392220165 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.516908495056407 = (3.3657549388232186 - 42.1288465860344) / 3.3657549388232186 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.38998249301822 > 2.7518934737900844.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.381104566994107 (T) = (0 -34.02302367342594) / Math.Sqrt((0.5820184086590767 / (26)) + (7.815328673634732 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.82492758670048 = (2.6528823218236335 - 34.02302367342594) / 2.6528823218236335 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.352483765045044 > 2.871434771289251.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -81.06647281657247 (T) = (0 -48.22347256598251) / Math.Sqrt((0.9903572076576049 / (27)) + (2.209748786071597 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.7614201933898 = (2.8770517062152288 - 48.22347256598251) / 2.8770517062152288 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.036494704363815 > 2.2092019049726774.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.57092128853981 (T) = (0 -23.658200269604592) / Math.Sqrt((0.19512385766462173 / (27)) + (5.710022097478616 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.158603938446944 = (1.9457990727697416 - 23.658200269604592) / 1.9457990727697416 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.74404444449736 > 3.439340225061919.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -81.1047594652398 (T) = (0 -52.08352428980895) / Math.Sqrt((1.1402768467789075 / (26)) + (2.5490948667223017 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.013777100373478 = (3.2524197110620605 - 52.08352428980895) / 3.2524197110620605 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.10750186112065 > 3.5725950145538223.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -61.63060457781174 (T) = (0 -55.13364734494672) / Math.Sqrt((2.847309517354188 / (26)) + (4.660723409059959 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.277813696411046 = (3.8614908778929813 - 55.13364734494672) / 3.8614908778929813 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.90259420663519 > 3.2735633740062284.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.739977124876702 (T) = (0 -92.28874985744721) / Math.Sqrt((0.8328488092079289 / (27)) + (82.38539851951121 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -28.43061563700478 = (3.1358076567520845 - 92.28874985744721) / 3.1358076567520845 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.921347258827666 > 28.39924195741034.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.23826819787029 (T) = (0 -39.7700345132407) / Math.Sqrt((1.7506097390644515 / (27)) + (2.8033269275884587 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.45289990503945937 = (27.372866069642 - 39.7700345132407) / 27.372866069642 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.77899856771558 > 29.91146156916689.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -11.649489137334315 (T) = (0 -50.4989057669636) / Math.Sqrt((5.331425407114084 / (27)) + (23.43547382907793 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.7679301495241436 = (28.56385801246497 - 50.4989057669636) / 28.56385801246497 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.24412831471567 > 3.442534305353264.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -75.08376830768039 (T) = (0 -36.41182251999765) / Math.Sqrt((0.9162613417798607 / (27)) + (1.2612415989636452 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.265986632183942 = (3.54684102216209 - 36.41182251999765) / 3.54684102216209 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.02877830811611 > 2.7602481660135947.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.902264137096385 (T) = (0 -34.03872572508933) / Math.Sqrt((0.24703781272878056 / (27)) + (10.992378668935787 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.187905648397143 = (2.3991367414354636 - 34.03872572508933) / 2.3991367414354636 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.20504395791361 > 3.347955759795375.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.22730171620986 (T) = (0 -42.79915747525203) / Math.Sqrt((1.2921404407803663 / (27)) + (3.982328024062037 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.294307783015357 = (3.48121734306825 - 42.79915747525203) / 3.48121734306825 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.22792080210086 > 3.4098156987020163.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.299020652054256 (T) = (0 -43.992144325523505) / Math.Sqrt((0.34603139242152664 / (27)) + (56.514496676651 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.36190671549684 = (3.2923552949596933 - 43.992144325523505) / 3.2923552949596933 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.743051571783795 > 3.3545908645657576.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.826590823125677 (T) = (0 -43.108297322982054) / Math.Sqrt((1.156776798982404 / (27)) + (23.817229164233982 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.531736866815343 = (3.439929977873614 - 43.108297322982054) / 3.439929977873614 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.65786086544779 > 2.901853149250611.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.010023582682738 (T) = (0 -19.547348926469823) / Math.Sqrt((0.4292275263823156 / (27)) + (4.536141293263436 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.126409653337922 = (2.7429448877267513 - 19.547348926469823) / 2.7429448877267513 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.087380012311876 > 2.2529173323924203.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.6003137366688 (T) = (0 -34.149388430739336) / Math.Sqrt((0.7925711495181175 / (25)) + (23.13905096556014 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -13.575456803425718 = (2.342937781731348 - 34.149388430739336) / 2.342937781731348 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.017667742759667 > 0.026717417618965303.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -57.91604182403817 (T) = (0 -15.221034747624397) / Math.Sqrt((0.1275615874452138 / (26)) + (0.5021497253534201 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -97.50486332583465 = (0.15452064226794793 - 15.221034747624397) / 0.15452064226794793 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.57292922464698 > 3.390350007147762.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.17604404633653 (T) = (0 -34.447466448078295) / Math.Sqrt((0.7335523893607707 / (27)) + (17.051595635892202 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.328696805199469 = (3.335122242211373 - 34.447466448078295) / 3.335122242211373 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.1846089703213 > 3.563685671897814.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -57.354168240098986 (T) = (0 -54.824076218820224) / Math.Sqrt((0.7655749256048617 / (25)) + (6.2235821311143384 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -15.864352758526175 = (3.250885284708161 - 54.824076218820224) / 3.250885284708161 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.656663957477456 > 3.4699749754446882.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.87002754411365 (T) = (0 -55.348339488521766) / Math.Sqrt((0.28854549319399736 / (27)) + (19.87038860706431 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.119554078767058 = (3.4336148021257924 - 55.348339488521766) / 3.4336148021257924 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.993825401469714 > 2.610854549926647.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.16575388385737 (T) = (0 -33.811471775753574) / Math.Sqrt((1.1233973099432595 / (27)) + (4.675432872204377 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.978997975717638 = (2.8225626086833024 - 33.811471775753574) / 2.8225626086833024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.073333461052886 > 2.4168122809968895.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.506605068689364 (T) = (0 -18.90885488846404) / Math.Sqrt((0.8648380776738006 / (27)) + (7.7406329224998505 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.860781235157663 = (2.4054676402764423 - 18.90885488846404) / 2.4054676402764423 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.04623947101046 > 3.581314133798355.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.215690402719765 (T) = (0 -34.07706495142257) / Math.Sqrt((0.8785158307074479 / (27)) + (21.99821208931663 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.227971699121069 = (3.6928011986283282 - 34.07706495142257) / 3.6928011986283282 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.98164363745333 > 3.4683645102797493.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.764645751393047 (T) = (0 -34.44150913458415) / Math.Sqrt((1.1102860616333632 / (25)) + (14.30417146526929 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -8.499524158319772 = (3.6256036155684654 - 34.44150913458415) / 3.6256036155684654 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.265659432930597 > 2.3797320649673646.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.0237002488067 (T) = (0 -19.907576014909885) / Math.Sqrt((1.5875707395429368 / (27)) + (4.656204814430738 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.741859709914215 = (2.2772701319299986 - 19.907576014909885) / 2.2772701319299986 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.23040622841963 > 2.3382397899466505.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.03562054265381 (T) = (0 -27.794886462004737) / Math.Sqrt((0.3056138497446048 / (27)) + (10.581314090262733 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.857165404944977 = (2.3441425933396363 - 27.794886462004737) / 2.3441425933396363 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.502003505737214 > 3.7923976595919644.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.32115045878633 (T) = (0 -52.741350209747694) / Math.Sqrt((1.2145054044887607 / (27)) + (1.4971574970915755 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -15.34939424130478 = (3.22589017252413 - 52.741350209747694) / 3.22589017252413 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.165587764516026 > 3.3712915432372697.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.34275203388377 (T) = (0 -21.559833174986302) / Math.Sqrt((0.19520378716753908 / (27)) + (1.6595632730870695 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.4722182525034 = (3.331135065886744 - 21.559833174986302) / 3.331135065886744 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.27641688783711 > 24.980473433253806.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.347696106937775 (T) = (0 -38.93645678309719) / Math.Sqrt((2.879762927687095 / (26)) + (18.0833026117313 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.586503924745984 = (24.54230095228496 - 38.93645678309719) / 24.54230095228496 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.36047726942916 > 3.589292609887536.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.16997081941598 (T) = (0 -39.26973286770108) / Math.Sqrt((0.47102441767213826 / (26)) + (17.386402817066223 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.252474449162388 = (3.4898753198790193 - 39.26973286770108) / 3.4898753198790193 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.217738736835386 > 3.462530638384635.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -77.92244258604013 (T) = (0 -53.32655755758436) / Math.Sqrt((0.5255865878250805 / (26)) + (3.128657619111798 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.904186725778615 = (3.3529886486524303 - 53.32655755758436) / 3.3529886486524303 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.63326572449848 > 2.693651814005424.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.2585879062939 (T) = (0 -20.179238401090128) / Math.Sqrt((0.2727386344783603 / (27)) + (3.903451729019416 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.572727702061198 = (2.3538877125699793 - 20.179238401090128) / 2.3538877125699793 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.4938080205736 > 2.052167686796375.
IsChangePoint: Marked as a change because one of 3/1/2023 10:00:31 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.55432112542064 (T) = (0 -16.630308596526596) / Math.Sqrt((0.25434389808629143 / (27)) + (0.8256895035293981 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.260549321858786 = (2.0132206646984163 - 16.630308596526596) / 2.0132206646984163 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.79389996224881 > 2.502889850518936.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.776994783855592 (T) = (0 -33.36643229861797) / Math.Sqrt((0.882800393746014 / (25)) + (8.93738831747966 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -12.491133947152761 = (2.4732118463370383 - 33.36643229861797) / 2.4732118463370383 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.871179236051084 > 3.4146425530630213.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.960064403143125 (T) = (0 -42.36156801846026) / Math.Sqrt((0.4748472485638607 / (27)) + (17.79622292092737 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.138803408948384 = (3.489764731442352 - 42.36156801846026) / 3.489764731442352 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int32>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 188.22236548922865 > 3.6005357470719237.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -111.31662325889322 (T) = (0 -181.40942786207358) / Math.Sqrt((0.3349498566008524 / (27)) + (20.344168369000638 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -51.40026886937317 = (3.4619942182797367 - 181.40942786207358) / 3.4619942182797367 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToDictionary - Duration of single invocation	8.34 μs	9.99 μs	1.20	0.27	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Payloads

Baseline
Compare

Histogram

System.Linq.Tests.Perf_Enumerable.ToDictionary(input: IEnumerable)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.987701276763778 > 8.60192589803295.
IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -8.82552520101482 (T) = (0 -9656.101623713734) / Math.Sqrt((106706.57963841168 / (27)) + (173016.80567837195 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.1712043778107357 = (8244.591470673397 - 9656.101623713734) / 8244.591470673397 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ZeroBenchmark - Duration of single invocation	2.08 ns	16.62 ns	7.99	0.67	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.35 ns	51.53 ns	21.96	0.60	False
MaxBenchmark - Duration of single invocation	2.91 ns	55.28 ns	19.00	0.59	False
GreaterThanBenchmark - Duration of single invocation	4.41 ns	68.20 ns	15.48	0.59	False
OnesComplementBenchmark - Duration of single invocation	4.10 ns	41.81 ns	10.20	0.64	True
AbsBenchmark - Duration of single invocation	3.12 ns	48.45 ns	15.51	0.58	False
EqualsStaticBenchmark - Duration of single invocation	3.71 ns	56.46 ns	15.23	0.59	False
GreaterThanAnyBenchmark - Duration of single invocation	2.54 ns	26.45 ns	10.43	0.67	False
LessThanOrEqualBenchmark - Duration of single invocation	3.09 ns	54.36 ns	17.57	0.55	False
XorBenchmark - Duration of single invocation	5.05 ns	48.93 ns	9.69	0.63	True
BitwiseOrBenchmark - Duration of single invocation	3.48 ns	48.62 ns	13.96	0.64	True
SumBenchmark - Duration of single invocation	2.15 ns	33.79 ns	15.69	0.60	False
ConditionalSelectBenchmark - Duration of single invocation	3.40 ns	51.95 ns	15.26	0.63	False
AllBitsSetBenchmark - Duration of single invocation	1.97 ns	31.06 ns	15.77	0.63	True
AndNotBenchmark - Duration of single invocation	7.29 ns	54.33 ns	7.46	0.58	True
EqualityOperatorBenchmark - Duration of single invocation	2.22 ns	22.64 ns	10.21	0.68	False
MultiplyBenchmark - Duration of single invocation	5.80 ns	41.07 ns	7.08	0.60	False
BitwiseAndBenchmark - Duration of single invocation	3.42 ns	67.60 ns	19.79	0.62	True
LessThanAllBenchmark - Duration of single invocation	4.76 ns	27.42 ns	5.76	0.70	False
AddBenchmark - Duration of single invocation	3.24 ns	40.16 ns	12.40	0.60	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.41 ns	55.70 ns	23.15	0.64	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.01 ns	50.86 ns	16.91	0.61	True
OnesComplementOperatorBenchmark - Duration of single invocation	5.68 ns	42.27 ns	7.44	0.57	True
InequalityOperatorBenchmark - Duration of single invocation	2.43 ns	21.40 ns	8.82	0.67	False
AddOperatorBenchmark - Duration of single invocation	3.35 ns	31.64 ns	9.46	0.55	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	5.11 ns	49.56 ns	9.70	0.63	True
NegateBenchmark - Duration of single invocation	22.00 ns	38.06 ns	1.73	0.53	False
MultiplyOperatorBenchmark - Duration of single invocation	3.35 ns	33.75 ns	10.08	0.58	False
CountBenchmark - Duration of single invocation	0.84 ns	15.27 ns	18.20	0.90	True
LessThanOrEqualAllBenchmark - Duration of single invocation	2.46 ns	25.58 ns	10.38	0.73	False
EqualsAllBenchmark - Duration of single invocation	0.00 ns	26.78 ns	∞	0.65	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.47 ns	48.60 ns	14.02	0.59	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.75 ns	70.03 ns	18.67	0.59	False
GreaterThanAllBenchmark - Duration of single invocation	2.49 ns	47.43 ns	19.03	0.61	False
MinBenchmark - Duration of single invocation	3.35 ns	55.75 ns	16.62	0.56	False
LessThanAnyBenchmark - Duration of single invocation	1.92 ns	48.56 ns	25.27	0.65	False
DivideBenchmark - Duration of single invocation	27.95 ns	55.41 ns	1.98	0.42	False
LessThanBenchmark - Duration of single invocation	3.25 ns	52.13 ns	16.04	0.56	False
SubtractBenchmark - Duration of single invocation	3.28 ns	45.15 ns	13.76	0.62	False
UnaryNegateOperatorBenchmark - Duration of single invocation	25.20 ns	27.91 ns	1.11	0.55	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.13 ns	37.74 ns	17.75	0.67	False
DivisionOperatorBenchmark - Duration of single invocation	30.18 ns	42.92 ns	1.42	0.35	False
DotBenchmark - Duration of single invocation	2.49 ns	64.21 ns	25.83	0.64	False
EqualsAnyBenchmark - Duration of single invocation	4.20 ns	49.11 ns	11.68	0.68	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.62412831048048 > 2.174141670236281.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.153060457109953 (T) = (0 -17.538311561348486) / Math.Sqrt((0.5904177313867465 / (26)) + (8.144354895135065 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.433624035277581 = (2.079570003119215 - 17.538311561348486) / 2.079570003119215 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.53007082930615 > 2.5143816534946097.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.673449557167118 (T) = (0 -48.636804904424416) / Math.Sqrt((0.642724816891348 / (26)) + (20.445520720558306 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -17.875153724207724 = (2.5767633797888934 - 48.636804904424416) / 2.5767633797888934 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.28258619313068 > 3.4632182391025546.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.41766993074698 (T) = (0 -59.134925903758955) / Math.Sqrt((0.0922284954317967 / (26)) + (20.991700393583535 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -16.677145065293388 = (3.345275817182841 - 59.134925903758955) / 3.345275817182841 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.19555207678134 > 3.5316454677563973.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.89944208156845 (T) = (0 -69.50412244425704) / Math.Sqrt((0.6817267781595807 / (27)) + (31.818708908931495 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.866698812040546 = (3.6839578103563175 - 69.50412244425704) / 3.6839578103563175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.8114269270652 > 3.3685863832557303.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.621812703104645 (T) = (0 -45.2760762254152) / Math.Sqrt((0.33032610186881206 / (26)) + (16.10666607440655 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.545621710333645 = (3.1126944675901838 - 45.2760762254152) / 3.1126944675901838 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.45179311213365 > 3.4674488543014497.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.22559804335948 (T) = (0 -51.29797360278149) / Math.Sqrt((0.6608798929485042 / (27)) + (15.593469165415497 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.953610848614668 = (3.2154459632714403 - 51.29797360278149) / 3.2154459632714403 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.45954997598524 > 3.493538429022852.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.71568461940613 (T) = (0 -55.93767033577422) / Math.Sqrt((0.7206890989516807 / (27)) + (18.12664340929755 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.577173022511943 = (3.374379350436313 - 55.93767033577422) / 3.374379350436313 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.452219976093378 > 2.6985094201920306.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.460497213153946 (T) = (0 -30.239661939954214) / Math.Sqrt((0.3697972018916944 / (26)) + (14.392804790636863 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.251476950571872 = (2.6876171077626605 - 30.239661939954214) / 2.6876171077626605 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.36487715497064 > 3.3711537790508523.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.39219070761436 (T) = (0 -58.85937219466948) / Math.Sqrt((0.44456357581362954 / (25)) + (65.8037377666475 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -17.495645374449175 = (3.1823367610616504 - 58.85937219466948) / 3.1823367610616504 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.93369254242239 > 3.8579241525639496.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -86.50815121230784 (T) = (0 -48.958140858944034) / Math.Sqrt((0.8985225792687679 / (27)) + (1.942024564647763 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.956667256884899 = (3.507867598892044 - 48.958140858944034) / 3.507867598892044 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.615599635314815 > 4.1056354135173745.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -98.8938269065875 (T) = (0 -48.625137918182176) / Math.Sqrt((1.0268054534451763 / (27)) + (1.3753691799163683 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.683352048809368 = (3.3115829244266504 - 48.625137918182176) / 3.3115829244266504 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.79225207917859 > 2.302963491194602.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.80849420919173 (T) = (0 -32.720447456963434) / Math.Sqrt((0.3243850914236942 / (27)) + (4.395052079086268 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.26045750865826 = (2.1441327980107396 - 32.720447456963434) / 2.1441327980107396 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.94946095623115 > 3.622295908590036.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -137.5435425045422 (T) = (0 -52.144909699516994) / Math.Sqrt((1.4244417073122422 / (27)) + (0.5015574449150669 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -13.360312683997208 = (3.6311820534121133 - 52.144909699516994) / 3.6311820534121133 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.061273012658912 > 2.06945768657728.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.44437039146132 (T) = (0 -30.33105413874797) / Math.Sqrt((0.2653079202111202 / (27)) + (2.1776533446161936 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.56655248858486 = (1.9484760136189498 - 30.33105413874797) / 1.9484760136189498 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.327670868092724 > 3.4248902232484926.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.2431048121729 (T) = (0 -49.99485491833315) / Math.Sqrt((1.0828910908835574 / (27)) + (8.008111150066474 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.050416548595289 = (3.8309010852005687 - 49.99485491833315) / 3.8309010852005687 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.644476605789354 > 2.501757076444252.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.61145237187495 (T) = (0 -19.620907564221717) / Math.Sqrt((0.5376000245078754 / (26)) + (6.6873561311602305 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.190585459936748 = (2.395543964493747 - 19.620907564221717) / 2.395543964493747 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.06812916946351 > 3.5797168036213627.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.19422290670278 (T) = (0 -40.43645262707155) / Math.Sqrt((0.6589450159582064 / (27)) + (10.264709966257646 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.15876154131121 = (3.623740186343302 - 40.43645262707155) / 3.623740186343302 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.59597171205489 > 3.5153921761384885.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.462852818948903 (T) = (0 -51.52349973030537) / Math.Sqrt((0.7437486046878192 / (26)) + (44.61799584809676 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.75973521219315 = (3.074243063984726 - 51.52349973030537) / 3.074243063984726 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.418394294253737 > 2.2915593267012015.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.43233993303715 (T) = (0 -30.68025828081837) / Math.Sqrt((0.6274550648425825 / (25)) + (13.763968094808122 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -11.980035387064751 = (2.3636498180423122 - 30.68025828081837) / 2.3636498180423122 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.16289229098503 > 3.6296529183756308.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.88539514085624 (T) = (0 -39.59922851008712) / Math.Sqrt((0.32729481301787167 / (27)) + (5.324922060491642 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.409697306672795 = (3.4706642468883104 - 39.59922851008712) / 3.4706642468883104 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.69528605408212 > 2.5241453300921233.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.60497356762121 (T) = (0 -50.38628733223028) / Math.Sqrt((0.6106667791589429 / (27)) + (16.11442156677134 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.777577113074365 = (2.425031901362769 - 50.38628733223028) / 2.425031901362769 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.86403057740917 > 3.450395827348841.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -80.08026538074176 (T) = (0 -49.203633953008485) / Math.Sqrt((2.550078946597899 / (25)) + (1.757741571339398 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -12.010798954514778 = (3.781753459185895 - 49.203633953008485) / 3.781753459185895 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.26714937043614 > 6.261643721917431.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.133583999294856 (T) = (0 -43.206007909460496) / Math.Sqrt((0.6823326535322627 / (26)) + (6.281145379377775 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.020679628719414 = (6.154106182643369 - 43.206007909460496) / 6.154106182643369 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.401824874526532 > 2.4437366462793126.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.909767619927468 (T) = (0 -19.847111220107895) / Math.Sqrt((0.19839723359162253 / (27)) + (2.4804748523219478 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.157861360332128 = (2.4328816516317784 - 19.847111220107895) / 2.4328816516317784 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.6389051373317 > 3.5886599256741216.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.625593961258584 (T) = (0 -32.51695714622469) / Math.Sqrt((1.7306204522377306 / (26)) + (7.76333793585731 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.657870459267656 = (3.366886860138152 - 32.51695714622469) / 3.366886860138152 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.55803503129888 > 3.658098324637868.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -61.96501492815402 (T) = (0 -48.277201242803784) / Math.Sqrt((0.7246643697320994 / (27)) + (3.9693667281829406 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.93504934069741 = (3.464444227105094 - 48.277201242803784) / 3.464444227105094 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.063653163827645 > 24.189845394997715.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.282615071769609 (T) = (0 -40.91945315444083) / Math.Sqrt((3.038445678517812 / (27)) + (12.062994478882404 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.7851205923663448 = (22.922514775429406 - 40.91945315444083) / 22.922514775429406 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.74815593401501 > 3.4945578118431477.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.556819958122173 (T) = (0 -31.858358648231523) / Math.Sqrt((2.3621739463528644 / (27)) + (4.92839996948551 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -7.422279829559016 = (3.7826288478828185 - 31.858358648231523) / 3.7826288478828185 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.270816729603363 > 0.47766764648322724.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -82.76289839692868 (T) = (0 -15.175887599333757) / Math.Sqrt((0.22343009281092518 / (27)) + (0.1927369680067356 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -52.04711178291321 = (0.28608320206835464 - 15.175887599333757) / 0.28608320206835464 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.577964266315607 > 2.787386860459098.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.792566391100493 (T) = (0 -29.676950435143556) / Math.Sqrt((0.7941879885280738 / (27)) + (14.716430763443551 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.333608401758493 = (2.618490897439068 - 29.676950435143556) / 2.618490897439068 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.7805876175125 > 2.3416748486445838.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.2602389868683 (T) = (0 -27.931228146224253) / Math.Sqrt((0.8855335619603919 / (27)) + (6.296085666045641 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.918668388773467 = (2.3434856340607206 - 27.931228146224253) / 2.3434856340607206 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.59595321654747 > 3.6076117093229936.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -64.70872809987479 (T) = (0 -49.467851697202796) / Math.Sqrt((0.49800525993584005 / (27)) + (3.8823503382122078 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.969493620655104 = (3.5411342057567716 - 49.467851697202796) / 3.5411342057567716 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 70.03010623063803 > 3.547125610514482.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.517979434690677 (T) = (0 -70.26294435888437) / Math.Sqrt((0.9865962505326938 / (27)) + (35.72760866423302 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.758953077691658 = (3.3847055820166356 - 70.26294435888437) / 3.3847055820166356 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.430483528968 > 2.4421992784669446.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.18029161332098 (T) = (0 -48.53531143816767) / Math.Sqrt((0.5716892336303103 / (26)) + (9.026029086380369 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -20.816153572653814 = (2.224741922380207 - 48.53531143816767) / 2.224741922380207 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.749034524286834 > 3.4900443927281333.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -62.08390034500779 (T) = (0 -55.18850062996302) / Math.Sqrt((0.44289937493975895 / (27)) + (5.413552798171964 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.758665106659997 = (3.502105048646475 - 55.18850062996302) / 3.502105048646475 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.55736041338802 > 2.346016362904944.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.040447622950246 (T) = (0 -49.920469713940406) / Math.Sqrt((1.2113328691809604 / (26)) + (8.468039233400805 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -18.40631132096662 = (2.5723832256574295 - 49.920469713940406) / 2.5723832256574295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.40685724195164 > 29.296075373429666.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.899537430546072 (T) = (0 -48.86205484471508) / Math.Sqrt((1.3707458741747103 / (27)) + (15.405620292783633 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.7503720261781136 = (27.91523979699559 - 48.86205484471508) / 27.91523979699559 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.13487864406927 > 3.5832575907807453.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.06674321538955 (T) = (0 -55.368458404934536) / Math.Sqrt((0.29015866800422735 / (25)) + (8.546046146727788 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -15.572946150174102 = (3.340894123665084 - 55.368458404934536) / 3.340894123665084 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.15489225014961 > 3.5344043477461984.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.11887966461659 (T) = (0 -43.52303769941204) / Math.Sqrt((0.7344194310505114 / (27)) + (18.695923806373987 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.942345754515406 = (3.362839976997791 - 43.52303769941204) / 3.362839976997791 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.UnaryNegateOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.91187275724954 > 22.910440081080885.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -5.930565549483916 (T) = (0 -31.46244203435521) / Math.Sqrt((4.109003063831131 / (27)) + (14.787080521744775 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3635357509497416 = (23.07415996422589 - 31.46244203435521) / 23.07415996422589 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.74445656517284 > 2.5100937286058636.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.917593833061447 (T) = (0 -31.876593155215215) / Math.Sqrt((0.424525874168841 / (26)) + (27.41841341763192 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.632473990223525 = (2.3382838051314376 - 31.876593155215215) / 2.3382838051314376 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.92183419235163 > 30.894650104156796.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.308532149458408 (T) = (0 -38.62302578380049) / Math.Sqrt((2.124417963927845 / (26)) + (3.6261172846118583 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.3369495006340991 = (28.88891896476423 - 38.62302578380049) / 28.88891896476423 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 64.21321055732689 > 2.7684819210278255.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.49147078267763 (T) = (0 -69.33287583214694) / Math.Sqrt((0.8670800971330686 / (27)) + (23.677035785369043 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -24.16165191148046 = (2.755497773996013 - 69.33287583214694) / 2.755497773996013 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.10816376492322 > 2.677199118371367.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -61.96549434979023 (T) = (0 -48.1324850553434) / Math.Sqrt((0.8627837615827934 / (27)) + (4.05599123522648 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.221916382505984 = (2.641461196779125 - 48.1324850553434) / 2.641461196779125 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SerializeToWriter - Duration of single invocation	985.88 ns	1.20 μs	1.22	0.18	False
SerializeToUtf8Bytes - Duration of single invocation	1.17 μs	1.34 μs	1.14	0.21	False
SerializeToString - Duration of single invocation	1.32 μs	1.50 μs	1.13	0.15	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToWriter(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.1987487403014974 > 1008.435029494508.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.853586259113115 (T) = (0 -1192.4863524278185) / Math.Sqrt((599.2199022211312 / (25)) + (1955.4523611042916 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.23506645231328693 = (965.5240413941164 - 1192.4863524278185) / 965.5240413941164 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.3398620003460806 > 1.2244025076202443.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.837525251964257 (T) = (0 -1402.7529559625305) / Math.Sqrt((963.5761521399285 / (26)) + (3198.973623810936 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.1925971120481688 = (1176.2169653030935 - 1402.7529559625305) / 1176.2169653030935 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToString(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.4977488389440228 > 1.4230340726010424.
IsChangePoint: Marked as a change because one of 4/11/2023 3:40:00 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -6.216315622927002 (T) = (0 -1477.14417854355) / Math.Sqrt((1348.4394200180582 / (22)) + (5129.389072637613 / (13))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (13) - 2, .025) and -0.0987220769223227 = (1344.420221973915 - 1477.14417854355) / 1344.420221973915 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
AllBitsSetBenchmark - Duration of single invocation	1.95 ns	31.59 ns	16.19	0.67	True
OnesComplementBenchmark - Duration of single invocation	3.04 ns	42.26 ns	13.92	0.59	True
NegateBenchmark - Duration of single invocation	14.05 ns	29.10 ns	2.07	0.66	False
MultiplyBenchmark - Duration of single invocation	3.24 ns	37.07 ns	11.45	0.64	False
SquareRootBenchmark - Duration of single invocation	30.26 ns	52.30 ns	1.73	0.58	False
DotBenchmark - Duration of single invocation	0.42 ns	43.06 ns	103.42	0.81	False
MultiplyOperatorBenchmark - Duration of single invocation	6.13 ns	27.54 ns	4.49	0.62	False
InequalityOperatorBenchmark - Duration of single invocation	2.30 ns	18.82 ns	8.17	0.69	False
BitwiseOrBenchmark - Duration of single invocation	3.59 ns	48.11 ns	13.39	0.55	True
MaxBenchmark - Duration of single invocation	12.90 ns	46.36 ns	3.59	0.59	False
GreaterThanAllBenchmark - Duration of single invocation	3.50 ns	40.66 ns	11.61	0.69	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.31 ns	48.63 ns	14.70	0.64	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	4.17 ns	36.96 ns	8.86	0.70	False
SubtractionOperatorBenchmark - Duration of single invocation	3.25 ns	22.36 ns	6.87	0.63	False
CountBenchmark - Duration of single invocation	0.07 ns	15.56 ns	235.04	0.91	True
LessThanAllBenchmark - Duration of single invocation	3.47 ns	29.09 ns	8.38	0.70	False
LessThanOrEqualBenchmark - Duration of single invocation	4.66 ns	45.61 ns	9.80	0.63	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.37 ns	48.68 ns	14.43	0.58	True
AbsBenchmark - Duration of single invocation	5.63 ns	27.85 ns	4.95	0.63	True
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	3.62 ns	32.57 ns	8.98	0.67	False
MinBenchmark - Duration of single invocation	5.11 ns	46.45 ns	9.09	0.60	False
SumBenchmark - Duration of single invocation	1.59 ns	27.35 ns	17.24	0.85	False
GreaterThanAnyBenchmark - Duration of single invocation	3.75 ns	35.77 ns	9.55	0.74	False
AddOperatorBenchmark - Duration of single invocation	3.31 ns	22.22 ns	6.70	0.58	False
ConditionalSelectBenchmark - Duration of single invocation	3.31 ns	76.20 ns	23.05	0.65	True
DivideBenchmark - Duration of single invocation	22.67 ns	45.19 ns	1.99	0.45	False
BitwiseAndBenchmark - Duration of single invocation	4.68 ns	48.45 ns	10.36	0.59	True
XorBenchmark - Duration of single invocation	3.96 ns	48.94 ns	12.36	0.65	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	3.62 ns	45.96 ns	12.68	0.62	False
GreaterThanBenchmark - Duration of single invocation	4.43 ns	55.87 ns	12.60	0.66	False
UnaryNegateOperatorBenchmark - Duration of single invocation	15.04 ns	29.56 ns	1.97	0.61	False
EqualsAllBenchmark - Duration of single invocation	2.15 ns	30.05 ns	13.98	0.68	False
ZeroBenchmark - Duration of single invocation	1.72 ns	16.64 ns	9.67	0.69	True
SubtractBenchmark - Duration of single invocation	3.26 ns	36.53 ns	11.20	0.54	False
AddBenchmark - Duration of single invocation	3.30 ns	31.61 ns	9.59	0.63	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.11 ns	48.47 ns	15.56	0.57	True
OnesComplementOperatorBenchmark - Duration of single invocation	5.73 ns	42.57 ns	7.43	0.58	True
DivisionOperatorBenchmark - Duration of single invocation	21.90 ns	32.76 ns	1.50	0.50	False
EqualityOperatorBenchmark - Duration of single invocation	3.59 ns	21.35 ns	5.95	0.69	False
AndNotBenchmark - Duration of single invocation	5.55 ns	49.27 ns	8.88	0.56	True
LessThanBenchmark - Duration of single invocation	4.50 ns	43.22 ns	9.62	0.61	False
LessThanOrEqualAllBenchmark - Duration of single invocation	4.14 ns	28.24 ns	6.82	0.64	False
LessThanAnyBenchmark - Duration of single invocation	2.91 ns	42.87 ns	14.75	0.68	False
GreaterThanOrEqualBenchmark - Duration of single invocation	3.40 ns	48.10 ns	14.13	0.66	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.59484871828449 > 2.0423017829292385.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -85.3126019024869 (T) = (0 -29.737555088261253) / Math.Sqrt((0.4938718697779082 / (26)) + (0.6908817895893342 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.531779483194589 = (2.0463808388127225 - 29.737555088261253) / 2.0463808388127225 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.25616048734504 > 3.3569268616766776.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -118.94289977125098 (T) = (0 -42.722849871601056) / Math.Sqrt((0.21287373340555696 / (27)) + (0.8104569792228701 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.494893974578174 = (3.419224681579851 - 42.722849871601056) / 3.419224681579851 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.10111467922803 > 14.849306899482992.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.572815765951617 (T) = (0 -31.699269373154728) / Math.Sqrt((4.926030116558739 / (27)) + (8.782467219604982 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -1.0840557577184706 = (15.210374893163916 - 31.699269373154728) / 15.210374893163916 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.06951335452592 > 3.388129923713886.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.80774509703802 (T) = (0 -34.01601597246743) / Math.Sqrt((0.6296793461100727 / (26)) + (12.844934634944366 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.391869569549659 = (3.6218577909934178 - 34.01601597246743) / 3.6218577909934178 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.30158626551495 > 34.538076758566405.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.257837576512431 (T) = (0 -53.044300755102284) / Math.Sqrt((8.296965010959694 / (26)) + (55.192088451597556 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.5812887110111492 = (33.5449816252614 - 53.044300755102284) / 33.5449816252614 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.063893749443324 > 2.6150007703717035.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.88692963886274 (T) = (0 -45.64569535816129) / Math.Sqrt((0.930952902732736 / (27)) + (20.014425352209635 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.150070090302647 = (2.8263465794844675 - 45.64569535816129) / 2.8263465794844675 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.541309242264553 > 3.875369309694582.
IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.02994597614782 (T) = (0 -25.393731493927735) / Math.Sqrt((1.3233971502878341 / (27)) + (6.565454569893821 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.483658175546051 = (3.916574687682249 - 25.393731493927735) / 3.916574687682249 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.81550600990642 > 2.571834416900414.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.491380571222503 (T) = (0 -18.547669168553817) / Math.Sqrt((0.8308306236790802 / (26)) + (5.396092082790078 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.171499803087604 = (3.0053746674794364 - 18.547669168553817) / 3.0053746674794364 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.106429512733875 > 3.6369391378796228.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -172.02785539724593 (T) = (0 -48.5719392295405) / Math.Sqrt((0.7327256050674082 / (27)) + (0.33068212277557274 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.65633718213225 = (3.556732569044305 - 48.5719392295405) / 3.556732569044305 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.35641932326622 > 4.77174900759351.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -58.41022319818548 (T) = (0 -43.980835008051315) / Math.Sqrt((3.249881177206006 / (27)) + (2.6369348641522086 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.1649389475221 = (4.798813746592638 - 43.980835008051315) / 4.798813746592638 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.663556457622086 > 3.669978255908842.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.649791757929364 (T) = (0 -40.898340528670694) / Math.Sqrt((0.5896693567481516 / (27)) + (5.678094236943537 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.478436284994308 = (3.5630585485007966 - 40.898340528670694) / 3.5630585485007966 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.63065181034993 > 3.4822251609155135.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.953236201868547 (T) = (0 -54.02364424061767) / Math.Sqrt((0.1350754849466605 / (27)) + (92.15434240971153 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.565490751628065 = (3.2612160454895185 - 54.02364424061767) / 3.2612160454895185 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.959881140820485 > 3.834081852116856.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.13833883648303 (T) = (0 -39.58820101739844) / Math.Sqrt((1.4712105601387158 / (26)) + (11.65742006529064 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.591228023953729 = (3.737829166538903 - 39.58820101739844) / 3.737829166538903 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.364493022937207 > 3.556909967486751.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.864472116078364 (T) = (0 -24.69420880346635) / Math.Sqrt((1.3899678218810845 / (26)) + (7.825707163330429 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.051690305954254 = (3.501885042032438 - 24.69420880346635) / 3.501885042032438 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.564711153978426 > 0.05491661386486595.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -105.894308553638 (T) = (0 -15.151670661757542) / Math.Sqrt((0.1711725250549159 / (27)) + (0.10827659032917526 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -66.9171654218718 = (0.22309044506851802 - 15.151670661757542) / 0.22309044506851802 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.08640324922086 > 3.772147847692445.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.539955467565655 (T) = (0 -30.758676046670413) / Math.Sqrt((0.5617986801265024 / (27)) + (16.630414266491098 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.8985288487033385 = (3.894228486830166 - 30.758676046670413) / 3.894228486830166 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.613315789018436 > 4.782174859806895.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.91516990321431 (T) = (0 -43.20745786809729) / Math.Sqrt((0.6517462720097349 / (27)) + (7.272678100537772 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.295906793404113 = (4.648008938595968 - 43.20745786809729) / 4.648008938595968 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.67558550731369 > 3.4903360750124754.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -72.95001030730175 (T) = (0 -49.395945792586815) / Math.Sqrt((0.9097132159951694 / (27)) + (2.9118518169462453 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.559837185760891 = (3.392616631791367 - 49.395945792586815) / 3.392616631791367 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.848118682035018 > 7.192073861154511.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.03556416935961 (T) = (0 -30.985567669460632) / Math.Sqrt((3.9852956279781817 / (25)) + (9.65440829038343 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -3.842913283347234 = (6.398125643919151 - 30.985567669460632) / 6.398125643919151 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.56602658225651 > 3.8084174575660814.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.755505054905697 (T) = (0 -31.084963822445594) / Math.Sqrt((0.6914545670645069 / (27)) + (16.889427215377687 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.473192771349583 = (3.668624644957119 - 31.084963822445594) / 3.668624644957119 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.454913160219355 > 4.879314554526163.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.01306300505639 (T) = (0 -44.86999306436853) / Math.Sqrt((0.36690496395351685 / (26)) + (5.259793602258682 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.539463503263734 = (4.703618085966487 - 44.86999306436853) / 4.703618085966487 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.34679245959941 > 1.6600776820249548.
IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.432771219779962 (T) = (0 -26.13665220877187) / Math.Sqrt((1.3322106278449457 / (25)) + (10.916705186952436 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -13.46886120785007 = (1.8064070028255887 - 26.13665220877187) / 1.8064070028255887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.77227325139763 > 3.319766863731036.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.354839018849997 (T) = (0 -30.431645154805146) / Math.Sqrt((1.0531554061781305 / (27)) + (27.760986543122453 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.593597772443123 = (3.5411996186730486 - 30.431645154805146) / 3.5411996186730486 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.21571456835755 > 3.5452469341840205.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.895438980481266 (T) = (0 -24.222557138000667) / Math.Sqrt((1.1398726275700066 / (27)) + (2.6006681170690356 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.582032691881237 = (3.68010283022121 - 24.222557138000667) / 3.68010283022121 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 76.19881400131226 > 3.6699580715266333.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.768307483291476 (T) = (0 -55.96582945414979) / Math.Sqrt((1.1375362550470625 / (26)) + (68.14452481997913 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.080423086264299 = (3.974726406392252 - 55.96582945414979) / 3.974726406392252 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.194479988425755 > 23.31462203690897.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.071261439062795 (T) = (0 -41.28830844044016) / Math.Sqrt((1.6593715773826003 / (27)) + (9.141463225526715 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.8305255932279256 = (22.555439046133674 - 41.28830844044016) / 22.555439046133674 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.448577162933276 > 3.821472018482159.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -224.38578582660472 (T) = (0 -48.13404159310795) / Math.Sqrt((0.23946037389914032 / (27)) + (0.24549456041960224 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.725899954959866 = (3.5068040529987012 - 48.13404159310795) / 3.5068040529987012 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.93712976510201 > 3.5307744911601024.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -47.999913064874384 (T) = (0 -50.84530787249805) / Math.Sqrt((0.9996359413661995 / (26)) + (7.580931299540901 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.983898752317018 = (3.1810329044487684 - 50.84530787249805) / 3.1810329044487684 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.96211924751514 > 3.9283787805260864.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.366449282287086 (T) = (0 -41.15771296985766) / Math.Sqrt((0.3890828319143783 / (27)) + (11.297939973364985 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.145343378862696 = (3.692816952406676 - 41.15771296985766) / 3.692816952406676 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.865537298422204 > 4.792695789672733.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.336409011217114 (T) = (0 -52.997769732521846) / Math.Sqrt((0.5594014586618147 / (27)) + (21.535777836017278 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.324368894773164 = (4.679975566407353 - 52.997769732521846) / 4.679975566407353 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.UnaryNegateOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.558122064914887 > 15.419804200775523.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.699226470527164 (T) = (0 -23.29408596729706) / Math.Sqrt((4.475919157232104 / (26)) + (7.952368250890409 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.5550491810379612 = (14.979645821715279 - 23.29408596729706) / 14.979645821715279 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.052818074336276 > 2.366400508558139.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.179597018680838 (T) = (0 -27.67084623329387) / Math.Sqrt((0.6957156874316207 / (26)) + (8.38978760926462 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.661948896014714 = (2.5952897076478054 - 27.67084623329387) / 2.5952897076478054 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.64381661048373 > 2.1922921619345654.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -63.89141749126184 (T) = (0 -16.717382080899966) / Math.Sqrt((0.29905608898130787 / (27)) + (0.34043149551830015 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.701085873485111 = (1.9212983671202442 - 16.717382080899966) / 1.9212983671202442 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.52991479467672 > 3.722209083872517.
IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.57193724402891 (T) = (0 -35.30538840967205) / Math.Sqrt((0.833391265184151 / (26)) + (7.317742798567302 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.7739716184808 = (3.6121844617305814 - 35.30538840967205) / 3.6121844617305814 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.610726666500028 > 3.589650874378217.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.71090802628394 (T) = (0 -34.29438847434598) / Math.Sqrt((0.45634703169200874 / (26)) + (24.047104292226468 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.802350601201407 = (3.4985882335347958 - 34.29438847434598) / 3.4985882335347958 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.468185029967785 > 3.466159571939576.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -94.75454789043327 (T) = (0 -49.11475539224395) / Math.Sqrt((0.2756512006121417 / (26)) + (1.8008276254170164 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.78291659232542 = (3.111893489706866 - 49.11475539224395) / 3.111893489706866 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.56595493665664 > 6.0143664289621945.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -66.84557996459253 (T) = (0 -43.07618661099254) / Math.Sqrt((3.1087629064369975 / (27)) + (1.5204621902754438 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.007015677114512 = (6.147579596786532 - 43.07618661099254) / 6.147579596786532 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.760282803879235 > 23.040683257384522.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.753044008985533 (T) = (0 -31.13488189893431) / Math.Sqrt((2.247026855457001 / (27)) + (2.6116387475717757 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3941764904132765 = (22.332095048959676 - 31.13488189893431) / 22.332095048959676 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.34716641787637 > 2.5073100435463247.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.50763080655883 (T) = (0 -21.57633209280427) / Math.Sqrt((1.1981435891905277 / (27)) + (15.620843777891158 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.671880950972965 = (2.4880798312139487 - 21.57633209280427) / 2.4880798312139487 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.26743843975749 > 3.4863563304635696.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -94.35568542286941 (T) = (0 -49.65505750033742) / Math.Sqrt((1.0984327908718725 / (25)) + (1.5691489650095334 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -13.507961203778756 = (3.4226075464969004 - 49.65505750033742) / 3.4226075464969004 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.22209099863213 > 4.720205115449776.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.57628304411445 (T) = (0 -44.43965760721845) / Math.Sqrt((0.8028239207984432 / (27)) + (6.655454829574306 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -9.43021681199744 = (4.260664798079881 - 44.43965760721845) / 4.260664798079881 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.23883269982631 > 3.604638241875902.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.935129338199445 (T) = (0 -28.642923979258125) / Math.Sqrt((0.446169913513843 / (27)) + (5.866920227506145 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.986968337505035 = (3.586207277767372 - 28.642923979258125) / 3.586207277767372 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.874260790391915 > 3.147767390542355.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.6319771273488 (T) = (0 -40.33352749439935) / Math.Sqrt((0.8760531036411471 / (27)) + (9.474195011128668 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.464960686591832 = (3.235752483181504 - 40.33352749439935) / 3.235752483181504 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.1011132788537 > 4.770172229287749.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.360198654122225 (T) = (0 -51.517298953754754) / Math.Sqrt((0.7116055337457153 / (27)) + (19.07064105502099 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.751802474946388 = (4.383778493859494 - 51.517298953754754) / 4.383778493859494 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
EqualityOperatorBenchmark - Duration of single invocation	3.03 ns	18.18 ns	5.99	0.71	False
LessThanOrEqualBenchmark - Duration of single invocation	6.47 ns	54.19 ns	8.38	0.58	False
LessThanAllBenchmark - Duration of single invocation	2.83 ns	31.71 ns	11.20	0.63	False
DivideBenchmark - Duration of single invocation	24.38 ns	48.89 ns	2.01	0.46	False
AddBenchmark - Duration of single invocation	3.34 ns	47.43 ns	14.20	0.54	False
ZeroBenchmark - Duration of single invocation	0.00 ns	13.18 ns	∞	0.67	True
SubtractBenchmark - Duration of single invocation	3.33 ns	42.82 ns	12.88	0.56	False
XorBenchmark - Duration of single invocation	3.42 ns	51.97 ns	15.22	0.58	True
EqualsAllBenchmark - Duration of single invocation	2.27 ns	32.15 ns	14.17	0.70	False
GreaterThanOrEqualBenchmark - Duration of single invocation	1.05 ns	45.67 ns	43.51	0.61	False
EqualsStaticBenchmark - Duration of single invocation	3.54 ns	39.86 ns	11.25	0.55	False
AbsBenchmark - Duration of single invocation	4.52 ns	12.79 ns	2.83	0.57	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.17 ns	37.76 ns	17.42	0.67	False
MultiplyBenchmark - Duration of single invocation	3.33 ns	46.36 ns	13.93	0.59	False
InequalityOperatorBenchmark - Duration of single invocation	2.41 ns	16.03 ns	6.64	0.66	False
DivisionOperatorBenchmark - Duration of single invocation	24.58 ns	38.29 ns	1.56	0.48	False
EqualsAnyBenchmark - Duration of single invocation	2.62 ns	34.63 ns	13.22	0.59	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	4.92 ns	53.26 ns	10.83	0.59	True
GreaterThanBenchmark - Duration of single invocation	3.26 ns	40.81 ns	12.53	0.60	False
MinBenchmark - Duration of single invocation	4.42 ns	35.43 ns	8.01	0.52	False
SubtractionOperatorBenchmark - Duration of single invocation	3.57 ns	33.69 ns	9.43	0.54	False
LessThanBenchmark - Duration of single invocation	3.55 ns	56.72 ns	15.96	0.55	False
OnesComplementOperatorBenchmark - Duration of single invocation	4.48 ns	39.48 ns	8.81	0.67	True
DotBenchmark - Duration of single invocation	6.23 ns	47.77 ns	7.67	0.64	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.33 ns	59.35 ns	17.81	0.63	True
AddOperatorBenchmark - Duration of single invocation	2.09 ns	33.18 ns	15.85	0.59	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.27 ns	53.62 ns	16.39	0.62	True
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.97 ns	35.59 ns	11.98	0.64	False
MaxBenchmark - Duration of single invocation	3.91 ns	36.92 ns	9.45	0.56	False
GreaterThanAnyBenchmark - Duration of single invocation	3.58 ns	31.19 ns	8.72	0.59	False
OneBenchmark - Duration of single invocation	2.22 ns	27.36 ns	12.32	0.69	False
LessThanAnyBenchmark - Duration of single invocation	2.46 ns	18.65 ns	7.58	0.71	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	3.59 ns	22.14 ns	6.17	0.70	False
BitwiseAndBenchmark - Duration of single invocation	3.28 ns	54.21 ns	16.54	0.58	True
GreaterThanAllBenchmark - Duration of single invocation	2.98 ns	23.55 ns	7.90	0.69	False
CountBenchmark - Duration of single invocation	1.17 ns	14.70 ns	12.53	0.88	True
OnesComplementBenchmark - Duration of single invocation	3.20 ns	39.46 ns	12.34	0.66	True
ConditionalSelectBenchmark - Duration of single invocation	3.45 ns	176.24 ns	51.02	0.62	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	1.06 ns	18.96 ns	17.96	0.69	False
MultiplyOperatorBenchmark - Duration of single invocation	3.19 ns	32.91 ns	10.31	0.55	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt32>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.182369759765443 > 2.362150130119417.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.384315250717027 (T) = (0 -18.55250242079898) / Math.Sqrt((0.8889057784429052 / (25)) + (2.533015407749119 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.061837526659575 = (2.3012746609501833 - 18.55250242079898) / 2.3012746609501833 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.18540801293671 > 3.4852281393117215.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -52.123916159722306 (T) = (0 -57.143925874109655) / Math.Sqrt((1.45937856450221 / (27)) + (8.007163276950589 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.841868240836245 = (3.607145634932588 - 57.143925874109655) / 3.607145634932588 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.71079497087589 > 2.735329051683593.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.23923167656702 (T) = (0 -33.89573493632949) / Math.Sqrt((0.38206174656846414 / (26)) + (9.744462430938126 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.334860376821462 = (2.541889002096097 - 33.89573493632949) / 2.541889002096097 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.88976616544848 > 26.83272597766266.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.639381607842484 (T) = (0 -44.57521666691275) / Math.Sqrt((5.585088685452087 / (27)) + (8.21281177412747 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.784098616079025 = (24.984726889636427 - 44.57521666691275) / 24.984726889636427 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.42761728178061 > 3.550164938737217.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.625814842847205 (T) = (0 -40.27155531782051) / Math.Sqrt((0.5458723647594537 / (27)) + (10.699401406185425 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.769072042163367 = (3.4218122867754888 - 40.27155531782051) / 3.4218122867754888 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.177888893901716 > 1.2880148025516727.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.693697650352643 (T) = (0 -16.12130978596603) / Math.Sqrt((0.6289696277205157 / (27)) + (1.4404143795108237 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.8125853342085065 = (1.8293507721720064 - 16.12130978596603) / 1.8293507721720064 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.82065702199661 > 3.487101082524178.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.673171707661755 (T) = (0 -42.18161752754669) / Math.Sqrt((0.04987586127097243 / (26)) + (18.303738656398227 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.659438349070445 = (3.332029144140032 - 42.18161752754669) / 3.332029144140032 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.970024597569584 > 3.528791495016209.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -126.32463693829945 (T) = (0 -53.2436759890398) / Math.Sqrt((0.2887515288924771 / (27)) + (1.1681194574847187 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.452935559807816 = (3.2361201316017145 - 53.2436759890398) / 3.2361201316017145 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.15347870953473 > 2.380765745684606.
IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.666998860066965 (T) = (0 -27.947410748918024) / Math.Sqrt((0.32676043806281696 / (26)) + (11.259580579224734 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.132793913360889 = (2.1280628427805612 - 27.947410748918024) / 2.1280628427805612 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.67163535743598 > 3.3360775198047605.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.7309078672951 (T) = (0 -44.09471358861667) / Math.Sqrt((0.900624777047642 / (27)) + (11.537623218417815 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.128840294752115 = (3.120901126258381 - 44.09471358861667) / 3.120901126258381 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.86441437218197 > 3.3966561682811234.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.063705785374914 (T) = (0 -42.03990537820278) / Math.Sqrt((1.447027673672325 / (27)) + (8.802920275699748 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.741748521865762 = (3.2993827578734 - 42.03990537820278) / 3.2993827578734 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.7940500427926 > 4.648003519753446.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.935551578964281 (T) = (0 -14.085829492203176) / Math.Sqrt((0.9456472134538182 / (27)) + (3.121127131091886 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -2.2402425593707394 = (4.347152793073204 - 14.085829492203176) / 4.347152793073204 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.76136872644934 > 2.66806488740042.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.414130094409618 (T) = (0 -33.650106949976795) / Math.Sqrt((0.9112256831111165 / (27)) + (7.598683878134943 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.48765597870765 = (2.4948817647112804 - 33.650106949976795) / 2.4948817647112804 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.35807314415381 > 3.511892544227551.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.750969115477087 (T) = (0 -44.721614046844564) / Math.Sqrt((0.4492910272898722 / (26)) + (16.441478568219093 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.423672723047249 = (3.3315483004931687 - 44.721614046844564) / 3.3315483004931687 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.029068526957566 > 2.7960237200979967.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.25783128338352 (T) = (0 -18.926680506429612) / Math.Sqrt((0.5222223993157137 / (26)) + (4.462053250999412 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.839297552175028 = (2.767342751509702 - 18.926680506429612) / 2.767342751509702 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.29434931903461 > 25.228370281746002.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.308307800343433 (T) = (0 -36.44661624657398) / Math.Sqrt((6.22083702333956 / (26)) + (8.73405121894944 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.4843489464349283 = (24.553940860139754 - 36.44661624657398) / 24.553940860139754 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.63209864941518 > 2.71815136204594.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.575390061223143 (T) = (0 -33.438062233792834) / Math.Sqrt((0.9004460576653412 / (27)) + (7.760764009794868 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.899471806362582 = (2.8100459228714407 - 33.438062233792834) / 2.8100459228714407 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.26014237656654 > 3.7434498684460413.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -56.74796747080619 (T) = (0 -53.7647121220216) / Math.Sqrt((1.8653891840229022 / (25)) + (5.607613984332362 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -13.190144576514939 = (3.7888769795202513 - 53.7647121220216) / 3.7888769795202513 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.811255384135606 > 3.4305939503152643.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.16586877230737 (T) = (0 -42.539778877464286) / Math.Sqrt((2.3800958670911787 / (27)) + (12.771686213550556 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.560809423887584 = (3.3867068149735675 - 42.539778877464286) / 3.3867068149735675 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.43473300225667 > 3.5703633259772056.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.25370575242948 (T) = (0 -36.70944779736748) / Math.Sqrt((1.0477997228946834 / (25)) + (4.591214908482152 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -9.336741412806695 = (3.551355918789489 - 36.70944779736748) / 3.551355918789489 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.688539976950224 > 3.4679838184685927.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.197856851256056 (T) = (0 -33.80725302319335) / Math.Sqrt((0.5821430386960393 / (26)) + (9.743936718531005 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.614345891070231 = (3.516334174599793 - 33.80725302319335) / 3.516334174599793 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.721812953825086 > 3.526035239875142.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.72743369704442 (T) = (0 -55.63892572190524) / Math.Sqrt((0.399045654766762 / (27)) + (2.169882365490136 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.490719051400966 = (3.373953891790937 - 55.63892572190524) / 3.373953891790937 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.47661972006297 > 4.712974307293123.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -55.3327774843795 (T) = (0 -40.495874457395416) / Math.Sqrt((1.6791032237087307 / (27)) + (2.7979772723099363 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.12835421121916 = (4.982050905397428 - 40.495874457395416) / 4.982050905397428 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.771660313964645 > 2.7835946189472134.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.22058287055901 (T) = (0 -49.31839230556389) / Math.Sqrt((1.2695522304859261 / (27)) + (7.005150152372354 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.43994280271722 = (2.9999126455240748 - 49.31839230556389) / 2.9999126455240748 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.348172696538555 > 3.480889913394664.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.979915315012526 (T) = (0 -56.00420736678992) / Math.Sqrt((1.9983672399879866 / (27)) + (10.634901353684702 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.346222286038952 = (3.9037599062779407 - 56.00420736678992) / 3.9037599062779407 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.17671816300701 > 3.5290382664832802.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.238172945836432 (T) = (0 -35.02894367536126) / Math.Sqrt((1.0964820343997241 / (26)) + (13.202265876166065 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.018474317341308 = (3.49643494266672 - 35.02894367536126) / 3.49643494266672 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.62091146653001 > 3.400105674479309.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -108.70343689321956 (T) = (0 -53.19819125318035) / Math.Sqrt((0.282470368648377 / (27)) + (1.5948931854610604 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.623757253062701 = (3.4049550560414645 - 53.19819125318035) / 3.4049550560414645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.592048115912554 > 2.7077076888326617.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.222668247479966 (T) = (0 -34.74310836713663) / Math.Sqrt((0.7105244648804543 / (27)) + (7.203853099509886 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.590176833687527 = (2.759540936245988 - 34.74310836713663) / 2.759540936245988 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.92377324159771 > 3.4630147932189255.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.42998756177814 (T) = (0 -38.01496627202347) / Math.Sqrt((0.709502417096426 / (25)) + (6.3177356349591784 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -10.677024537967364 = (3.255535359065092 - 38.01496627202347) / 3.255535359065092 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.19276171160076 > 2.5786213104414757.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.11418168134299 (T) = (0 -33.303820171468) / Math.Sqrt((0.5108428001919453 / (27)) + (3.776120323532595 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.908810765558554 = (2.394440526427751 - 33.303820171468) / 2.394440526427751 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.35765894682579 > 2.291262232474783.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.776351453928584 (T) = (0 -24.512156064287623) / Math.Sqrt((0.8479940458487558 / (27)) + (6.332909742710274 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.045722121671048 = (2.034926243250178 - 24.512156064287623) / 2.034926243250178 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.650290782038105 > 2.5901874443634583.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.24203552336411 (T) = (0 -19.233872507878665) / Math.Sqrt((0.4047647300364449 / (26)) + (0.8881251723811238 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.914645047498619 = (2.7816138609799705 - 19.233872507878665) / 2.7816138609799705 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.14221778758052 > 2.6450844827237474.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.98909122938314 (T) = (0 -20.349102226169443) / Math.Sqrt((0.8291284388199025 / (27)) + (1.9367460928662132 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.837261595380049 = (2.5964556597376998 - 20.349102226169443) / 2.5964556597376998 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.206198674858584 > 3.482666376896089.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -69.44221131967456 (T) = (0 -52.52596755323478) / Math.Sqrt((0.22394249677878464 / (26)) + (3.92533100805301 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.188386185133727 = (3.458298130755115 - 52.52596755323478) / 3.458298130755115 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.545273657742282 > 2.78833078324613.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.680414396439309 (T) = (0 -21.94833676560697) / Math.Sqrt((0.7265137365408086 / (27)) + (11.845870685262637 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.144176548179475 = (2.6949731057234065 - 21.94833676560697) / 2.6949731057234065 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.700266138498671 > 0.1620559986962727.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -66.07173784866039 (T) = (0 -15.259771760663476) / Math.Sqrt((0.06834408331177783 / (27)) + (0.3961217445087777 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -80.88101365184303 = (0.1863652033614022 - 15.259771760663476) / 0.1863652033614022 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.45615820327093 > 3.4529220537380314.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.10113506868604 (T) = (0 -41.02865950477873) / Math.Sqrt((0.8532941882264953 / (27)) + (6.480004625822978 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.347256090747356 = (3.3228969418982337 - 41.02865950477873) / 3.3228969418982337 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 176.24125428519878 > 3.6413589726961773.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -70.57671630714084 (T) = (0 -181.1543224476554) / Math.Sqrt((0.4082353797574171 / (27)) + (50.48575067869957 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -48.69571144154857 = (3.6452707324801397 - 181.1543224476554) / 3.6452707324801397 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.964738192484756 > 2.3144686437744033.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.305424503215315 (T) = (0 -20.002587941620472) / Math.Sqrt((1.4259347302958798 / (26)) + (11.2628756808973 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.404845085902601 = (2.7012837823847993 - 20.002587941620472) / 2.7012837823847993 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.91169934977928 > 3.3624129663244884.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -117.7408476504584 (T) = (0 -31.655137714781823) / Math.Sqrt((0.4310189027851692 / (25)) + (0.33006783520938565 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -8.961926811966872 = (3.1776119532172977 - 31.655137714781823) / 3.1776119532172977 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SubtractionOperatorBenchmark - Duration of single invocation	3.29 ns	62.19 ns	18.93	0.54	False
AndNotBenchmark - Duration of single invocation	3.28 ns	86.94 ns	26.48	0.57	True
OnesComplementOperatorBenchmark - Duration of single invocation	5.18 ns	40.13 ns	7.75	0.68	True
MaxBenchmark - Duration of single invocation	6.39 ns	65.44 ns	10.23	0.49	False
MultiplyBenchmark - Duration of single invocation	3.17 ns	64.89 ns	20.48	0.51	False
EqualsStaticBenchmark - Duration of single invocation	3.27 ns	69.19 ns	21.18	0.52	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.47 ns	22.59 ns	9.16	0.64	False
DotBenchmark - Duration of single invocation	4.83 ns	87.13 ns	18.05	0.57	False
MultiplyOperatorBenchmark - Duration of single invocation	3.26 ns	69.13 ns	21.22	0.46	False
InequalityOperatorBenchmark - Duration of single invocation	2.50 ns	22.03 ns	8.80	0.71	False
LessThanAllBenchmark - Duration of single invocation	2.70 ns	60.84 ns	22.56	0.61	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.46 ns	57.24 ns	23.27	0.54	False
DivideBenchmark - Duration of single invocation	48.46 ns	74.16 ns	1.53	0.33	False
CountBenchmark - Duration of single invocation	0.03 ns	15.10 ns	520.74	0.88	True
ZeroBenchmark - Duration of single invocation	2.10 ns	16.48 ns	7.87	0.66	True
GreaterThanAnyBenchmark - Duration of single invocation	2.41 ns	58.77 ns	24.41	0.58	False
XorBenchmark - Duration of single invocation	3.53 ns	52.32 ns	14.84	0.62	True
ConditionalSelectBenchmark - Duration of single invocation	3.97 ns	177.81 ns	44.82	0.60	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.26 ns	18.84 ns	8.32	0.70	False
AddBenchmark - Duration of single invocation	3.67 ns	63.61 ns	17.34	0.51	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.72 ns	52.26 ns	14.05	0.61	True
MinBenchmark - Duration of single invocation	0.70 ns	69.22 ns	98.86	0.52	False
LessThanOrEqualBenchmark - Duration of single invocation	3.21 ns	91.19 ns	28.42	0.49	False
GreaterThanAllBenchmark - Duration of single invocation	2.41 ns	22.25 ns	9.22	0.67	False
EqualsAllBenchmark - Duration of single invocation	1.95 ns	26.05 ns	13.37	0.70	False
EqualityOperatorBenchmark - Duration of single invocation	2.62 ns	17.46 ns	6.67	0.69	False
OneBenchmark - Duration of single invocation	2.29 ns	25.84 ns	11.30	0.70	False
BitwiseAndBenchmark - Duration of single invocation	3.20 ns	52.44 ns	16.39	0.64	True
SubtractBenchmark - Duration of single invocation	3.53 ns	70.22 ns	19.87	0.50	False
GreaterThanBenchmark - Duration of single invocation	4.20 ns	63.43 ns	15.10	0.51	False
EqualsAnyBenchmark - Duration of single invocation	2.26 ns	61.04 ns	27.07	0.55	False
AbsBenchmark - Duration of single invocation	4.28 ns	24.80 ns	5.79	0.63	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.21 ns	53.30 ns	16.58	0.64	True
OnesComplementBenchmark - Duration of single invocation	3.33 ns	39.42 ns	11.82	0.63	True
BitwiseOrBenchmark - Duration of single invocation	3.71 ns	52.10 ns	14.06	0.60	True
LessThanBenchmark - Duration of single invocation	2.75 ns	90.74 ns	33.05	0.58	False
GreaterThanOrEqualBenchmark - Duration of single invocation	8.46 ns	72.45 ns	8.56	0.54	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 62.18707471440844 > 3.4718511459060903.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -56.101318195956395 (T) = (0 -57.67888612896949) / Math.Sqrt((1.276592185966297 / (27)) + (6.180679999337637 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -15.157070344631602 = (3.5698851894974917 - 57.67888612896949) / 3.5698851894974917 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.94239014319156 > 3.748518056135074.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -232.2753975260535 (T) = (0 -85.64066441587977) / Math.Sqrt((0.36355992764730566 / (26)) + (0.8885585653765821 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -23.458023157168345 = (3.501536647731055 - 85.64066441587977) / 3.501536647731055 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.12694715422231 > 4.910406640790517.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.290400327328236 (T) = (0 -41.32097455493523) / Math.Sqrt((0.6816133423021153 / (27)) + (4.257335159598994 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.140286549656489 = (4.520752640571008 - 41.32097455493523) / 4.520752640571008 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 65.43510002448954 > 3.4521127868557158.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.065503032802795 (T) = (0 -72.20348465138365) / Math.Sqrt((1.1701048281546174 / (27)) + (34.037413425439425 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -18.764260275383364 = (3.653234861580628 - 72.20348465138365) / 3.653234861580628 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 64.88885384986818 > 3.3906374101656325.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -67.67430038516497 (T) = (0 -67.90762278679219) / Math.Sqrt((0.31372147458144817 / (27)) + (7.187894158561376 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.290969120069768 = (3.3466919389091605 - 67.90762278679219) / 3.3466919389091605 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.19019328098587 > 3.432324373356698.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -60.50675633809993 (T) = (0 -66.10139068564644) / Math.Sqrt((0.6605089801029869 / (27)) + (8.361743097771443 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.767925104813614 = (3.5220404129113185 - 66.10139068564644) / 3.5220404129113185 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.589274331251712 > 2.7262653948907345.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.98633411603049 (T) = (0 -21.70045850620716) / Math.Sqrt((0.2778021202910922 / (27)) + (6.018420480854047 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.678220827232307 = (2.5005653737354776 - 21.70045850620716) / 2.5005653737354776 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 87.13353047445678 > 3.3317685197839237.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.417210758271366 (T) = (0 -89.61703721918684) / Math.Sqrt((0.5197644721171751 / (27)) + (23.474613438368827 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -29.172592494010008 = (2.970147070954476 - 89.61703721918684) / 2.970147070954476 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.1303362887499 > 3.4270881583027344.
IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.615178720122415 (T) = (0 -60.23107334288655) / Math.Sqrt((0.671142051955284 / (26)) + (14.619259965276987 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.828729167264244 = (3.5790624915427287 - 60.23107334288655) / 3.5790624915427287 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.02702125544483 > 2.559168886247043.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.079523105554408 (T) = (0 -18.580762029388488) / Math.Sqrt((0.3942652475448202 / (27)) + (4.943474697013373 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.116122074015518 = (2.6110797195618725 - 18.580762029388488) / 2.6110797195618725 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 60.835120713785855 > 2.8154118277549984.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.998678445338147 (T) = (0 -61.373371661425935) / Math.Sqrt((0.6035215789700094 / (27)) + (32.6661373871777 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -22.467094032019308 = (2.615294913707083 - 61.373371661425935) / 2.615294913707083 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.24461468189547 > 2.513247837682673.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -65.30209003389798 (T) = (0 -58.951854501312965) / Math.Sqrt((0.8060217838008025 / (26)) + (5.697002311197525 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -21.176172561284524 = (2.6583421615428784 - 58.951854501312965) / 2.6583421615428784 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.15537895417837 > 55.512072038565606.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.78994701325543 (T) = (0 -75.0243564518943) / Math.Sqrt((14.171935230171355 / (26)) + (2.3271190583603416 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.4328935525254431 = (52.35863914640801 - 75.0243564518943) / 52.35863914640801 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.10217933081725 > 0.026358130321187.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -6.557258086178835 (T) = (0 -17.20035305966085) / Math.Sqrt((0.02145973943287783 / (27)) + (54.55911927907351 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -227.94454538280252 = (0.07512890525913737 - 17.20035305966085) / 0.07512890525913737 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.48046807597728 > 2.0800647354499953.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.861305589425246 (T) = (0 -16.486544650896462) / Math.Sqrt((0.19826397208014437 / (26)) + (1.9236783982508263 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.808873530625926 = (2.111257735989351 - 16.486544650896462) / 2.111257735989351 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.77277167290644 > 2.457908097713731.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.019846252047465 (T) = (0 -58.623327580181716) / Math.Sqrt((1.3206583888853665 / (25)) + (12.529179783724127 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -21.435611879467864 = (2.6129587147044266 - 58.623327580181716) / 2.6129587147044266 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.323918981651644 > 3.5518450179873344.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -104.51144881391146 (T) = (0 -52.91907102435094) / Math.Sqrt((0.9278641562719501 / (27)) + (1.548036297517644 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -16.466304382354952 = (3.0297806488367147 - 52.91907102435094) / 3.0297806488367147 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 177.8113664349506 > 3.7030580876831842.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -161.03264403415665 (T) = (0 -178.74798106829493) / Math.Sqrt((2.4433697574016855 / (26)) + (8.67057653129754 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -43.85454012673253 = (3.985058827116683 - 178.74798106829493) / 3.985058827116683 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.837425357283127 > 2.4821328230300987.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.226174719544424 (T) = (0 -20.242766132968537) / Math.Sqrt((0.3985681706416786 / (27)) + (3.5557151633970956 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.194534518969751 = (2.4702765100455686 - 20.242766132968537) / 2.4702765100455686 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.61436206127778 > 3.7277091711351558.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.730827787018626 (T) = (0 -66.75257788788076) / Math.Sqrt((1.7320930552954557 / (27)) + (12.916201028744592 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.46500211101075 = (3.6150863935225845 - 66.75257788788076) / 3.6150863935225845 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.25740063486767 > 4.6249610514347355.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -77.51275556370942 (T) = (0 -53.51334082798983) / Math.Sqrt((0.989465794959228 / (26)) + (2.988705400965183 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.15127880944681 = (3.781519786909048 - 53.51334082798983) / 3.781519786909048 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.21559002546255 > 3.438170412543469.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.769067600354425 (T) = (0 -68.77727453007049) / Math.Sqrt((3.251077797139407 / (27)) + (17.498684925858154 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.072448171278367 = (3.8056423722036037 - 68.77727453007049) / 3.8056423722036037 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 91.19397577196133 > 3.461498648533508.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -68.10473219938923 (T) = (0 -92.4182188856042) / Math.Sqrt((0.23080300207575077 / (26)) + (13.585655721025507 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -25.89945049420664 = (3.4356917032750687 - 92.4182188856042) / 3.4356917032750687 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.250028060846137 > 2.6211370207005062.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.875849415252407 (T) = (0 -21.36921999164573) / Math.Sqrt((0.14688159740267895 / (26)) + (5.908263066334769 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.555213147473776 = (2.4978010042865773 - 21.36921999164573) / 2.4978010042865773 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.050587981084085 > 2.6450274605653084.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.641865182829445 (T) = (0 -28.27236570857821) / Math.Sqrt((0.5560514962399649 / (26)) + (12.412908208642891 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.861788402883688 = (2.3834825532467763 - 28.27236570857821) / 2.3834825532467763 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.463411011878183 > 2.774357800625255.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.305203924522765 (T) = (0 -18.57541163675711) / Math.Sqrt((0.5634565180898211 / (27)) + (1.8243290054466084 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.556925994476435 = (2.458064515959848 - 18.57541163675711) / 2.458064515959848 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.83853515673747 > 2.5749813693440466.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.57780613804626 (T) = (0 -23.345061389181097) / Math.Sqrt((0.5224414973092683 / (27)) + (1.7181165452737885 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.330654157339632 = (2.2597853953512814 - 23.345061389181097) / 2.2597853953512814 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.43708680205847 > 3.381511924446121.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -64.77200132737971 (T) = (0 -53.32833789132141) / Math.Sqrt((0.9827340444533893 / (27)) + (4.502617591954636 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.724766296235616 = (3.1885849372570583 - 53.32833789132141) / 3.1885849372570583 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 70.21748237022618 > 3.374346465866803.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.2079319609822 (T) = (0 -65.9619673376577) / Math.Sqrt((0.3492416336484111 / (27)) + (14.610282849495514 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.014180139645482 = (3.2957616488619306 - 65.9619673376577) / 3.2957616488619306 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.42531990819237 > 3.5729995846103577.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.345195412452625 (T) = (0 -66.15711276881703) / Math.Sqrt((2.3060403348189014 / (25)) + (15.054064487748905 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -16.17245723697414 = (3.8525128847823646 - 66.15711276881703) / 3.8525128847823646 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 61.04273113618568 > 2.455122810589215.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -65.4569533178101 (T) = (0 -58.211599473483744) / Math.Sqrt((0.7464229750105681 / (25)) + (5.535008327869832 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -21.365582758252064 = (2.6027311741745622 - 58.211599473483744) / 2.6027311741745622 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.79625508452355 > 4.488562619708184.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.678174397007158 (T) = (0 -16.82096134215231) / Math.Sqrt((0.6026286797016726 / (27)) + (13.045617203810622 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -2.8423821849057482 = (4.37774290340796 - 16.82096134215231) / 4.37774290340796 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.304350280915884 > 3.5520976761786884.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -162.2548266564973 (T) = (0 -53.042313602627004) / Math.Sqrt((0.7288367190884988 / (27)) + (0.531582226840016 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.401956954997233 = (3.443868448510187 - 53.042313602627004) / 3.443868448510187 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.417011563877246 > 3.4196688151856423.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -72.55352260115188 (T) = (0 -40.1163848148113) / Math.Sqrt((0.40438352645172587 / (27)) + (1.9472001772668432 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.39369966085084 = (3.2368369342957974 - 40.1163848148113) / 3.2368369342957974 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.09637012750414 > 3.6749759262365482.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -125.30328169781488 (T) = (0 -53.81553235676845) / Math.Sqrt((1.0890624872949652 / (27)) + (0.9694034740646197 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.56218368435407 = (3.4580964630865774 - 53.81553235676845) / 3.4580964630865774 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 90.73928646924665 > 3.6870130485251744.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -51.89830674252825 (T) = (0 -93.9349127933654) / Math.Sqrt((2.3636226314410327 / (27)) + (23.533203654904046 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.0343119261699 = (3.6081196637634685 - 93.9349127933654) / 3.6081196637634685 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt16>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 72.4522916336276 > 3.45005071826872.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -51.98726728150891 (T) = (0 -68.75574372136462) / Math.Sqrt((1.7393343853638648 / (27)) + (12.060030346514944 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -18.227042749140352 = (3.57599161859869 - 68.75574372136462) / 3.57599161859869 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OneBenchmark - Duration of single invocation	2.19 ns	21.89 ns	10.02	0.69	False
AbsBenchmark - Duration of single invocation	3.19 ns	31.50 ns	9.89	0.55	False
LessThanAnyBenchmark - Duration of single invocation	2.49 ns	25.13 ns	10.10	0.68	False
DivisionOperatorBenchmark - Duration of single invocation	3.31 ns	30.32 ns	9.15	0.60	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.87 ns	19.60 ns	6.82	0.69	False
ZeroBenchmark - Duration of single invocation	1.94 ns	16.77 ns	8.63	0.64	True
LessThanOrEqualBenchmark - Duration of single invocation	3.15 ns	51.93 ns	16.46	0.59	False
XorBenchmark - Duration of single invocation	3.01 ns	48.49 ns	16.08	0.55	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.48 ns	19.07 ns	7.70	0.72	False
SubtractionOperatorBenchmark - Duration of single invocation	3.18 ns	32.59 ns	10.23	0.59	False
LessThanAllBenchmark - Duration of single invocation	2.52 ns	31.43 ns	12.46	0.62	False
ConditionalSelectBenchmark - Duration of single invocation	3.45 ns	176.15 ns	51.08	0.62	True
AndNotBenchmark - Duration of single invocation	3.47 ns	84.87 ns	24.47	0.57	True
LessThanBenchmark - Duration of single invocation	3.69 ns	55.34 ns	14.98	0.55	False
OnesComplementBenchmark - Duration of single invocation	3.18 ns	40.81 ns	12.84	0.63	True
DivideBenchmark - Duration of single invocation	5.65 ns	40.07 ns	7.09	0.59	False
EqualityOperatorBenchmark - Duration of single invocation	2.30 ns	17.07 ns	7.42	0.72	False
AddBenchmark - Duration of single invocation	3.47 ns	36.32 ns	10.47	0.57	False
CountBenchmark - Duration of single invocation	0.08 ns	15.63 ns	207.59	0.91	True
BitwiseOrBenchmark - Duration of single invocation	3.59 ns	52.56 ns	14.66	0.57	True
MinBenchmark - Duration of single invocation	3.38 ns	39.22 ns	11.61	0.55	False
AddOperatorBenchmark - Duration of single invocation	3.25 ns	33.57 ns	10.34	0.60	False
OnesComplementOperatorBenchmark - Duration of single invocation	5.04 ns	40.01 ns	7.94	0.63	True
InequalityOperatorBenchmark - Duration of single invocation	2.47 ns	17.42 ns	7.07	0.72	False
EqualsAllBenchmark - Duration of single invocation	3.71 ns	29.38 ns	7.92	0.70	False
GreaterThanBenchmark - Duration of single invocation	1.52 ns	40.59 ns	26.75	0.56	False
MultiplyBenchmark - Duration of single invocation	3.77 ns	39.51 ns	10.47	0.60	False
GreaterThanOrEqualBenchmark - Duration of single invocation	3.33 ns	42.14 ns	12.65	0.58	False
GreaterThanAnyBenchmark - Duration of single invocation	1.82 ns	32.63 ns	17.88	0.63	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.18 ns	55.51 ns	17.47	0.54	True
DotBenchmark - Duration of single invocation	2.40 ns	56.65 ns	23.61	0.66	False
SubtractBenchmark - Duration of single invocation	3.31 ns	41.38 ns	12.51	0.60	False
GreaterThanAllBenchmark - Duration of single invocation	2.49 ns	18.74 ns	7.54	0.65	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.33 ns	55.17 ns	16.56	0.58	True
MaxBenchmark - Duration of single invocation	3.14 ns	45.53 ns	14.49	0.61	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.52 ns	34.48 ns	13.68	0.63	False
BitwiseAndBenchmark - Duration of single invocation	3.27 ns	52.68 ns	16.11	0.54	True
LessThanOrEqualAllBenchmark - Duration of single invocation	2.73 ns	32.80 ns	12.03	0.65	False
EqualsAnyBenchmark - Duration of single invocation	2.11 ns	32.06 ns	15.19	0.63	False
MultiplyOperatorBenchmark - Duration of single invocation	3.20 ns	31.63 ns	9.88	0.61	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.15 ns	52.19 ns	16.59	0.65	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Single>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Single>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.89005164731747 > 2.1359776662851355.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -69.04310376531808 (T) = (0 -22.021106906208523) / Math.Sqrt((0.23572920082085083 / (27)) + (0.6019404499470123 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.93565117851352 = (2.0136987314917123 - 22.021106906208523) / 2.0136987314917123 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.49666694767234 > 3.348255064197997.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.791861901850826 (T) = (0 -34.688997914308835) / Math.Sqrt((0.5746319182306151 / (25)) + (13.854280923462657 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -9.934434952761043 = (3.1724545497021364 - 34.688997914308835) / 3.1724545497021364 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.126835839892657 > 2.6505211598473455.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.71273924865494 (T) = (0 -21.846066575470488) / Math.Sqrt((0.36594558010865386 / (26)) + (4.254933156753451 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.672081754303473 = (2.847475727590683 - 21.846066575470488) / 2.847475727590683 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.321443899198822 > 3.4894860853038154.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.51294295302928 (T) = (0 -32.61725865927934) / Math.Sqrt((1.138716920390249 / (26)) + (6.083915960168221 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.42968480091526 = (3.4589977658758495 - 32.61725865927934) / 3.4589977658758495 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.60108776364361 > 2.626014516673608.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.40697213093201 (T) = (0 -20.00735928638521) / Math.Sqrt((0.4234371214778535 / (27)) + (2.867087077672722 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.597753108390931 = (2.6333258005303115 - 20.00735928638521) / 2.6333258005303115 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.77382170947 > 2.0369367239472354.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -108.1335179685851 (T) = (0 -16.522162197701142) / Math.Sqrt((0.24872097223893833 / (27)) + (0.06826890155411448 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.802842828969376 = (2.1174541843082904 - 16.522162197701142) / 2.1174541843082904 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.92529488606659 > 3.2596371682089327.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.298193670632315 (T) = (0 -56.01832285700961) / Math.Sqrt((0.503512672173999 / (27)) + (15.073814248043538 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -16.571754850889626 = (3.1879754374204405 - 56.01832285700961) / 3.1879754374204405 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.49260147814686 > 3.4607803880853036.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.648940813204376 (T) = (0 -54.0289883396922) / Math.Sqrt((0.12383568214593699 / (25)) + (40.05511641822191 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -15.2518894338317 = (3.3244742748015246 - 54.0289883396922) / 3.3244742748015246 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.0662605140108 > 2.599489958561067.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.0409130774948 (T) = (0 -21.080971289850197) / Math.Sqrt((0.20683235730792746 / (26)) + (9.438532271953903 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.402331357857494 = (2.5089431006712433 - 21.080971289850197) / 2.5089431006712433 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.59095166182353 > 3.6066420280623737.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.51475828657121 (T) = (0 -31.265472915083528) / Math.Sqrt((0.5596976801362833 / (25)) + (2.919802854764505 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.782069163285265 = (3.5601487911064797 - 31.265472915083528) / 3.5601487911064797 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.43326619511813 > 2.568741607859313.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -83.7810348953177 (T) = (0 -32.706966841871825) / Math.Sqrt((0.27498051747342145 / (27)) + (0.9495130929876507 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.43403460974068 = (2.6304387810091474 - 32.706966841871825) / 2.6304387810091474 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 176.146365936421 > 3.711700429882548.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -291.48459593926606 (T) = (0 -176.82191641755665) / Math.Sqrt((0.44260242027187857 / (27)) + (2.69661550270965 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -49.16690261470755 = (3.5246727862707896 - 176.82191641755665) / 3.5246727862707896 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 84.86681822880152 > 3.5660679556906243.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -94.03707476252549 (T) = (0 -86.53943777354763) / Math.Sqrt((0.3119959519000925 / (26)) + (6.183812762902407 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -25.845358457682973 = (3.2236275745753953 - 86.53943777354763) / 3.2236275745753953 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.33663048665457 > 3.4634645526541825.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.93411965838746 (T) = (0 -54.224234342940676) / Math.Sqrt((0.2030926376565862 / (27)) + (10.745359983770728 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -16.13614247138312 = (3.1643197664523175 - 54.224234342940676) / 3.1643197664523175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.805756907547085 > 3.4275941135488934.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.67379410347027 (T) = (0 -40.63379357906585) / Math.Sqrt((0.8064604265529526 / (25)) + (7.912016099791816 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -10.3750067112166 = (3.5721995257372394 - 40.63379357906585) / 3.5721995257372394 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.073950644547004 > 4.576982227346217.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.287583453385412 (T) = (0 -41.03799770005861) / Math.Sqrt((0.6117238429075166 / (27)) + (9.030142447704668 / (6))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (6) - 2, .025) and -10.390779270076692 = (3.602738384007182 - 41.03799770005861) / 3.602738384007182 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.071025273502972 > 2.376642602208786.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.72807143171376 (T) = (0 -18.09365557503087) / Math.Sqrt((0.3707316216137286 / (26)) + (6.297345835316929 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.139115425591012 = (2.2230493891437866 - 18.09365557503087) / 2.2230493891437866 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.32334321564988 > 3.6883674053678983.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.354162201547005 (T) = (0 -41.39265355103252) / Math.Sqrt((0.32561626994639986 / (27)) + (13.367689192648571 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.501113139977194 = (3.3111174251085953 - 41.39265355103252) / 3.3111174251085953 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.634227153433375 > 0.04583479125661966.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -72.67542582040124 (T) = (0 -15.157425343489125) / Math.Sqrt((0.06368490296708774 / (27)) + (0.32385836018739217 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -130.78367362262122 = (0.11501747467515802 - 15.157425343489125) / 0.11501747467515802 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.56403839077115 > 3.673363987174244.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -128.9470731593993 (T) = (0 -52.27064574384016) / Math.Sqrt((0.3900867546811148 / (27)) + (1.0330791543850457 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.330213440828075 = (3.4096489227365065 - 52.27064574384016) / 3.4096489227365065 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.22334633962194 > 3.4967214530042834.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.9073796500488 (T) = (0 -38.83444325577324) / Math.Sqrt((0.26432000213933377 / (27)) + (8.167350805135042 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.438244777131208 = (3.3951400772097475 - 38.83444325577324) / 3.3951400772097475 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.570559621114995 > 3.441469048013616.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.626712969324405 (T) = (0 -33.51596902507338) / Math.Sqrt((1.172147137781679 / (26)) + (8.347991257027271 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.186844424799622 = (3.6482569504059508 - 33.51596902507338) / 3.6482569504059508 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.01010144653329 > 4.923703864795137.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.76464779860055 (T) = (0 -41.10722062917263) / Math.Sqrt((1.0472731477928943 / (25)) + (4.4977912028827935 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.636913445237249 = (4.759480442847422 - 41.10722062917263) / 4.759480442847422 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.423679781016688 > 2.6220471684079216.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.01390809597572 (T) = (0 -18.49791273969226) / Math.Sqrt((0.8177157436575478 / (27)) + (3.8653470636300145 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.791491097195325 = (2.723689463029897 - 18.49791273969226) / 2.723689463029897 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.3802697551583 > 2.464108623928081.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.642137930004168 (T) = (0 -29.083265117668134) / Math.Sqrt((0.29123550093611017 / (27)) + (7.299842489214417 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.528047807987459 = (2.5228265532970084 - 29.083265117668134) / 2.5228265532970084 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.58997156947246 > 3.334334963129396.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -52.11468294293483 (T) = (0 -40.98613433754718) / Math.Sqrt((1.3558399392579192 / (27)) + (3.7451137581766454 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.828020874425725 = (3.465172641533501 - 40.98613433754718) / 3.465172641533501 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.506009616685006 > 3.3468129433331986.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.35623587857717 (T) = (0 -40.543043279862964) / Math.Sqrt((1.4449093835001223 / (27)) + (3.4530345210448092 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.997856321961244 = (3.37919059804473 - 40.543043279862964) / 3.37919059804473 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.144549964715395 > 3.6635632665555176.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.67559431519388 (T) = (0 -43.044259685971404) / Math.Sqrt((0.981506778405778 / (27)) + (8.718972222350372 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.059716951475474 = (3.061531027582614 - 43.044259685971404) / 3.061531027582614 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.6292710986562 > 2.1550769213397882.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.427828097160905 (T) = (0 -35.47566457833782) / Math.Sqrt((0.8026273812162174 / (26)) + (9.163887660110264 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.341394822032898 = (2.473655109462298 - 35.47566457833782) / 2.473655109462298 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.513179662168554 > 3.429686800950129.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -92.53067987267845 (T) = (0 -53.13768910642911) / Math.Sqrt((0.5269935850952575 / (27)) + (2.1618901037252067 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.95973102263715 = (3.3294852545484037 - 53.13768910642911) / 3.3294852545484037 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.65378091170013 > 2.544430727567824.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.90131276369235 (T) = (0 -52.37435762044932) / Math.Sqrt((0.6485242610937273 / (26)) + (17.051421354634673 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -19.20864785304589 = (2.5916804529084487 - 52.37435762044932) / 2.5916804529084487 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.384752975491054 > 3.4971520617772547.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.453293268932168 (T) = (0 -42.2622375617289) / Math.Sqrt((0.8991757513592029 / (26)) + (19.917814466786012 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.391247236062748 = (3.41065243527152 - 42.2622375617289) / 3.41065243527152 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.74005789172099 > 2.60777633075377.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.33478142917547 (T) = (0 -18.925274643906086) / Math.Sqrt((1.4079924447842285 / (27)) + (2.7632573933828852 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.4127456014713236 = (2.951196853897326 - 18.925274643906086) / 2.951196853897326 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.17328807550193 > 3.451581221337687.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.379152862019865 (T) = (0 -54.52573413211121) / Math.Sqrt((1.7916105849300965 / (27)) + (7.63077698271416 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.978695226379632 = (3.6402192118899364 - 54.52573413211121) / 3.6402192118899364 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.52918478186503 > 3.4011485775314587.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.749688839376937 (T) = (0 -38.68757140437861) / Math.Sqrt((1.1797450314782225 / (26)) + (14.68511915612259 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.47369245777871 = (3.371850129916108 - 38.68757140437861) / 3.371850129916108 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.483564047097566 > 2.692813036243417.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.243086463701886 (T) = (0 -35.143840613454174) / Math.Sqrt((0.3850363430539885 / (27)) + (4.394934494903596 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.118072194181009 = (2.6790400367703024 - 35.143840613454174) / 2.6790400367703024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.67782032708581 > 3.4668426713420204.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -141.64436280670785 (T) = (0 -53.21445454091214) / Math.Sqrt((0.4243201362879317 / (26)) + (0.8595571542865584 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.726780438987692 = (3.3836839490039625 - 53.21445454091214) / 3.3836839490039625 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.79551781878746 > 2.6378189148629025.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.801503206015994 (T) = (0 -33.79829736936106) / Math.Sqrt((1.3342940436539819 / (27)) + (4.544594131528756 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.401389470739476 = (2.5219994869305222 - 33.79829736936106) / 2.5219994869305222 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.05911849145836 > 2.645537409032038.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.828852033099988 (T) = (0 -32.539600550927894) / Math.Sqrt((0.6403429958524226 / (27)) + (7.861344606981356 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.440211161397102 = (2.6156791174012133 - 32.539600550927894) / 2.6156791174012133 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.629680011732788 > 3.381864496875361.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.951241538571765 (T) = (0 -32.83333823435127) / Math.Sqrt((0.7617833290027148 / (26)) + (7.510037316236385 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.759074332754016 = (3.3643906291556736 - 32.83333823435127) / 3.3643906291556736 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.189910306917014 > 3.474744259938219.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -67.51388847389505 (T) = (0 -52.90284592473824) / Math.Sqrt((2.101915105205765 / (27)) + (3.6140848706218285 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.032168066112332 = (3.7701120507883985 - 52.90284592473824) / 3.7701120507883985 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
DivisionOperatorBenchmark - Duration of single invocation	3.23 ns	52.36 ns	16.21	0.60	False
CountBenchmark - Duration of single invocation	0.13 ns	19.33 ns	153.47	0.90	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.17 ns	69.04 ns	21.80	0.58	False
EqualsAnyBenchmark - Duration of single invocation	2.48 ns	49.38 ns	19.93	0.61	False
DivideBenchmark - Duration of single invocation	1.09 ns	58.67 ns	53.83	0.59	False
GreaterThanAnyBenchmark - Duration of single invocation	2.55 ns	59.14 ns	23.15	0.58	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	1.86 ns	45.53 ns	24.43	0.62	False
NegateBenchmark - Duration of single invocation	20.95 ns	77.59 ns	3.70	0.56	False
MultiplyBenchmark - Duration of single invocation	3.41 ns	62.25 ns	18.25	0.60	False
EqualsAllBenchmark - Duration of single invocation	1.60 ns	38.61 ns	24.08	0.73	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.28 ns	49.05 ns	14.97	0.59	True
EqualsStaticBenchmark - Duration of single invocation	3.20 ns	51.18 ns	16.00	0.61	False
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.52 ns	45.35 ns	18.02	0.62	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.33 ns	48.40 ns	14.54	0.62	True
BitwiseAndBenchmark - Duration of single invocation	3.28 ns	55.59 ns	16.96	0.59	True
EqualityOperatorBenchmark - Duration of single invocation	2.16 ns	33.88 ns	15.66	0.74	False
AbsBenchmark - Duration of single invocation	3.42 ns	49.98 ns	14.62	0.62	False
BitwiseAndOperatorBenchmark - Duration of single invocation	4.55 ns	50.75 ns	11.15	0.56	True
UnaryNegateOperatorBenchmark - Duration of single invocation	23.55 ns	66.36 ns	2.82	0.55	False
DotBenchmark - Duration of single invocation	3.15 ns	67.49 ns	21.40	0.63	False
MultiplyOperatorBenchmark - Duration of single invocation	5.82 ns	53.44 ns	9.18	0.59	False
GreaterThanBenchmark - Duration of single invocation	3.08 ns	66.56 ns	21.60	0.57	False
LessThanAllBenchmark - Duration of single invocation	2.50 ns	29.05 ns	11.62	0.68	False
LessThanOrEqualAllBenchmark - Duration of single invocation	1.14 ns	31.20 ns	27.37	0.69	False
ConditionalSelectBenchmark - Duration of single invocation	4.37 ns	53.50 ns	12.23	0.65	False
GreaterThanAllBenchmark - Duration of single invocation	3.37 ns	29.72 ns	8.83	0.67	False
LessThanBenchmark - Duration of single invocation	3.30 ns	51.61 ns	15.64	0.62	False
LessThanOrEqualBenchmark - Duration of single invocation	3.15 ns	56.14 ns	17.84	0.66	False
SquareRootBenchmark - Duration of single invocation	32.00 ns	48.19 ns	1.51	0.63	False
AllBitsSetBenchmark - Duration of single invocation	0.20 ns	29.36 ns	148.48	0.68	True
MinBenchmark - Duration of single invocation	3.62 ns	53.74 ns	14.83	0.57	False
AddBenchmark - Duration of single invocation	3.01 ns	61.71 ns	20.49	0.58	False
SubtractionOperatorBenchmark - Duration of single invocation	3.65 ns	56.16 ns	15.38	0.56	False
MaxBenchmark - Duration of single invocation	3.17 ns	54.54 ns	17.21	0.60	False
AddOperatorBenchmark - Duration of single invocation	3.13 ns	59.58 ns	19.03	0.57	False
InequalityOperatorBenchmark - Duration of single invocation	3.42 ns	26.09 ns	7.63	0.73	False
EqualsBenchmark - Duration of single invocation	6.87 ns	168.72 ns	24.56	0.62	False
SumBenchmark - Duration of single invocation	2.16 ns	39.38 ns	18.22	0.64	False
LessThanAnyBenchmark - Duration of single invocation	4.92 ns	45.25 ns	9.19	0.61	False
OnesComplementBenchmark - Duration of single invocation	3.38 ns	43.43 ns	12.84	0.55	True
ZeroBenchmark - Duration of single invocation	1.94 ns	16.50 ns	8.52	0.65	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.01 ns	25.15 ns	12.52	0.70	False
XorBenchmark - Duration of single invocation	3.34 ns	48.31 ns	14.46	0.57	True
SubtractBenchmark - Duration of single invocation	3.14 ns	59.52 ns	18.95	0.62	False
OnesComplementOperatorBenchmark - Duration of single invocation	8.52 ns	42.24 ns	4.96	0.63	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.35598214951337 > 3.654349666775463.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.9957714893573 (T) = (0 -54.447889563861246) / Math.Sqrt((0.946106325603299 / (26)) + (7.704604428558549 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.710139331980626 = (3.465780182676256 - 54.447889563861246) / 3.465780182676256 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.32828207997907 > 0.13410263193223135.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.27415446700752 (T) = (0 -16.077749231575783) / Math.Sqrt((0.23303337992585618 / (27)) + (3.080230178491545 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -72.02655075852232 = (0.22016306486582188 - 16.077749231575783) / 0.22016306486582188 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.039137856661 > 3.750687188581177.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.590628354079314 (T) = (0 -59.212402914898014) / Math.Sqrt((1.7379922473780975 / (27)) + (20.065079589163904 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.864481390608823 = (3.732388185720936 - 59.212402914898014) / 3.732388185720936 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.38329857400062 > 2.589655829771696.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -63.79400902736032 (T) = (0 -48.05451338025164) / Math.Sqrt((1.0171748557505942 / (27)) + (3.760833752175145 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.51197927506402 = (2.5958603705321757 - 48.05451338025164) / 2.5958603705321757 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.66951015803717 > 3.665804537115656.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.367403255419937 (T) = (0 -66.30531118570576) / Math.Sqrt((2.212407769206761 / (27)) + (44.48708466563055 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.064339715120187 = (3.6705084288360115 - 66.30531118570576) / 3.6705084288360115 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.14497375218323 > 2.7231548110002444.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.157282208920538 (T) = (0 -48.7141099853347) / Math.Sqrt((0.4544318364424486 / (27)) + (23.025873532809555 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -18.436728941735872 = (2.506291574645178 - 48.7141099853347) / 2.506291574645178 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.528612715014326 > 2.5831678801481464.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.85528758489124 (T) = (0 -48.15523100685821) / Math.Sqrt((0.29001983797289954 / (27)) + (6.893904105171864 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -18.100405023849362 = (2.5211628207218686 - 48.15523100685821) / 2.5211628207218686 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 77.58570479990577 > 22.67729944388498.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.710293009822465 (T) = (0 -79.56334898081234) / Math.Sqrt((3.547733536466646 / (25)) + (18.975415935968062 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -2.4676608956823 = (22.944385675046632 - 79.56334898081234) / 22.944385675046632 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 62.25220897655833 > 3.202137135889807.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.388602158549837 (T) = (0 -65.66529317510589) / Math.Sqrt((2.113827338550726 / (26)) + (30.91560372536298 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -18.807112392896297 = (3.315238075725584 - 65.66529317510589) / 3.315238075725584 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.60933997208941 > 2.4693331336976287.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.7322016135905 (T) = (0 -37.39025118402259) / Math.Sqrt((0.42554734376701775 / (26)) + (5.457764029041954 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.897545647517193 = (2.5098262538469887 - 37.39025118402259) / 2.5098262538469887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.04557724890156 > 3.493827596366463.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -126.86100520269405 (T) = (0 -48.44602652992123) / Math.Sqrt((1.1159088291785269 / (26)) + (0.646038948159725 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.641373405200506 = (3.8323388588451257 - 48.44602652992123) / 3.8323388588451257 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.18237346457038 > 3.3605956418162664.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.351838200537372 (T) = (0 -55.17649793740337) / Math.Sqrt((0.4403767324422575 / (27)) + (28.490446016833847 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.032103060006555 = (3.4416257013121276 - 55.17649793740337) / 3.4416257013121276 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.34704220370833 > 2.7671475766314337.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.18596754477302 (T) = (0 -49.09927200273502) / Math.Sqrt((0.4751758354729875 / (26)) + (11.720953208133754 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -17.951515064137663 = (2.590783472274814 - 49.09927200273502) / 2.590783472274814 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.40415673755391 > 3.4744770009137436.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.993420845542941 (T) = (0 -52.31890052574134) / Math.Sqrt((1.5643439345194716 / (27)) + (73.13846353368002 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.739917553974358 = (3.807803090536578 - 52.31890052574134) / 3.807803090536578 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.58631131553781 > 3.407958921831388.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.92864141133296 (T) = (0 -50.338713206201874) / Math.Sqrt((0.9253353378225406 / (26)) + (7.082649473557355 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.873203533520265 = (3.384523925377054 - 50.338713206201874) / 3.384523925377054 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.88479495770491 > 2.305187433126788.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.00122510645046 (T) = (0 -29.606564096978726) / Math.Sqrt((0.764608304459204 / (25)) + (5.22641479224536 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -11.78677400626317 = (2.315405283809423 - 29.606564096978726) / 2.315405283809423 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.98042897013313 > 3.3512916739354828.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -62.936844108058466 (T) = (0 -49.9279326199492) / Math.Sqrt((1.0418023944915313 / (27)) + (4.023029948512662 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.806224172841542 = (3.6163350670607888 - 49.9279326199492) / 3.6163350670607888 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.75218488112923 > 3.778856150029821.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -115.10436788462414 (T) = (0 -49.272898677528076) / Math.Sqrt((0.3765595226436711 / (27)) + (1.1587050935337562 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.465096808624912 = (3.406330377833958 - 49.272898677528076) / 3.406330377833958 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.UnaryNegateOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.35849593936884 > 23.24585166733585.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.450732395601406 (T) = (0 -72.02047741864274) / Math.Sqrt((3.0096589087848162 / (26)) + (21.31903756196068 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -2.1435331390253065 = (22.9106786006314 - 72.02047741864274) / 22.9106786006314 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.49013305265937 > 2.966309226355318.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -58.24411506880537 (T) = (0 -67.04713346979933) / Math.Sqrt((0.8823990172438206 / (27)) + (9.460529071606606 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -22.609561738080796 = (2.839829650952663 - 67.04713346979933) / 2.839829650952663 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.444923502257595 > 3.691306574286288.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -51.210229108661075 (T) = (0 -55.94808362156928) / Math.Sqrt((0.9553461890804901 / (25)) + (8.028385105808038 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -14.205468921065718 = (3.6794711108224085 - 55.94808362156928) / 3.6794711108224085 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.56201179585535 > 3.3091095079826434.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.585709332463765 (T) = (0 -56.25487162505903) / Math.Sqrt((0.36817073899563924 / (27)) + (27.55762894377005 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -15.478299693882997 = (3.413875986606902 - 56.25487162505903) / 3.413875986606902 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.05016639857536 > 2.6612333151161756.
IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.6265542168276 (T) = (0 -29.61129207945786) / Math.Sqrt((0.42158163943610893 / (26)) + (2.224903807008311 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.016485081868716 = (2.6879074277686876 - 29.61129207945786) / 2.6879074277686876 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.201196417359643 > 2.463854768564729.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.288404212190038 (T) = (0 -29.89015343844766) / Math.Sqrt((0.7129190914873108 / (27)) + (12.91058570218936 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.383246563989745 = (2.6258021620126777 - 29.89015343844766) / 2.6258021620126777 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.49673539796989 > 3.619160135200458.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -190.24520011457935 (T) = (0 -52.256825165147035) / Math.Sqrt((0.4154012286338164 / (27)) + (0.397768422128297 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.070275092182497 = (3.7139874538900197 - 52.256825165147035) / 3.7139874538900197 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.718873140623746 > 2.6445000873821627.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.85734883812093 (T) = (0 -28.79417514753921) / Math.Sqrt((0.6022892754780713 / (27)) + (11.339537512030299 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.214253880176864 = (2.5676407414351394 - 28.79417514753921) / 2.5676407414351394 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.609515244723646 > 3.458014698015803.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.64224075820919 (T) = (0 -55.74133529089656) / Math.Sqrt((0.8715709266224516 / (27)) + (24.745747926210367 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.70613358335584 = (3.33657904821443 - 55.74133529089656) / 3.33657904821443 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.137651073518256 > 3.816915111163419.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -55.593274183875884 (T) = (0 -55.99944931967302) / Math.Sqrt((3.1494403687609465 / (27)) + (5.988092787381176 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.053462219291326 = (4.29000738493065 - 55.99944931967302) / 4.29000738493065 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.188835811686 > 30.87336067807557.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.51318593379358 (T) = (0 -48.31577250918777) / Math.Sqrt((8.426312275737995 / (26)) + (3.7913725685010675 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.6604650629157345 = (29.097735079319584 - 48.31577250918777) / 29.097735079319584 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.35988230210044 > 2.0784204355148828.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -106.57984587462182 (T) = (0 -30.28125656680229) / Math.Sqrt((0.5651874657756893 / (27)) + (0.3951314492148728 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.00828690641931 = (2.0176357738637356 - 30.28125656680229) / 2.0176357738637356 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.73540887397768 > 3.4375259307572277.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.37279127577717 (T) = (0 -58.56006780569998) / Math.Sqrt((1.213714548526481 / (26)) + (15.97278655190702 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.78982850288216 = (3.708720952543015 - 58.56006780569998) / 3.708720952543015 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 61.70667950791243 > 3.3929243844682206.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.738738996486575 (T) = (0 -61.37957887142852) / Math.Sqrt((1.6929709926158334 / (27)) + (12.894368273702918 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -16.604587152545477 = (3.4865673554039316 - 61.37957887142852) / 3.4865673554039316 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.16373896313175 > 3.5737608814062978.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.525028318286125 (T) = (0 -54.56515829993414) / Math.Sqrt((0.8571625100666499 / (26)) + (11.389408062267623 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.83556895165183 = (3.2410641099587227 - 54.56515829993414) / 3.2410641099587227 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.541068188638626 > 3.675816908716279.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.07060119432642 (T) = (0 -55.472028165943826) / Math.Sqrt((2.2543207076380862 / (25)) + (13.320086129189448 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -13.952069821760588 = (3.7099899095717346 - 55.472028165943826) / 3.7099899095717346 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.57789831763902 > 3.3056209937958663.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.59764816840963 (T) = (0 -57.28083632066426) / Math.Sqrt((1.1343369981024487 / (26)) + (26.01620998795959 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.137948071692598 = (3.549449785449487 - 57.28083632066426) / 3.549449785449487 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.088671749885687 > 2.599144736080085.
IsChangePoint: Marked as a change because one of 1/27/2023 8:07:09 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.236531842275596 (T) = (0 -31.024854498243513) / Math.Sqrt((0.25628298363999663 / (26)) + (15.887571010309426 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.735367272996628 = (2.436117768195575 - 31.024854498243513) / 2.436117768195575 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.EqualsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 168.72137503797978 > 6.954458523507778.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.30790029297557 (T) = (0 -167.69267824879125) / Math.Sqrt((1.7071414880939457 / (27)) + (134.42426326135512 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.784459241521297 = (6.260820005237734 - 167.69267824879125) / 6.260820005237734 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.38011478360061 > 2.2691738664877623.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.230538473210867 (T) = (0 -35.37258071732771) / Math.Sqrt((2.3885418828717633 / (27)) + (25.593097872983837 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.263688589604197 = (2.317433332688619 - 35.37258071732771) / 2.317433332688619 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.25221078442064 > 2.7203283118406203.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -55.495728207322095 (T) = (0 -47.87131076280389) / Math.Sqrt((0.7316113040930401 / (26)) + (5.0623759123392285 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -16.379853411908883 = (2.754413954377883 - 47.87131076280389) / 2.754413954377883 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.433437366732264 > 3.336877637419749.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.45987463394571 (T) = (0 -44.321554183992234) / Math.Sqrt((0.8371807097777585 / (27)) + (6.038021441477514 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.123711868779921 = (3.138095324782419 - 44.321554183992234) / 3.138095324782419 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.50064839383935 > 2.071493363508139.
IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.3468370116313 (T) = (0 -17.02271781962922) / Math.Sqrt((0.3277343583557425 / (27)) + (1.1889900193684722 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.3100499480990715 = (2.0484495190697594 - 17.02271781962922) / 2.0484495190697594 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.152453441446355 > 3.2620160430658878.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.97412660123631 (T) = (0 -26.93393380235439) / Math.Sqrt((1.0601729371287645 / (27)) + (2.224452253433362 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.880297966147772 = (2.726024447302742 - 26.93393380235439) / 2.726024447302742 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.30848433102048 > 3.6838846919460106.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -86.26980915660432 (T) = (0 -48.9258106893606) / Math.Sqrt((0.36776609845903907 / (27)) + (2.10974773835345 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.004738210484454 = (3.4935184045591776 - 48.9258106893606) / 3.4935184045591776 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 59.52240271449431 > 3.3353678715075694.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.759136182622115 (T) = (0 -65.68455128030972) / Math.Sqrt((3.182216247260156 / (26)) + (11.456841778076592 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -17.019951511052415 = (3.6451014443641836 - 65.68455128030972) / 3.6451014443641836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.24467071047245 > 6.499083051387761.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -62.07893131882272 (T) = (0 -43.52638695193135) / Math.Sqrt((1.7771221480985835 / (27)) + (2.3567532962476156 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.9557160279325965 = (6.257642890701566 - 43.52638695193135) / 6.257642890701566 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.13 ns	54.99 ns	17.56	0.52	True
EqualsAllBenchmark - Duration of single invocation	2.20 ns	25.09 ns	11.39	0.68	False
MaxBenchmark - Duration of single invocation	5.22 ns	133.26 ns	25.53	0.46	False
InequalityOperatorBenchmark - Duration of single invocation	3.05 ns	26.11 ns	8.57	0.71	False
GreaterThanBenchmark - Duration of single invocation	3.25 ns	181.58 ns	55.87	0.46	False
EqualityOperatorBenchmark - Duration of single invocation	2.16 ns	19.94 ns	9.21	0.69	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.13 ns	28.00 ns	13.17	0.71	False
CountBenchmark - Duration of single invocation	0.00 ns	15.66 ns	∞	0.90	True
OnesComplementOperatorBenchmark - Duration of single invocation	5.90 ns	42.68 ns	7.23	0.62	True
SubtractionOperatorBenchmark - Duration of single invocation	3.55 ns	100.31 ns	28.26	0.45	False
ZeroBenchmark - Duration of single invocation	2.14 ns	16.83 ns	7.86	0.64	True
AndNotBenchmark - Duration of single invocation	3.24 ns	48.94 ns	15.12	0.53	True
XorBenchmark - Duration of single invocation	5.65 ns	48.61 ns	8.60	0.62	True
LessThanBenchmark - Duration of single invocation	3.28 ns	137.26 ns	41.91	0.44	False
LessThanAllBenchmark - Duration of single invocation	3.11 ns	24.96 ns	8.03	0.74	False
AbsBenchmark - Duration of single invocation	2.84 ns	118.24 ns	41.59	0.48	False
MinBenchmark - Duration of single invocation	3.24 ns	141.10 ns	43.61	0.45	False
EqualsAnyBenchmark - Duration of single invocation	4.94 ns	117.97 ns	23.90	0.53	False
LessThanAnyBenchmark - Duration of single invocation	2.46 ns	118.78 ns	48.33	0.54	False
SumBenchmark - Duration of single invocation	2.76 ns	89.39 ns	32.36	0.54	False
BitwiseAndBenchmark - Duration of single invocation	3.42 ns	48.44 ns	14.15	0.53	True
SubtractBenchmark - Duration of single invocation	3.18 ns	112.40 ns	35.39	0.45	False
AllBitsSetBenchmark - Duration of single invocation	1.97 ns	29.80 ns	15.09	0.64	True
BitwiseOrOperatorBenchmark - Duration of single invocation	2.38 ns	48.18 ns	20.25	0.61	True
AddOperatorBenchmark - Duration of single invocation	3.32 ns	97.81 ns	29.45	0.44	False
GreaterThanAllBenchmark - Duration of single invocation	2.47 ns	116.37 ns	47.11	0.55	False
MultiplyOperatorBenchmark - Duration of single invocation	16.35 ns	95.28 ns	5.83	0.38	False
GreaterThanAnyBenchmark - Duration of single invocation	6.92 ns	31.66 ns	4.57	0.67	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.35 ns	34.41 ns	14.66	0.64	False
EqualsStaticBenchmark - Duration of single invocation	7.09 ns	129.38 ns	18.24	0.42	False
ConditionalSelectBenchmark - Duration of single invocation	3.46 ns	52.00 ns	15.01	0.67	False
SquareRootBenchmark - Duration of single invocation	72.06 ns	122.73 ns	1.70	0.33	False
BitwiseOrBenchmark - Duration of single invocation	3.54 ns	50.78 ns	14.35	0.57	True
OnesComplementBenchmark - Duration of single invocation	3.72 ns	41.75 ns	11.21	0.64	True
MultiplyBenchmark - Duration of single invocation	14.76 ns	110.35 ns	7.48	0.32	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.29 ns	117.32 ns	51.23	0.49	False
GreaterThanOrEqualBenchmark - Duration of single invocation	2.71 ns	176.80 ns	65.14	0.47	False
DotBenchmark - Duration of single invocation	19.12 ns	174.61 ns	9.13	0.40	False
AddBenchmark - Duration of single invocation	4.24 ns	111.07 ns	26.19	0.40	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.98840094454093 > 3.4460883855831805.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.63790509120183 (T) = (0 -48.96152300362738) / Math.Sqrt((0.03651925143839789 / (27)) + (6.763408799781628 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.90713181982264 = (3.284436174269364 - 48.96152300362738) / 3.284436174269364 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.092990643642 > 2.472308817738458.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.711585464552485 (T) = (0 -26.00811059257462) / Math.Sqrt((0.5305955421660824 / (27)) + (2.9836067619664077 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.933362297949568 = (2.3787843010975824 - 26.00811059257462) / 2.3787843010975824 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 133.2638467334101 > 3.589504822728849.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -55.176356936133494 (T) = (0 -137.53957812189458) / Math.Sqrt((0.8131009655228296 / (27)) + (46.99167798242096 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -38.63217450880996 = (3.470402011156881 - 137.53957812189458) / 3.470402011156881 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.110225667489065 > 2.6862677770671.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.169207457398363 (T) = (0 -19.354879928817585) / Math.Sqrt((1.3486490109235842 / (27)) + (9.303084657690155 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.3059012639677805 = (2.649211812411778 - 19.354879928817585) / 2.649211812411778 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 181.58479465794997 > 3.5279431626665696.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -56.95251762726751 (T) = (0 -183.74089071900696) / Math.Sqrt((0.6059925588472661 / (26)) + (79.9967703964269 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -52.48944312075522 = (3.4350870003301823 - 183.74089071900696) / 3.4350870003301823 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.938957023868007 > 2.1727437566694316.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.57922313680835 (T) = (0 -19.93743727241053) / Math.Sqrt((0.7161363803206106 / (27)) + (4.645378452598021 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.5090717170712145 = (2.3430801778778414 - 19.93743727241053) / 2.3430801778778414 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.002942218740667 > 2.5257022537391456.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.63336743710933 (T) = (0 -29.8191170038972) / Math.Sqrt((0.339543686830111 / (27)) + (9.716381929108433 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.779900643159424 = (2.531355561238382 - 29.8191170038972) / 2.531355561238382 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.655818037691244 > 0.004803329140960007.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.49869823769828 (T) = (0 -15.584496632434783) / Math.Sqrt((0.07631642136594832 / (25)) + (1.3393814701876408 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -152.10923104850642 = (0.1017867866340304 - 15.584496632434783) / 0.1017867866340304 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.6815750654516 > 5.977630155189689.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -62.27864717167513 (T) = (0 -41.97603488586665) / Math.Sqrt((1.801937421120141 / (26)) + (2.1203444968475607 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.037364277073001 = (5.9647381083597155 - 41.97603488586665) / 5.9647381083597155 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 100.31261253797786 > 3.5774439898016452.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -68.60685441266902 (T) = (0 -100.16484335741902) / Math.Sqrt((0.591097304037124 / (27)) + (15.82744907127856 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -30.978562224228344 = (3.132249744534474 - 100.16484335741902) / 3.132249744534474 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.8288503110742 > 2.1192349030578304.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.361244501072417 (T) = (0 -17.2004409983039) / Math.Sqrt((0.10854252053254905 / (27)) + (2.2255508519060974 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.060692062228099 = (2.1338665297616437 - 17.2004409983039) / 2.1338665297616437 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.93921441840371 > 3.4502734009999965.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -122.11157161833242 (T) = (0 -48.734285376546225) / Math.Sqrt((1.3112502364253769 / (27)) + (0.7098286547015897 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.971455128533561 = (3.4881324048357274 - 48.734285376546225) / 3.4881324048357274 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.612711159376616 > 3.872816097930553.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -79.4696620538495 (T) = (0 -49.06457998327223) / Math.Sqrt((1.1307981459533232 / (27)) + (2.2590646222238893 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.873801951312554 = (3.8111958043808363 - 49.06457998327223) / 3.8111958043808363 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 137.25974531315381 > 3.456910096708335.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -103.47890556820289 (T) = (0 -130.8753744711888) / Math.Sqrt((0.6997717495326957 / (26)) + (11.914904441584273 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -36.88730885353458 = (3.454332820975201 - 130.8753744711888) / 3.454332820975201 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.956270843591035 > 2.3242128478691213.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.602975577766763 (T) = (0 -29.712382863124144) / Math.Sqrt((0.40814873319502587 / (27)) + (16.998302984842965 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.888838393789937 = (2.4991830050145376 - 29.712382863124144) / 2.4991830050145376 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 118.24444028232867 > 3.310828492696105.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -51.49962143923011 (T) = (0 -122.7578431173454) / Math.Sqrt((0.12473255147375296 / (27)) + (43.04560110700678 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -36.81448431151759 = (3.246318053845723 - 122.7578431173454) / 3.246318053845723 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 141.09927194089587 > 3.414422389009386.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -122.57124610849006 (T) = (0 -135.98234575661263) / Math.Sqrt((0.22805390158798253 / (27)) + (9.29331251290681 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -39.05357995274266 = (3.3950110306507386 - 135.98234575661263) / 3.3950110306507386 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 117.97064367272112 > 3.3758525915641235.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.42755144440527 (T) = (0 -119.6431517437288) / Math.Sqrt((0.5362473532078439 / (26)) + (77.96781733012241 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -43.70631382307756 = (2.6762025654185915 - 119.6431517437288) / 2.6762025654185915 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 118.78204765082828 > 2.502100644739125.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -51.558840930276816 (T) = (0 -119.63576078862046) / Math.Sqrt((0.6971891271356504 / (27)) + (40.98820806249966 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -44.35885361259006 = (2.6375393392970072 - 119.63576078862046) / 2.6375393392970072 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 89.38590935027582 > 2.6007522281211024.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -98.2603427412942 (T) = (0 -91.7336705273132) / Math.Sqrt((0.1977138972640455 / (27)) + (6.538585867380635 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -35.643138306643635 = (2.5034337877845276 - 91.7336705273132) / 2.5034337877845276 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.440686268270795 > 3.472769822784375.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -130.4013349753457 (T) = (0 -48.7734671007236) / Math.Sqrt((0.20548739636389624 / (26)) + (0.9090328616820541 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.719194579096078 = (3.3135961916007792 - 48.7734671007236) / 3.3135961916007792 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 112.39947484317024 > 3.374780982165886.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -79.63646330271898 (T) = (0 -109.58032923112202) / Math.Sqrt((1.0103184079776366 / (27)) + (12.208999933955122 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -32.35346111837884 = (3.285426026468351 - 109.58032923112202) / 3.285426026468351 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.795971145121218 > 2.0757389292435495.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.80939941863627 (T) = (0 -31.535102686402954) / Math.Sqrt((0.2104260115998973 / (27)) + (4.293949234582191 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.608740089872287 = (2.1586462961487762 - 31.535102686402954) / 2.1586462961487762 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.179834945057415 > 3.3692857660023554.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.87921473824468 (T) = (0 -49.81790940683334) / Math.Sqrt((1.1818037473146763 / (26)) + (9.543575034777096 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.503805322269885 = (3.213269798690918 - 49.81790940683334) / 3.213269798690918 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 97.8144351234251 > 3.5191976823216384.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.338158713714964 (T) = (0 -101.99422214513197) / Math.Sqrt((1.0829481994197268 / (27)) + (103.18992792411686 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -26.888695439655184 = (3.657188711670804 - 101.99422214513197) / 3.657188711670804 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 116.36568006688294 > 2.314120380205475.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -129.1776353350003 (T) = (0 -118.4663811449468) / Math.Sqrt((0.44212848907825547 / (25)) + (6.32484911320958 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -49.8613801979687 = (2.3292010693346876 - 118.4663811449468) / 2.3292010693346876 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 95.2790897868239 > 17.281696178294386.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -70.33834284460696 (T) = (0 -98.4276254747873) / Math.Sqrt((1.9612971048163306 / (27)) + (8.895967122231168 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -4.8244469352601 = (16.899050943176267 - 98.4276254747873) / 16.899050943176267 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.65590930473086 > 2.6404525459167454.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -47.90585660693655 (T) = (0 -29.370158244122322) / Math.Sqrt((1.0288288977359397 / (26)) + (2.190599330663934 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.510318147651295 = (2.551637397626178 - 29.370158244122322) / 2.551637397626178 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.41401245466342 > 2.6995121461328835.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.3177346901666 (T) = (0 -30.453434641261254) / Math.Sqrt((0.9576837107427199 / (26)) + (14.93842450043888 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.600222744350587 = (2.4168965310486517 - 30.453434641261254) / 2.4168965310486517 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 129.38244636298487 > 3.444541896118978.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -167.03679723079466 (T) = (0 -128.43304863321634) / Math.Sqrt((1.2196377082279397 / (26)) + (4.08419781677168 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -33.516846229051694 = (3.7208801690902593 - 128.43304863321634) / 3.7208801690902593 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.999968418300455 > 3.759506732464518.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -134.77193065969018 (T) = (0 -53.7997099106975) / Math.Sqrt((0.08982292628933249 / (27)) + (1.081402847111024 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.767330507149511 = (3.6431574335422847 - 53.7997099106975) / 3.6431574335422847 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 122.72830394701792 > 77.48423483488021.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.26940899480841 (T) = (0 -123.88992095528084) / Math.Sqrt((13.742964917571971 / (27)) + (9.42653053860245 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.6414002170758729 = (75.47819213524211 - 123.88992095528084) / 75.47819213524211 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.7776033575591 > 3.4963087529059385.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -68.13030847283542 (T) = (0 -48.63939570571557) / Math.Sqrt((0.7285929825177936 / (27)) + (3.262611232925694 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.095817134084022 = (3.7141168976102708 - 48.63939570571557) / 3.7141168976102708 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.74503952156065 > 3.2361924563832414.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -61.928116417278126 (T) = (0 -42.68336189879751) / Math.Sqrt((0.6377521495483641 / (26)) + (3.078696599468831 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.94566618982151 = (3.060690060826976 - 42.68336189879751) / 3.060690060826976 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 110.3529704957727 > 17.44993074254809.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -106.61586237884708 (T) = (0 -106.69493507416803) / Math.Sqrt((1.3282693408450374 / (27)) + (5.294959165923104 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.35412006363089 = (16.79145719717485 - 106.69493507416803) / 16.79145719717485 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 117.3155234505197 > 2.614812035588866.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -116.5298938117306 (T) = (0 -116.61813841484184) / Math.Sqrt((0.4489931976068969 / (27)) + (7.550673545845141 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -47.287824653789045 = (2.415062994677501 - 116.61813841484184) / 2.415062994677501 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 176.79926274428192 > 3.383845278722663.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -99.26138551096965 (T) = (0 -179.83836987011574) / Math.Sqrt((0.30311006083079817 / (25)) + (25.322539632892518 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -60.98812574339957 = (2.901174502590357 - 179.83836987011574) / 2.901174502590357 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 174.60816750772867 > 19.35593144121902.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -104.10444031557881 (T) = (0 -170.96020192048766) / Math.Sqrt((3.0029724950499497 / (26)) + (16.098970695450884 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.950444428870489 = (19.100750055387156 - 170.96020192048766) / 19.100750055387156 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 111.07494261268783 > 3.6817303114116964.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -90.16168879599955 (T) = (0 -106.8598530450827) / Math.Sqrt((0.7425579094181802 / (27)) + (10.264118569854858 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -28.31905550868403 = (3.6447235830442017 - 106.8598530450827) / 3.6447235830442017 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.16 ns	20.23 ns	9.38	0.68	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.26 ns	52.25 ns	16.05	0.57	True
XorBenchmark - Duration of single invocation	3.24 ns	52.68 ns	16.27	0.54	True
LessThanAnyBenchmark - Duration of single invocation	0.35 ns	25.27 ns	71.35	0.70	False
EqualsAnyBenchmark - Duration of single invocation	2.51 ns	60.47 ns	24.09	0.56	False
GreaterThanBenchmark - Duration of single invocation	3.29 ns	66.33 ns	20.16	0.46	False
AbsBenchmark - Duration of single invocation	1.82 ns	58.35 ns	32.10	0.54	False
LessThanAllBenchmark - Duration of single invocation	2.49 ns	57.84 ns	23.23	0.56	False
GreaterThanAnyBenchmark - Duration of single invocation	2.53 ns	55.84 ns	22.10	0.55	False
AddOperatorBenchmark - Duration of single invocation	3.24 ns	56.11 ns	17.32	0.42	False
BitwiseAndBenchmark - Duration of single invocation	3.31 ns	56.19 ns	16.98	0.59	True
SubtractionOperatorBenchmark - Duration of single invocation	3.16 ns	60.76 ns	19.24	0.48	False
DivideBenchmark - Duration of single invocation	51.10 ns	85.98 ns	1.68	0.31	False
MinBenchmark - Duration of single invocation	3.24 ns	66.26 ns	20.48	0.47	False
EqualsStaticBenchmark - Duration of single invocation	3.52 ns	65.21 ns	18.55	0.51	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.46 ns	52.35 ns	15.15	0.63	True
LessThanOrEqualBenchmark - Duration of single invocation	3.68 ns	93.15 ns	25.33	0.49	False
OnesComplementBenchmark - Duration of single invocation	3.35 ns	39.48 ns	11.78	0.66	True
LessThanBenchmark - Duration of single invocation	3.36 ns	91.01 ns	27.11	0.50	False
InequalityOperatorBenchmark - Duration of single invocation	2.25 ns	17.51 ns	7.77	0.67	False
LessThanOrEqualAllBenchmark - Duration of single invocation	3.42 ns	58.60 ns	17.13	0.61	False
BitwiseOrBenchmark - Duration of single invocation	3.37 ns	51.67 ns	15.33	0.57	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.38 ns	74.16 ns	21.92	0.58	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.66 ns	52.21 ns	14.27	0.58	True
OneBenchmark - Duration of single invocation	2.08 ns	22.38 ns	10.76	0.73	False
SquareRootBenchmark - Duration of single invocation	42.71 ns	72.57 ns	1.70	0.35	False
AddBenchmark - Duration of single invocation	3.78 ns	67.64 ns	17.91	0.49	False
MultiplyBenchmark - Duration of single invocation	3.60 ns	76.12 ns	21.12	0.54	False
EqualityOperatorBenchmark - Duration of single invocation	1.93 ns	16.37 ns	8.48	0.74	False
SubtractBenchmark - Duration of single invocation	3.26 ns	63.01 ns	19.35	0.48	False
MultiplyOperatorBenchmark - Duration of single invocation	3.29 ns	56.68 ns	17.24	0.51	False
MaxBenchmark - Duration of single invocation	4.35 ns	65.64 ns	15.08	0.52	False
DivisionOperatorBenchmark - Duration of single invocation	51.45 ns	68.37 ns	1.33	0.26	False
GreaterThanAllBenchmark - Duration of single invocation	2.66 ns	19.96 ns	7.51	0.71	False
EqualsAllBenchmark - Duration of single invocation	2.23 ns	24.44 ns	10.97	0.72	False
CountBenchmark - Duration of single invocation	0.04 ns	16.22 ns	452.20	0.92	True
DotBenchmark - Duration of single invocation	2.95 ns	88.48 ns	29.94	0.53	False
OnesComplementOperatorBenchmark - Duration of single invocation	4.59 ns	40.04 ns	8.72	0.63	True
AndNotBenchmark - Duration of single invocation	3.34 ns	126.62 ns	37.96	0.51	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.78 ns	18.70 ns	6.74	0.70	False
ConditionalSelectBenchmark - Duration of single invocation	3.42 ns	181.14 ns	52.96	0.58	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int16>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.23114441840793 > 2.327475531044853.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.328825819612536 (T) = (0 -21.130078460949594) / Math.Sqrt((0.8525389232955636 / (27)) + (2.5177980666962028 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.843630440234818 = (2.6939156073137247 - 21.130078460949594) / 2.6939156073137247 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.252046761034556 > 3.459794226800494.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -59.50550418357941 (T) = (0 -53.62854549770923) / Math.Sqrt((1.6101519732385758 / (27)) + (4.501541237839134 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -13.315072913842464 = (3.746299150586318 - 53.62854549770923) / 3.746299150586318 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.68288198806322 > 3.4400253919546637.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -86.88105618664956 (T) = (0 -52.927885433248775) / Math.Sqrt((0.5721526137768301 / (26)) + (2.4105769870079725 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.012304567694677 = (3.5256336023947656 - 52.927885433248775) / 3.5256336023947656 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.269476558345307 > 2.934339000057792.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.59180828808884 (T) = (0 -22.020008595596458) / Math.Sqrt((1.8049925382424896 / (27)) + (10.201106767631355 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.866125218363715 = (2.7993463089285764 - 22.020008595596458) / 2.7993463089285764 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 60.47241846994719 > 2.777612973605041.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.15741654706358 (T) = (0 -61.59575324495223) / Math.Sqrt((0.221719822383739 / (26)) + (11.494652772370571 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -23.666073903257605 = (2.497185141280931 - 61.59575324495223) / 2.497185141280931 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.32617814647476 > 3.446333480253292.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.59909039449824 (T) = (0 -66.80622013226679) / Math.Sqrt((0.10836833239349321 / (26)) + (13.561826618311729 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -18.35284617530961 = (3.452010083018086 - 66.80622013226679) / 3.452010083018086 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.346323661418005 > 3.177432331305978.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.71016618310758 (T) = (0 -62.74906314035044) / Math.Sqrt((0.5574168586518286 / (26)) + (11.26611272424382 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -17.954445908982027 = (3.310519518305479 - 62.74906314035044) / 3.310519518305479 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.836850041497414 > 2.501808254480554.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -82.80381722735461 (T) = (0 -58.793322652619594) / Math.Sqrt((0.8333616343277518 / (27)) + (3.4523910225622805 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -22.651032787924713 = (2.4858670308316158 - 58.793322652619594) / 2.4858670308316158 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.84411790482465 > 2.6932500483104027.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -60.777638671666345 (T) = (0 -57.05506446426211) / Math.Sqrt((0.545741034717591 / (27)) + (6.2312373757771615 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.946167537714516 = (2.7238903900454297 - 57.05506446426211) / 2.7238903900454297 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.11183800530524 > 3.4042120631724626.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -78.0997372363454 (T) = (0 -56.55025255774505) / Math.Sqrt((0.6959321004873118 / (27)) + (3.4827470686020563 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.083389306450432 = (3.516065642648152 - 56.55025255774505) / 3.516065642648152 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.18845958129463 > 3.4568870373808283.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -75.46559555690776 (T) = (0 -53.47009417087286) / Math.Sqrt((0.2884263744911086 / (27)) + (3.422686213738087 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.293593081054409 = (3.4962414579417063 - 53.47009417087286) / 3.4962414579417063 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 60.75716187673416 > 3.4049512074405555.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -74.46613672936341 (T) = (0 -58.266233407482005) / Math.Sqrt((0.7362377636682064 / (27)) + (4.15031427179417 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -16.989149829653364 = (3.2389653740854274 - 58.266233407482005) / 3.2389653740854274 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.97850037687057 > 55.095902872759886.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.34450271906761 (T) = (0 -76.68156145507979) / Math.Sqrt((5.023632355572613 / (25)) + (17.333755695925962 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.4448960935205148 = (53.07064071869958 - 76.68156145507979) / 53.07064071869958 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.25956052277242 > 3.8699452364633484.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -117.79014133289347 (T) = (0 -67.6604424342984) / Math.Sqrt((0.7699576257073292 / (27)) + (2.1440395550459574 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -18.226051591353084 = (3.5192063286009643 - 67.6604424342984) / 3.5192063286009643 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 65.21031120103825 > 3.5400938097367414.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -52.35997107608279 (T) = (0 -66.1104619302917) / Math.Sqrt((0.7826221047094607 / (25)) + (11.050209588027545 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -16.040708483623266 = (3.8795606411450696 - 66.1104619302917) / 3.8795606411450696 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.34940397282749 > 3.58616606315772.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.86862615358347 (T) = (0 -53.27571729556654) / Math.Sqrt((1.977497282274253 / (26)) + (7.339666260305067 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.927220117182365 = (3.5690313988364206 - 53.27571729556654) / 3.5690313988364206 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 93.14695600618106 > 3.534983089525602.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -83.169385166373 (T) = (0 -90.96224738031492) / Math.Sqrt((0.308474594835426 / (27)) + (7.714804237550919 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -27.4412238869929 = (3.1982536244480997 - 90.96224738031492) / 3.1982536244480997 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.48079649483409 > 3.488127830958553.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -79.46964288332187 (T) = (0 -40.63857847393283) / Math.Sqrt((0.6930562372339648 / (26)) + (1.5505079257160754 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.22485146722856 = (3.3242594875588956 - 40.63857847393283) / 3.3242594875588956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 91.00904299877725 > 3.534644965384309.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -132.41795098516215 (T) = (0 -91.21285692330605) / Math.Sqrt((0.8307213452066967 / (27)) + (3.2530683876513646 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -24.082423893939673 = (3.6365248155041576 - 91.21285692330605) / 3.6365248155041576 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.514471565812133 > 2.640861584875108.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.046518856094213 (T) = (0 -19.7226100186527) / Math.Sqrt((0.6740690706674937 / (27)) + (8.070857372374993 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.251417190797984 = (2.3902088044520933 - 19.7226100186527) / 2.3902088044520933 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.60061079470286 > 2.70066117985777.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -75.41091018433457 (T) = (0 -57.62100898527774) / Math.Sqrt((0.5065549292067317 / (26)) + (4.137342079453631 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -23.23434859374964 = (2.3776586675054663 - 57.62100898527774) / 2.3776586675054663 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.67112550811841 > 3.530203633186096.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.443535881192542 (T) = (0 -54.74545961533132) / Math.Sqrt((1.5112525550644325 / (26)) + (54.86506689937949 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.15935490349355 = (3.6113317462285255 - 54.74545961533132) / 3.6113317462285255 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.15579507951206 > 3.49486711727705.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.170157686356053 (T) = (0 -69.70616390510138) / Math.Sqrt((0.9238437573448414 / (27)) + (38.53472343362778 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -19.46321553659882 = (3.4064130234288292 - 69.70616390510138) / 3.4064130234288292 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.211368320426146 > 3.6816239218369122.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -267.0333823116217 (T) = (0 -52.36430638292991) / Math.Sqrt((0.3931956957734825 / (27)) + (0.15220416426545197 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.289811581620974 = (3.424784282225826 - 52.36430638292991) / 3.424784282225826 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.37715685968255 > 2.054386334553649.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.99377768331906 (T) = (0 -24.626151388722324) / Math.Sqrt((0.6103608800727777 / (26)) + (11.048815226493016 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.639710220043234 = (2.1157014155143505 - 24.626151388722324) / 2.1157014155143505 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 72.57390985431104 > 45.125133235199094.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.73879392982529 (T) = (0 -72.3640092341439) / Math.Sqrt((3.8471921184650046 / (27)) + (3.2852722635932152 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.6615366975231259 = (43.552459203590175 - 72.3640092341439) / 43.552459203590175 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.63614276516248 > 3.6365713572004785.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.233201973190596 (T) = (0 -68.83716231180395) / Math.Sqrt((0.46978286468583363 / (26)) + (40.00938520057752 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -19.584795091743473 = (3.3440780928353484 - 68.83716231180395) / 3.3440780928353484 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 76.12161549487097 > 3.427563410570253.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.189077155991455 (T) = (0 -68.0385646690296) / Math.Sqrt((0.35133676884286175 / (27)) + (18.79494304043156 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -20.303344886187503 = (3.1937972666979593 - 68.0385646690296) / 3.1937972666979593 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.370385208464572 > 2.2202900849745664.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.361358559860395 (T) = (0 -18.791349311888133) / Math.Sqrt((0.5735560458566356 / (27)) + (3.837027555286469 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.322164593650028 = (2.2579881832938384 - 18.791349311888133) / 2.2579881832938384 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.00668907815284 > 3.457845022577522.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.331988272890165 (T) = (0 -68.1124271375381) / Math.Sqrt((1.1945027204432053 / (27)) + (26.315134960503006 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.90730122555456 = (3.6024404712756852 - 68.1124271375381) / 3.6024404712756852 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.67981383097538 > 3.4865401748309592.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -192.41954376145543 (T) = (0 -56.20458346965424) / Math.Sqrt((1.0173942232690936 / (27)) + (0.3011652868691197 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.561967684000225 = (3.3935933544871584 - 56.20458346965424) / 3.3935933544871584 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 65.63951489334391 > 3.4433738143313914.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -183.38969170807644 (T) = (0 -65.72810946985368) / Math.Sqrt((1.1593082916609403 / (27)) + (0.5759287174586127 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.478558862548304 = (3.556993267644324 - 65.72810946985368) / 3.556993267644324 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.36891120702376 > 54.20285940080609.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/2/2023 2:22:24 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.078245782008234 (T) = (0 -69.00230834963837) / Math.Sqrt((2.605770627878848 / (27)) + (43.20272337553176 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3166594377720053 = (52.40710419879048 - 69.00230834963837) / 52.40710419879048 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.957836130728765 > 2.6459654561755297.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.18968995080282 (T) = (0 -20.470041852002996) / Math.Sqrt((1.420232951148081 / (27)) + (3.950092975521731 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.90378614809493 = (2.5899033031070737 - 20.470041852002996) / 2.5899033031070737 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.44034268782918 > 2.3385792263559573.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.03346301118332 (T) = (0 -28.920490363150392) / Math.Sqrt((1.0854273933137621 / (27)) + (9.361225625756092 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.662373298314208 = (2.479811752152612 - 28.920490363150392) / 2.479811752152612 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.224697075050837 > 0.03139633356605199.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.71174565972143 (T) = (0 -15.698907978122834) / Math.Sqrt((0.27994625356469116 / (27)) + (0.7314608015941894 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -75.00463765093139 = (0.20655197450218296 - 15.698907978122834) / 0.20655197450218296 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 88.4780752817813 > 3.0703664612482493.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -143.91367284726894 (T) = (0 -87.24153190702305) / Math.Sqrt((0.25138618087355913 / (26)) + (2.6806954072354614 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -30.824506884141105 = (2.7413317738003204 - 87.24153190702305) / 2.7413317738003204 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.041036192751704 > 4.652441016540535.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -68.26453255299498 (T) = (0 -39.92495493739408) / Math.Sqrt((5.299258524132727 / (26)) + (0.4758340630382486 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.153372097118718 = (4.896741429414582 - 39.92495493739408) / 4.896741429414582 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 126.62262960621777 > 3.4968824634761977.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.651246929244557 (T) = (0 -92.00417557111452) / Math.Sqrt((1.0694211981482613 / (27)) + (201.22098049328685 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.986399097616694 = (3.409279438813305 - 92.00417557111452) / 3.409279438813305 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.699871959649723 > 2.6506068234941726.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.772593218063847 (T) = (0 -19.959831994040456) / Math.Sqrt((0.6987425561746891 / (26)) + (2.7036907230558773 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.734246444908138 = (2.580708041334921 - 19.959831994040456) / 2.580708041334921 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int16>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 181.14140419114625 > 3.6775671468846776.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -148.18597010556763 (T) = (0 -178.8844642824689) / Math.Sqrt((0.3414054307183681 / (26)) + (11.084693085418744 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -48.296016476971126 = (3.628781330962831 - 178.8844642824689) / 3.628781330962831 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
XorBenchmark - Duration of single invocation	3.37 ns	52.40 ns	15.57	0.56	True
OnesComplementOperatorBenchmark - Duration of single invocation	5.83 ns	42.28 ns	7.25	0.65	True
CountBenchmark - Duration of single invocation	0.00 ns	14.91 ns	∞	0.89	True
MinBenchmark - Duration of single invocation	3.33 ns	30.24 ns	9.08	0.64	False
BitwiseAndBenchmark - Duration of single invocation	3.53 ns	51.92 ns	14.70	0.59	True
EqualsStaticBenchmark - Duration of single invocation	6.66 ns	25.77 ns	3.87	0.60	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.27 ns	23.00 ns	10.12	0.65	False
SubtractBenchmark - Duration of single invocation	3.01 ns	30.58 ns	10.16	0.59	False
BitwiseOrBenchmark - Duration of single invocation	2.57 ns	56.43 ns	21.97	0.61	True
ExclusiveOrOperatorBenchmark - Duration of single invocation	4.03 ns	52.81 ns	13.10	0.62	True
BitwiseAndOperatorBenchmark - Duration of single invocation	1.86 ns	52.31 ns	28.07	0.56	True
LessThanOrEqualAllBenchmark - Duration of single invocation	2.29 ns	33.58 ns	14.67	0.64	False
LessThanBenchmark - Duration of single invocation	3.24 ns	32.72 ns	10.11	0.64	False
AndNotBenchmark - Duration of single invocation	3.28 ns	87.82 ns	26.80	0.58	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.12 ns	29.25 ns	9.36	0.56	False
OneBenchmark - Duration of single invocation	1.87 ns	23.42 ns	12.53	0.72	False
BitwiseOrOperatorBenchmark - Duration of single invocation	4.05 ns	52.35 ns	12.93	0.65	True
MultiplyBenchmark - Duration of single invocation	4.54 ns	35.87 ns	7.90	0.67	False
AddOperatorBenchmark - Duration of single invocation	3.62 ns	22.60 ns	6.25	0.59	False
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.25 ns	24.16 ns	10.72	0.71	False
EqualityOperatorBenchmark - Duration of single invocation	2.24 ns	21.62 ns	9.66	0.69	False
OnesComplementBenchmark - Duration of single invocation	3.14 ns	45.68 ns	14.54	0.68	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.71 ns	22.06 ns	8.14	0.70	False
DotBenchmark - Duration of single invocation	2.68 ns	43.53 ns	16.27	0.86	False
EqualsAllBenchmark - Duration of single invocation	2.16 ns	26.03 ns	12.05	0.70	False
LessThanOrEqualBenchmark - Duration of single invocation	3.19 ns	32.01 ns	10.05	0.66	False
ZeroBenchmark - Duration of single invocation	1.94 ns	16.89 ns	8.70	0.69	True
LessThanAllBenchmark - Duration of single invocation	2.30 ns	23.11 ns	10.04	0.62	False
SubtractionOperatorBenchmark - Duration of single invocation	3.33 ns	22.96 ns	6.90	0.60	False
EqualsAnyBenchmark - Duration of single invocation	2.52 ns	24.72 ns	9.83	0.72	False
AddBenchmark - Duration of single invocation	5.10 ns	30.01 ns	5.88	0.65	False
GreaterThanBenchmark - Duration of single invocation	3.19 ns	37.30 ns	11.68	0.58	False
DivideBenchmark - Duration of single invocation	24.56 ns	41.60 ns	1.69	0.42	False
ConditionalSelectBenchmark - Duration of single invocation	3.56 ns	180.74 ns	50.71	0.55	True
LessThanAnyBenchmark - Duration of single invocation	2.60 ns	18.72 ns	7.21	0.70	False
InequalityOperatorBenchmark - Duration of single invocation	0.82 ns	22.60 ns	27.45	0.72	False
SquareRootBenchmark - Duration of single invocation	14.51 ns	27.02 ns	1.86	0.67	False
DivisionOperatorBenchmark - Duration of single invocation	24.40 ns	47.89 ns	1.96	0.45	False
MultiplyOperatorBenchmark - Duration of single invocation	3.23 ns	28.47 ns	8.81	0.66	False
NegateBenchmark - Duration of single invocation	3.29 ns	26.40 ns	8.01	0.62	False
GreaterThanAnyBenchmark - Duration of single invocation	2.26 ns	22.68 ns	10.05	0.67	False
AbsBenchmark - Duration of single invocation	1.19 ns	22.57 ns	19.04	0.65	False
MaxBenchmark - Duration of single invocation	3.51 ns	32.44 ns	9.24	0.59	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int64>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Int64>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.399699548591066 > 3.6426396565557795.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -121.36920783291333 (T) = (0 -52.94057967110494) / Math.Sqrt((1.460600941332781 / (26)) + (0.8684031357505004 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.38241725977097 = (3.680923638558654 - 52.94057967110494) / 3.680923638558654 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.28434467851562 > 5.351350949136534.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -66.40454180337383 (T) = (0 -40.45801129578709) / Math.Sqrt((3.173003195339473 / (26)) + (1.3198231948041592 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.28633849826688 = (4.882495604572398 - 40.45801129578709) / 4.882495604572398 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.913091300298658 > 0.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -51.01950732746991 (T) = (0 -14.622115553579563) / Math.Sqrt((0.38041821628048555 / (27)) + (0.5313380820080154 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -99.16441703196502 = (0.14598113768199014 - 14.622115553579563) / 0.14598113768199014 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.24231064094887 > 3.4893878757401238.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.154216641057292 (T) = (0 -28.49949288656738) / Math.Sqrt((0.5830286389482425 / (27)) + (6.215959612799723 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.533243987061077 = (3.339819291441924 - 28.49949288656738) / 3.339819291441924 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.9244474192378 > 3.6076418442266247.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -4.954817112068622 (T) = (0 -64.4064917477489) / Math.Sqrt((1.0204531375651928 / (26)) + (1205.9325323553674 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -17.066917750416167 = (3.5648854241485277 - 64.4064917477489) / 3.5648854241485277 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.76712000573328 > 3.5851882319021073.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.70439702087349 (T) = (0 -27.85614265687048) / Math.Sqrt((0.8206460459840467 / (27)) + (4.4345684558872795 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.710312978074251 = (3.6128420125207303 - 27.85614265687048) / 3.6128420125207303 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.000170235485278 > 2.270385268548801.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.21125076474817 (T) = (0 -23.829489386724003) / Math.Sqrt((0.2174696536204285 / (27)) + (1.9516308027379443 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -9.393801038732287 = (2.2926636076565154 - 23.829489386724003) / 2.2926636076565154 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.580982466139933 > 3.436125731575535.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.776355665882384 (T) = (0 -32.07846209583187) / Math.Sqrt((0.8710496090936777 / (27)) + (3.6369231195892326 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.8464636819159574 = (3.62613392754972 - 32.07846209583187) / 3.62613392754972 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.432965408777285 > 3.4923112049249605.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -67.35114069561021 (T) = (0 -54.38956298341694) / Math.Sqrt((0.8583689810159095 / (25)) + (4.287379012665118 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -14.411742945906225 = (3.5290987641254605 - 54.38956298341694) / 3.5290987641254605 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.81260409298439 > 4.711439858697987.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.61443252921339 (T) = (0 -53.84474991788894) / Math.Sqrt((1.0304364775247332 / (27)) + (6.687894050697468 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.484615466704433 = (3.717375172413866 - 53.84474991788894) / 3.717375172413866 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.31374174346472 > 3.49890224777806.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -72.76880246507581 (T) = (0 -53.59319203473111) / Math.Sqrt((1.4143771984272415 / (27)) + (3.374649952011306 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.390683611096216 = (3.4821839879868652 - 53.59319203473111) / 3.4821839879868652 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.58175407848577 > 2.6164184973592013.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.396409855127658 (T) = (0 -27.309934480013286) / Math.Sqrt((0.5696949220538564 / (27)) + (12.872852199714476 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.732131406500159 = (2.544688789728423 - 27.309934480013286) / 2.544688789728423 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.721279666085195 > 3.4349227465623677.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.60297763716705 (T) = (0 -34.08217239782307) / Math.Sqrt((1.92318242390106 / (26)) + (4.468783222974834 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.084490941718983 = (3.3796621559574223 - 34.08217239782307) / 3.3796621559574223 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 87.8248778879043 > 3.4730853378338975.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -100.06022086227865 (T) = (0 -87.48594572887048) / Math.Sqrt((0.7313159872960188 / (25)) + (5.409656034590108 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -24.40448729766749 = (3.443720186272092 - 87.48594572887048) / 3.443720186272092 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.251857106641534 > 3.3689251286451034.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.932963098687793 (T) = (0 -27.755719141156508) / Math.Sqrt((1.1190369216748937 / (27)) + (5.257078890511127 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.767706930691526 = (3.57321914804599 - 27.755719141156508) / 3.57321914804599 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.424284781449078 > 1.9416764610721673.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.15376063587337 (T) = (0 -25.0299335700129) / Math.Sqrt((0.4628906357808058 / (27)) + (10.289313029866877 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.37946479076364 = (2.021891413971937 - 25.0299335700129) / 2.021891413971937 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.34978959846506 > 4.167210878419317.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -110.84716185066412 (T) = (0 -52.19064444871272) / Math.Sqrt((1.0839684813580175 / (27)) + (1.2159266533372595 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.487648699770167 = (3.602423383550201 - 52.19064444871272) / 3.602423383550201 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.872335907355975 > 3.6257963810681.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.54272703072393 (T) = (0 -32.90497889775563) / Math.Sqrt((0.43679538296185216 / (27)) + (12.368570156101795 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.458348126113124 = (3.4789350591685 - 32.90497889775563) / 3.4789350591685 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.599944972954688 > 3.403326177828083.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.5100333849115 (T) = (0 -24.37945269152549) / Math.Sqrt((0.23149620465853268 / (27)) + (3.9872822843377635 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.239682350892438 = (3.367475465069296 - 24.37945269152549) / 3.367475465069296 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.163367599003514 > 2.444443006281618.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.75387951290385 (T) = (0 -20.44307407327601) / Math.Sqrt((0.5728131881851041 / (27)) + (8.973723549047692 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.074372631340404 = (2.5318467460774485 - 20.44307407327601) / 2.5318467460774485 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.619792897385288 > 2.34943048678952.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.55661661502793 (T) = (0 -19.547419495683478) / Math.Sqrt((0.7011695784965545 / (27)) + (4.408249529227015 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.099902705991275 = (2.4132906536302947 - 19.547419495683478) / 2.4132906536302947 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.68091634768631 > 3.456418289515038.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.07932663945771 (T) = (0 -42.42519282179884) / Math.Sqrt((0.589306281856311 / (26)) + (9.624202381978463 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.822392996321426 = (3.5885453000081764 - 42.42519282179884) / 3.5885453000081764 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.05828245469457 > 2.816114140755483.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.306957866285806 (T) = (0 -23.03476991051659) / Math.Sqrt((2.095074945767103 / (27)) + (12.941702192261456 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.419803599477 = (3.1044986031894752 - 23.03476991051659) / 3.1044986031894752 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.53376148348559 > 2.8236131396702873.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.3568689064476 (T) = (0 -38.81765875515906) / Math.Sqrt((3.130597415421434 / (26)) + (8.030900747965903 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.255298198490122 = (3.448834324120029 - 38.81765875515906) / 3.448834324120029 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.027027687444704 > 2.268518379294665.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.57499807891142 (T) = (0 -28.99972832498676) / Math.Sqrt((0.1287804571527272 / (27)) + (16.5930237670049 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.07716595182375 = (2.217585096940858 - 28.99972832498676) / 2.217585096940858 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.01243337562529 > 3.2832338861948687.
IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.94237042884403 (T) = (0 -33.929730923227154) / Math.Sqrt((0.6666198268403124 / (27)) + (5.594523445204354 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.13762294488623 = (3.3469119050578318 - 33.929730923227154) / 3.3469119050578318 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.894718683880996 > 2.0602899853924566.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.60179971408258 (T) = (0 -16.446055082055807) / Math.Sqrt((1.1771584769660715 / (27)) + (0.19262503556643987 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -6.643220876166085 = (2.1517178881143773 - 16.446055082055807) / 2.1517178881143773 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.114091157282612 > 2.38161388716674.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.49711966807231 (T) = (0 -25.38958056525711) / Math.Sqrt((0.49071659054397315 / (27)) + (3.214214638219605 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.640415731517086 = (2.3861455422322226 - 25.38958056525711) / 2.3861455422322226 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.964864099767684 > 3.488107308758405.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.611033976160588 (T) = (0 -25.259433533515743) / Math.Sqrt((0.07239854327055456 / (26)) + (4.66966276448074 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.543946740876162 = (3.3483048596631644 - 25.259433533515743) / 3.3483048596631644 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.723852470893416 > 2.6878567847882757.
IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -12.910115484011309 (T) = (0 -27.239705027625224) / Math.Sqrt((1.0600584095999268 / (27)) + (24.662216958102388 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -8.482537224814854 = (2.872617779589795 - 27.239705027625224) / 2.872617779589795 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.00635369421185 > 3.7264595269487413.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.493082483490905 (T) = (0 -32.52991055307825) / Math.Sqrt((1.5434737771744116 / (25)) + (15.121548560794949 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.343780758832179 = (3.898701499154831 - 32.52991055307825) / 3.898701499154831 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.300533153491706 > 3.360202188005226.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.71991580350817 (T) = (0 -28.970002534056533) / Math.Sqrt((1.0333548844679665 / (26)) + (16.103220461844312 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.086374933418588 = (3.582569788389617 - 28.970002534056533) / 3.582569788389617 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.60416768501489 > 25.682212309609458.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 11:57:24 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.94790177979494 (T) = (0 -45.04252309561792) / Math.Sqrt((3.521225404451393 / (26)) + (15.346719831387748 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.7978317052528717 = (25.05380395952163 - 45.04252309561792) / 25.05380395952163 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 180.74310170553775 > 3.7213293075825695.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -73.93351393801518 (T) = (0 -181.6822802717439) / Math.Sqrt((0.5612335511463112 / (27)) + (46.18892850549996 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -47.93481831604926 = (3.712740468317161 - 181.6822802717439) / 3.712740468317161 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.72186406049445 > 2.835565767676392.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.219049729885516 (T) = (0 -21.310765689124327) / Math.Sqrt((1.5664117698842106 / (27)) + (9.999068792963266 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.7153988841884145 = (2.762108091753705 - 21.310765689124327) / 2.762108091753705 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.602080433543097 > 2.597348696575523.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.08207699062597 (T) = (0 -19.73613590552852) / Math.Sqrt((0.288761207254484 / (27)) + (4.008480697886621 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.867614654468796 = (2.5085285403903734 - 19.73613590552852) / 2.5085285403903734 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.021213010553463 > 16.395560517632912.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 2/9/2023 12:40:40 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.365935594565569 (T) = (0 -26.679465225935594) / Math.Sqrt((1.293611944244875 / (26)) + (5.1735843512473965 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.7184735935192623 = (15.525094669216717 - 26.679465225935594) / 15.525094669216717 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.88543047910753 > 25.62650528671319.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/3/2023 9:00:24 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -5.920406827480806 (T) = (0 -35.996798737127186) / Math.Sqrt((5.411164037284631 / (27)) + (26.204689685352747 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.44225035500305143 = (24.958772665409416 - 35.996798737127186) / 24.958772665409416 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.46687236089611 > 3.4232605120195.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.096734424617022 (T) = (0 -26.05490434515316) / Math.Sqrt((2.2210760086376564 / (26)) + (12.928593157812456 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.941206022149992 = (3.7536566789704406 - 26.05490434515316) / 3.7536566789704406 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.40368752746269 > 3.4637890654424073.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.57359937784341 (T) = (0 -22.370005029739108) / Math.Sqrt((1.0524535485882551 / (26)) + (5.452493307095379 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.015738309758611 = (3.188546100504252 - 22.370005029739108) / 3.188546100504252 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.675699030712213 > 2.7565635772469412.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.96768918731266 (T) = (0 -24.457810903049502) / Math.Sqrt((1.1332350386054508 / (27)) + (3.2602169642373964 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.084748564644322 = (3.025178916510373 - 24.457810903049502) / 3.025178916510373 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.57309337006069 > 3.5641673453557936.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.656992294237543 (T) = (0 -25.52634706643023) / Math.Sqrt((1.7188186607638443 / (26)) + (20.05876087268727 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.0557308594676815 = (3.617817569129339 - 25.52634706643023) / 3.617817569129339 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Int64>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.43851579779476 > 3.6676896523588995.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.748667979952977 (T) = (0 -28.675133520894622) / Math.Sqrt((2.906892853344841 / (27)) + (6.500854327681595 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.215209880002072 = (3.974261871490617 - 28.675133520894622) / 3.974261871490617 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
NegateBenchmark - Duration of single invocation	3.42 ns	23.03 ns	6.74	0.58	False
CountBenchmark - Duration of single invocation	0.00 ns	14.86 ns	∞	0.88	True
AddOperatorBenchmark - Duration of single invocation	3.63 ns	24.64 ns	6.78	0.60	False
AndNotBenchmark - Duration of single invocation	5.42 ns	89.58 ns	16.54	0.59	True
LessThanOrEqualBenchmark - Duration of single invocation	3.18 ns	31.33 ns	9.85	0.67	False
OnesComplementOperatorBenchmark - Duration of single invocation	4.68 ns	42.07 ns	8.99	0.64	True
LessThanBenchmark - Duration of single invocation	3.22 ns	31.61 ns	9.83	0.65	False
EqualsStaticBenchmark - Duration of single invocation	4.88 ns	24.79 ns	5.08	0.66	False
MultiplyBenchmark - Duration of single invocation	4.25 ns	33.40 ns	7.85	0.65	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.50 ns	52.10 ns	14.90	0.56	True
MinBenchmark - Duration of single invocation	3.69 ns	23.82 ns	6.45	0.66	False
GreaterThanAnyBenchmark - Duration of single invocation	2.65 ns	32.42 ns	12.23	0.67	False
MaxBenchmark - Duration of single invocation	3.18 ns	27.12 ns	8.52	0.64	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.70 ns	52.68 ns	14.22	0.54	True
SquareRootBenchmark - Duration of single invocation	15.08 ns	22.33 ns	1.48	0.59	False
DivideBenchmark - Duration of single invocation	3.77 ns	35.47 ns	9.40	0.66	False
AbsBenchmark - Duration of single invocation	3.34 ns	25.14 ns	7.53	0.60	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.73 ns	28.22 ns	10.35	0.70	False
OnesComplementBenchmark - Duration of single invocation	1.42 ns	39.44 ns	27.76	0.66	True
XorBenchmark - Duration of single invocation	5.49 ns	56.78 ns	10.35	0.56	True
BitwiseOrBenchmark - Duration of single invocation	3.40 ns	56.98 ns	16.77	0.64	True
ZeroBenchmark - Duration of single invocation	1.98 ns	16.33 ns	8.25	0.70	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.43 ns	25.01 ns	7.30	0.65	False
InequalityOperatorBenchmark - Duration of single invocation	2.70 ns	20.64 ns	7.64	0.69	False
LessThanAllBenchmark - Duration of single invocation	2.75 ns	22.97 ns	8.36	0.73	False
MultiplyOperatorBenchmark - Duration of single invocation	3.19 ns	22.80 ns	7.14	0.67	False
BitwiseOrOperatorBenchmark - Duration of single invocation	1.29 ns	51.99 ns	40.15	0.54	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.10 ns	21.72 ns	10.32	0.62	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.65 ns	18.22 ns	6.89	0.69	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.29 ns	22.66 ns	9.90	0.63	False
OneBenchmark - Duration of single invocation	2.05 ns	23.21 ns	11.30	0.73	False
SubtractBenchmark - Duration of single invocation	3.61 ns	31.02 ns	8.59	0.66	False
LessThanAnyBenchmark - Duration of single invocation	2.48 ns	18.45 ns	7.42	0.64	False
EqualsAllBenchmark - Duration of single invocation	2.33 ns	28.06 ns	12.06	0.69	False
GreaterThanBenchmark - Duration of single invocation	3.48 ns	26.74 ns	7.69	0.62	False
DivisionOperatorBenchmark - Duration of single invocation	3.41 ns	21.76 ns	6.38	0.61	False
ConditionalSelectBenchmark - Duration of single invocation	3.56 ns	178.11 ns	50.08	0.56	True
EqualityOperatorBenchmark - Duration of single invocation	2.22 ns	20.00 ns	9.00	0.68	False
EqualsAnyBenchmark - Duration of single invocation	2.24 ns	29.90 ns	13.38	0.64	False
GreaterThanAllBenchmark - Duration of single invocation	0.74 ns	18.31 ns	24.81	0.66	False
DotBenchmark - Duration of single invocation	4.83 ns	34.02 ns	7.04	0.82	False
SubtractionOperatorBenchmark - Duration of single invocation	3.17 ns	29.73 ns	9.37	0.63	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Double>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.02537423990867 > 3.538158478093381.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.551331873946296 (T) = (0 -22.37650814563213) / Math.Sqrt((0.12511071647513936 / (27)) + (2.5523766783966395 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.805166823928953 = (3.2881645262464096 - 22.37650814563213) / 3.2881645262464096 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.855213379159661 > 0.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.829876234290992 (T) = (0 -14.523247687774822) / Math.Sqrt((0.3334060065925321 / (26)) + (2.000472764118857 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -56.111332852144145 = (0.2542971239241455 - 14.523247687774822) / 0.2542971239241455 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.636727519961386 > 3.2880584748966895.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.023432973254597 (T) = (0 -24.16408068316553) / Math.Sqrt((0.7875287742178452 / (27)) + (5.691697607968622 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.924701922217117 = (3.4895481357309883 - 24.16408068316553) / 3.4895481357309883 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 89.58494598311295 > 3.641877708574689.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -107.47445468790873 (T) = (0 -87.46298955375887) / Math.Sqrt((0.7903605583853625 / (26)) + (4.638470669196328 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -23.92892543289518 = (3.5084941703241777 - 87.46298955375887) / 3.5084941703241777 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.326491746110793 > 3.3467446034962482.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.410988136155595 (T) = (0 -33.78635764919847) / Math.Sqrt((0.7488832477613803 / (27)) + (6.420738457670228 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.111220569626619 = (3.3414717260436655 - 33.78635764919847) / 3.3414717260436655 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.069354410369 > 4.786111745455346.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.689856244268583 (T) = (0 -42.318217608894905) / Math.Sqrt((0.7625419848495121 / (26)) + (13.56675919295094 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.129592885364502 = (4.6352798137071956 - 42.318217608894905) / 4.6352798137071956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.61476081893208 > 3.3407325990900856.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.52090457011019 (T) = (0 -32.52072140027773) / Math.Sqrt((1.2086711891773148 / (26)) + (6.364803942132945 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.044953696124736 = (3.595454713517336 - 32.52072140027773) / 3.595454713517336 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.78730036546623 > 3.6799813878051397.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.909483162375686 (T) = (0 -26.46563680524806) / Math.Sqrt((0.892824668214463 / (26)) + (3.3961138723164277 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.570735837407761 = (3.4957813049662505 - 26.46563680524806) / 3.4957813049662505 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.400958450270004 > 3.448059730441027.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.413077920689247 (T) = (0 -32.94291415587592) / Math.Sqrt((0.6794319523104416 / (25)) + (6.830526556560808 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -8.525996037990435 = (3.458212036252896 - 32.94291415587592) / 3.458212036252896 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.095392394063545 > 3.54112781140796.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -58.20435058858675 (T) = (0 -53.701994649546926) / Math.Sqrt((1.6415444887598423 / (26)) + (5.425880231639993 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.974010562578298 = (3.5863467856603575 - 53.701994649546926) / 3.5863467856603575 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.823450861367505 > 3.6801711339519945.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.401103969352064 (T) = (0 -26.868711572024807) / Math.Sqrt((0.21663496382415837 / (26)) + (5.7350155737620225 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.602598119474263 = (3.534148609433908 - 26.868711572024807) / 3.534148609433908 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.42212984198124 > 2.606189141179786.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.709150404243122 (T) = (0 -25.609150823852566) / Math.Sqrt((0.46408097183169134 / (27)) + (10.71500897189817 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.650792801900074 = (2.653580006277885 - 25.609150823852566) / 2.653580006277885 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.121277775384122 > 3.5498461130677486.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.95086803435021 (T) = (0 -27.02009790340779) / Math.Sqrt((0.8772858063412747 / (25)) + (8.039151925034869 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -6.474693285946076 = (3.6148771420776553 - 27.02009790340779) / 3.6148771420776553 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.68183691189558 > 3.5300134251686233.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -64.01613988913545 (T) = (0 -54.341682360933255) / Math.Sqrt((0.6130939534038344 / (27)) + (4.8350157187693785 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.895605840157797 = (3.6481686575265595 - 54.341682360933255) / 3.6481686575265595 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.33317926911708 > 14.591185263877215.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.368128918192218 (T) = (0 -25.33308270575984) / Math.Sqrt((1.7764400178397433 / (26)) + (4.771411018127437 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.8602069061255184 = (13.61842202732392 - 25.33308270575984) / 13.61842202732392 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.46500428399188 > 3.6071960527818416.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.325012547879744 (T) = (0 -32.686958106189834) / Math.Sqrt((0.20766969521995515 / (27)) + (6.915461094069632 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.520606364115912 = (3.43328532407244 - 32.686958106189834) / 3.43328532407244 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.141621752395924 > 3.426377509978649.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -60.24150778136277 (T) = (0 -24.89983087784349) / Math.Sqrt((0.5854388559384144 / (27)) + (0.8543450300125468 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.529130306798368 = (3.307132412804754 - 24.89983087784349) / 3.307132412804754 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.22277440325518 > 2.733134947068568.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.355098277087116 (T) = (0 -26.059801747806755) / Math.Sqrt((0.27420225278238874 / (27)) + (6.7723477342867735 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.055412568073692 = (2.5916193464351323 - 26.059801747806755) / 2.5916193464351323 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.43890136484888 > 3.3325005377382704.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.905325093972706 (T) = (0 -40.40277441058745) / Math.Sqrt((0.9002102541938651 / (26)) + (5.129643414109236 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.58788392442748 = (3.486639551628372 - 40.40277441058745) / 3.486639551628372 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.77866545966879 > 3.4890822118436433.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -73.99939930435247 (T) = (0 -53.39211793807709) / Math.Sqrt((1.2320381668193483 / (27)) + (3.289514531932938 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.810314234079623 = (3.377043438073402 - 53.39211793807709) / 3.377043438073402 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.976237798514326 > 3.478296524941511.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -54.463069347902476 (T) = (0 -55.36942481077362) / Math.Sqrt((0.620831786196191 / (27)) + (7.072972744846817 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.831689938944837 = (3.497379308482334 - 55.36942481077362) / 3.497379308482334 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.332805067380047 > 2.0603520985275465.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -71.40860733756821 (T) = (0 -16.488729663012137) / Math.Sqrt((0.3116653556822197 / (27)) + (0.23437692693975595 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.0128718893358855 = (2.057780267890785 - 16.488729663012137) / 2.057780267890785 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.013606508021706 > 3.5055761637131813.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.465929396876398 (T) = (0 -26.244038327425624) / Math.Sqrt((0.9405153183539815 / (26)) + (4.107979077753624 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.177055661420637 = (3.6566580455126134 - 26.244038327425624) / 3.6566580455126134 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.643297717353686 > 2.576166314671935.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.659429753937417 (T) = (0 -18.70329041429083) / Math.Sqrt((0.8497884930684708 / (25)) + (2.8001207021048664 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -5.673582706121384 = (2.8025861426929084 - 18.70329041429083) / 2.8025861426929084 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.974124516389647 > 2.6304676056384504.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.518261100512383 (T) = (0 -24.917169664437758) / Math.Sqrt((0.8509596732003161 / (26)) + (5.386071434718397 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.453704172535176 = (2.6357043979466708 - 24.917169664437758) / 2.6357043979466708 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.798925993821385 > 3.5727931654589984.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.15518267725446 (T) = (0 -23.99940659472724) / Math.Sqrt((1.2812701788317524 / (27)) + (4.479820519184345 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.639574804867093 = (3.6145999254552637 - 23.99940659472724) / 3.6145999254552637 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.994568753139454 > 3.4667247135533965.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -140.40823057217474 (T) = (0 -52.57594435636832) / Math.Sqrt((1.0031564424704973 / (26)) + (0.6775338690039238 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.039412785416493 = (3.2779220199490045 - 52.57594435636832) / 3.2779220199490045 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.720397496226262 > 2.557253351150225.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.455209537382736 (T) = (0 -20.838636648878108) / Math.Sqrt((0.7731782617885662 / (25)) + (4.339783655268663 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.980727537046985 = (2.3203728832564274 - 20.838636648878108) / 2.3203728832564274 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.223571523488108 > 2.743448239837812.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.9685032727873 (T) = (0 -21.21869999001261) / Math.Sqrt((0.4262723989076625 / (27)) + (9.524721233939763 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.220149257244024 = (2.581303492915726 - 21.21869999001261) / 2.581303492915726 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.65742255339695 > 2.64870873786639.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.065956755456497 (T) = (0 -25.542292535656756) / Math.Sqrt((0.39738453837907073 / (26)) + (7.870805321466674 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.273141552520478 = (2.4863175889355915 - 25.542292535656756) / 2.4863175889355915 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.21233334468931 > 2.1262637063360916.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.21553463774104 (T) = (0 -23.98631896930937) / Math.Sqrt((0.3832464051971751 / (27)) + (10.154967852863676 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.823334143268228 = (2.2161672781975508 - 23.98631896930937) / 2.2161672781975508 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.022536399901913 > 3.381477765827702.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.24321254487569 (T) = (0 -32.22926949942932) / Math.Sqrt((0.5106432767956857 / (27)) + (4.865643016184878 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.135322222695796 = (3.527983875528651 - 32.22926949942932) / 3.527983875528651 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.446308962790127 > 2.611727683369473.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.97424613788359 (T) = (0 -20.038310920529376) / Math.Sqrt((0.43939145141587205 / (27)) + (6.084125478991305 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.233081415666213 = (2.4338774158603282 - 20.038310920529376) / 2.4338774158603282 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.06494985742239 > 2.399620428498005.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.80836029218566 (T) = (0 -28.282963648214384) / Math.Sqrt((0.7197299333251888 / (27)) + (3.371552869293562 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.272825406889051 = (2.304519351537294 - 28.282963648214384) / 2.304519351537294 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.739864977593584 > 3.5204670186814013.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.450257766160384 (T) = (0 -27.91155891370624) / Math.Sqrt((0.519054668643247 / (27)) + (6.239737845832531 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.2781562733288006 = (3.3717120083410173 - 27.91155891370624) / 3.3717120083410173 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.757755867431335 > 3.5894448592146175.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.593089486568326 (T) = (0 -25.16521496547818) / Math.Sqrt((0.9862058817245961 / (25)) + (17.162599230158587 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -5.999667777516198 = (3.595201338885251 - 25.16521496547818) / 3.595201338885251 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 178.10512560916328 > 3.6470619631292767.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -92.48954147525941 (T) = (0 -178.1742665931827) / Math.Sqrt((1.130461940680876 / (27)) + (28.178620571866308 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -49.01350086987455 = (3.562523388569772 - 178.1742665931827) / 3.562523388569772 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.99673074504549 > 2.2714005080770874.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.54701832634804 (T) = (0 -19.435558536891936) / Math.Sqrt((0.6303862795380121 / (25)) + (5.404933461841912 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.698043515912408 = (2.234474741513544 - 19.435558536891936) / 2.234474741513544 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.904826062305006 > 2.5887145868270776.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.429808092584373 (T) = (0 -25.476399097665613) / Math.Sqrt((0.33524886428948736 / (27)) + (7.1680824203127385 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -8.64392511905389 = (2.6417043665478976 - 25.476399097665613) / 2.6417043665478976 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.310678280354328 > 2.802286958242678.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.822614962132164 (T) = (0 -20.770465081868455) / Math.Sqrt((0.3768602176983385 / (27)) + (4.958573411871977 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.984585604789363 = (2.60132035774152 - 20.770465081868455) / 2.60132035774152 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.0177035140713 > 3.4576127774956373.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.51122022583908 (T) = (0 -33.85822603504843) / Math.Sqrt((3.0117684743531754 / (27)) + (6.221579086900961 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.579950949084449 = (3.2002252371480417 - 33.85822603504843) / 3.2002252371480417 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Double>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.731402013463548 > 3.3496899717422086.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.515641423967917 (T) = (0 -25.582357094556013) / Math.Sqrt((1.949082712064226 / (26)) + (15.768975496223172 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.549640269574775 = (3.388553120557744 - 25.582357094556013) / 3.388553120557744 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorConvert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Narrow_ushort - Duration of single invocation	6.53 μs	30.23 μs	4.63	0.44	False
Widen_byte - Duration of single invocation	9.75 μs	22.32 μs	2.29	0.45	False
Convert_float_uint - Duration of single invocation	35.62 μs	50.64 μs	1.42	0.29	False
Narrow_int - Duration of single invocation	6.74 μs	28.73 μs	4.26	0.36	False
Narrow_double - Duration of single invocation	11.11 μs	29.07 μs	2.62	0.23	True
Convert_long_double - Duration of single invocation	10.87 μs	23.26 μs	2.14	0.42	False
Convert_double_ulong - Duration of single invocation	24.41 μs	38.96 μs	1.60	0.30	False
Narrow_short - Duration of single invocation	7.16 μs	31.76 μs	4.44	0.39	False
Convert_double_long - Duration of single invocation	19.46 μs	30.40 μs	1.56	0.48	False
Convert_uint_float - Duration of single invocation	15.70 μs	27.36 μs	1.74	0.42	False
Convert_float_int - Duration of single invocation	18.27 μs	28.71 μs	1.57	0.47	False
Narrow_uint - Duration of single invocation	7.59 μs	28.45 μs	3.75	0.35	False
Narrow_ulong - Duration of single invocation	6.11 μs	29.15 μs	4.77	0.37	False
Convert_ulong_double - Duration of single invocation	8.83 μs	22.14 μs	2.51	0.39	False
Widen_uint - Duration of single invocation	12.11 μs	23.24 μs	1.92	0.43	False
Widen_short - Duration of single invocation	9.70 μs	22.26 μs	2.30	0.32	False
Widen_ushort - Duration of single invocation	10.70 μs	21.37 μs	2.00	0.33	False
Widen_int - Duration of single invocation	9.72 μs	21.42 μs	2.20	0.48	False
Narrow_long - Duration of single invocation	6.10 μs	28.66 μs	4.70	0.39	False
Widen_float - Duration of single invocation	9.55 μs	21.36 μs	2.24	0.49	False
Widen_sbyte - Duration of single invocation	10.37 μs	21.61 μs	2.08	0.52	False
Convert_int_float - Duration of single invocation	13.90 μs	26.94 μs	1.94	0.45	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorConvert.Narrow_ushort

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.229307644110282 > 6.9001795775074175.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.721769404907135 (T) = (0 -29692.99010565287) / Math.Sqrt((52330.97940226629 / (27)) + (1932441.177783903 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -3.4731072751977683 = (6638.112676235796 - 29692.99010565287) / 6638.112676235796 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Widen_byte

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.324683476826518 > 10.744822898609868.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.400336981775027 (T) = (0 -22145.99624340649) / Math.Sqrt((2700362.444948758 / (26)) + (717615.7044677654 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -1.1946221005170736 = (10091.02944793488 - 22145.99624340649) / 10091.02944793488 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.6409956624097 > 36.27209185940303.
IsChangePoint: Marked as a change because one of 1/31/2023 8:52:14 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.205600605124832 (T) = (0 -49390.91847872137) / Math.Sqrt((2008843.536583427 / (27)) + (4686094.738398684 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.39477878675841005 = (35411.291702758295 - 49390.91847872137) / 35411.291702758295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Narrow_int

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.72618113661932 > 6.744650855748282.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.378354255724062 (T) = (0 -30291.20228506712) / Math.Sqrt((93229.88743313857 / (27)) + (6968696.434831801 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -3.6188524205191057 = (6558.16629916544 - 30291.20228506712) / 6558.16629916544 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Narrow_double

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.06893840104849 > 11.686684126208771.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.01668287852494 (T) = (0 -30475.736415922835) / Math.Sqrt((1256996.0737743394 / (27)) + (4198729.91040101 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -1.8193417023350988 = (10809.522091870429 - 30475.736415922835) / 10809.522091870429 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_long_double

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.2639833497716 > 9.165124022935299.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.66452006113784 (T) = (0 -22988.27997437214) / Math.Sqrt((1143819.2658231994 / (27)) + (1571596.4848818553 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -1.5598414954609836 = (8980.35289104193 - 22988.27997437214) / 8980.35289104193 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_double_ulong

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.96098051994302 > 25.831011827226543.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.824543108963592 (T) = (0 -36918.11185559553) / Math.Sqrt((1582769.1591155415 / (26)) + (1157831.2036221914 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.5191732686909849 = (24301.449095011063 - 36918.11185559553) / 24301.449095011063 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Narrow_short

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.76443599799733 > 7.306902704539576.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.92706949132834 (T) = (0 -30207.424753842435) / Math.Sqrt((312471.71721069014 / (26)) + (5541563.465220867 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -3.466290247110408 = (6763.426262631717 - 30207.424753842435) / 6763.426262631717 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_double_long

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.39960648919753 > 16.36510424323999.
IsChangePoint: Marked as a change because one of 3/2/2023 1:15:31 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.98500501472138 (T) = (0 -29827.991035216488) / Math.Sqrt((3009290.2804936715 / (27)) + (3179313.7983097318 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.918258699755939 = (15549.514275113945 - 29827.991035216488) / 15549.514275113945 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_uint_float

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.36021030529263 > 16.47374836610986.
IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.93997720939305 (T) = (0 -28919.17734383253) / Math.Sqrt((2556682.914209437 / (27)) + (12117247.615010696 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.8671589229781261 = (15488.33202569941 - 28919.17734383253) / 15488.33202569941 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_float_int

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.70847065781441 > 19.32762355437404.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.68866686018517 (T) = (0 -29700.639368016895) / Math.Sqrt((1924432.0853605291 / (27)) + (2524021.8471575086 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.5371640579133037 = (19321.710792753922 - 29700.639368016895) / 19321.710792753922 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Narrow_uint

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.452568295454544 > 6.72609343455168.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -114.40426506838422 (T) = (0 -28944.171049236636) / Math.Sqrt((528784.5761191357 / (26)) + (136870.13181880015 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -3.2529622985306914 = (6805.649572589965 - 28944.171049236636) / 6805.649572589965 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Narrow_ulong

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.150920577242527 > 6.402329077995956.
IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -99.01471440461285 (T) = (0 -29207.8746830633) / Math.Sqrt((293706.8280884347 / (27)) + (340201.740806996 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -3.616807181844652 = (6326.4229006404485 - 29207.8746830633) / 6326.4229006404485 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_ulong_double

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.144959097529398 > 9.29380254334099.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.580712812284045 (T) = (0 -23215.864194552778) / Math.Sqrt((905164.0696805554 / (27)) + (1741742.251525464 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -1.6114454279395038 = (8890.043784246596 - 23215.864194552778) / 8890.043784246596 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Widen_uint

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.235930482700894 > 10.179504875870695.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.86325688620725 (T) = (0 -22101.745578234506) / Math.Sqrt((1932226.5228026372 / (27)) + (789931.1180297168 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -1.2604106634080565 = (9777.756730678026 - 22101.745578234506) / 9777.756730678026 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Widen_short

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.264102030516433 > 10.334853481871734.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.71206652067971 (T) = (0 -22334.151119973612) / Math.Sqrt((1489480.5614047395 / (25)) + (979441.1359775269 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -1.2146240718901136 = (10084.84979616071 - 22334.151119973612) / 10084.84979616071 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Widen_ushort

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.373858145043737 > 10.582087855470125.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.389009125781165 (T) = (0 -22140.52564516442) / Math.Sqrt((2826166.909607583 / (26)) + (1196517.1010945716 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -1.1591412035060784 = (10254.320379423063 - 22140.52564516442) / 10254.320379423063 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Widen_int

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.417702694896523 > 10.543002779680654.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.099533139873934 (T) = (0 -21751.484945863023) / Math.Sqrt((2464168.091986168 / (25)) + (353139.16581915604 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -1.1744836080452496 = (10003.057675572227 - 21751.484945863023) / 10003.057675572227 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Narrow_long

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.65781713721919 > 6.405241794292568.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.32427755565166 (T) = (0 -29672.753725625458) / Math.Sqrt((577591.0124542086 / (26)) + (2323539.2540649157 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -3.5191786969115144 = (6565.961586317518 - 29672.753725625458) / 6565.961586317518 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Widen_float

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.362218597113504 > 10.708334852518412.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.011851382366523 (T) = (0 -21685.98319700733) / Math.Sqrt((2662563.2692424464 / (27)) + (352886.71795248013 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -1.175111365683525 = (9970.0564941844 - 21685.98319700733) / 9970.0564941844 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Widen_sbyte

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.605144400580485 > 10.703169794347492.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.80458265502757 (T) = (0 -21652.422024424144) / Math.Sqrt((1765922.0677089577 / (26)) + (17364.27880619806 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -1.1533299954958927 = (10055.319932251157 - 21652.422024424144) / 10055.319932251157 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorConvert.Convert_int_float

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.93575727911647 > 15.16193850450214.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.203257706438553 (T) = (0 -27746.466749084055) / Math.Sqrt((2754332.1569314604 / (27)) + (1305396.5084857848 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.8788589337918503 = (14767.722179699284 - 27746.466749084055) / 14767.722179699284 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.53 ns	18.73 ns	7.40	0.70	False
BitwiseAndBenchmark - Duration of single invocation	3.29 ns	53.63 ns	16.32	0.50	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.31 ns	18.77 ns	8.13	0.68	False
AbsBenchmark - Duration of single invocation	5.21 ns	102.74 ns	19.73	0.43	False
MinBenchmark - Duration of single invocation	5.03 ns	119.46 ns	23.73	0.37	False
GreaterThanAnyBenchmark - Duration of single invocation	2.55 ns	108.46 ns	42.61	0.49	False
EqualsAllBenchmark - Duration of single invocation	2.27 ns	31.78 ns	13.98	0.72	False
ZeroBenchmark - Duration of single invocation	2.28 ns	16.61 ns	7.30	0.64	True
BitwiseOrBenchmark - Duration of single invocation	3.34 ns	52.35 ns	15.68	0.57	True
LessThanOrEqualAllBenchmark - Duration of single invocation	2.49 ns	100.75 ns	40.52	0.52	False
LessThanOrEqualBenchmark - Duration of single invocation	3.98 ns	164.78 ns	41.42	0.41	False
CountBenchmark - Duration of single invocation	0.00 ns	14.86 ns	∞	0.88	True
AndNotBenchmark - Duration of single invocation	3.24 ns	86.58 ns	26.74	0.62	True
SubtractBenchmark - Duration of single invocation	4.31 ns	114.99 ns	26.71	0.44	False
DotBenchmark - Duration of single invocation	18.41 ns	166.76 ns	9.06	0.36	False
OnesComplementBenchmark - Duration of single invocation	3.06 ns	39.65 ns	12.97	0.61	True
OnesComplementOperatorBenchmark - Duration of single invocation	4.46 ns	39.44 ns	8.84	0.66	True
UnaryNegateOperatorBenchmark - Duration of single invocation	2.10 ns	117.85 ns	56.19	0.51	False
OneBenchmark - Duration of single invocation	2.09 ns	33.47 ns	16.04	0.65	False
SubtractionOperatorBenchmark - Duration of single invocation	3.38 ns	104.55 ns	30.89	0.45	False
LessThanBenchmark - Duration of single invocation	3.27 ns	169.21 ns	51.72	0.45	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.35 ns	55.60 ns	16.62	0.59	True
AddBenchmark - Duration of single invocation	3.63 ns	115.25 ns	31.73	0.45	False
LessThanAnyBenchmark - Duration of single invocation	2.41 ns	18.57 ns	7.72	0.68	False
ConditionalSelectBenchmark - Duration of single invocation	4.32 ns	189.48 ns	43.85	0.62	True
EqualsBenchmark - Duration of single invocation	2.46 ns	32.97 ns	13.43	0.73	False
EqualsStaticBenchmark - Duration of single invocation	3.47 ns	111.33 ns	32.11	0.44	False
AddOperatorBenchmark - Duration of single invocation	3.46 ns	127.35 ns	36.78	0.44	False
GreaterThanAllBenchmark - Duration of single invocation	2.20 ns	18.56 ns	8.44	0.68	False
EqualsAnyBenchmark - Duration of single invocation	2.63 ns	100.96 ns	38.41	0.45	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.05 ns	52.39 ns	17.17	0.63	True
NegateBenchmark - Duration of single invocation	3.20 ns	129.56 ns	40.50	0.44	False
MultiplyOperatorBenchmark - Duration of single invocation	17.50 ns	103.84 ns	5.93	0.37	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.50 ns	108.34 ns	43.35	0.51	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.22 ns	57.51 ns	17.85	0.61	True
GreaterThanBenchmark - Duration of single invocation	3.60 ns	110.21 ns	30.59	0.45	False
LessThanAllBenchmark - Duration of single invocation	1.43 ns	100.66 ns	70.19	0.54	False
XorBenchmark - Duration of single invocation	3.32 ns	51.55 ns	15.52	0.65	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.29 ns	110.18 ns	33.48	0.43	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.725692014174577 > 2.5649623763801355.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.02808089439082 (T) = (0 -21.654548904911493) / Math.Sqrt((0.48787218254893056 / (25)) + (9.722613023354667 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -6.925210742037334 = (2.7323625339134843 - 21.654548904911493) / 2.7323625339134843 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.63486579216716 > 3.419886440770327.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -90.53816035185793 (T) = (0 -53.921582639793655) / Math.Sqrt((0.6929133553173672 / (27)) + (2.2671623266648093 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.025566138137242 = (3.588655638267914 - 53.921582639793655) / 3.588655638267914 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.771598296028845 > 2.536260505390268.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.903481658560125 (T) = (0 -20.467253862551274) / Math.Sqrt((1.055321322313504 / (27)) + (3.778407740087373 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.698958582299632 = (2.658444469308709 - 20.467253862551274) / 2.658444469308709 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 102.73621289223445 > 3.5818650158178165.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -121.97606886377558 (T) = (0 -104.80140428034629) / Math.Sqrt((0.7623979927250727 / (26)) + (5.271954795598676 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -28.07847203436515 = (3.604089106074461 - 104.80140428034629) / 3.604089106074461 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 119.45947840708207 > 3.421794123241147.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.98085956700013 (T) = (0 -120.41587375559166) / Math.Sqrt((0.6058643720651107 / (26)) + (49.35921674153982 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -33.418279135810046 = (3.4986023932354753 - 120.41587375559166) / 3.4986023932354753 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 108.46305314489264 > 2.578084320404678.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -103.97483059397338 (T) = (0 -103.33986589962633) / Math.Sqrt((0.3887511117775104 / (26)) + (7.392923780417419 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -39.01474380358295 = (2.582544734183034 - 103.33986589962633) / 2.582544734183034 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.7817915277685 > 2.3830626943361164.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.713688418999105 (T) = (0 -29.385384330245802) / Math.Sqrt((0.24392588763531858 / (26)) + (5.077944147180266 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.624433457168216 = (2.3276596474561506 - 29.385384330245802) / 2.3276596474561506 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.614088000065507 > 2.4003615779016116.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -112.62612332790148 (T) = (0 -16.555007893705273) / Math.Sqrt((0.33548437071789594 / (26)) + (0.027738915457657557 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.718828912390362 = (2.1447564237537335 - 16.555007893705273) / 2.1447564237537335 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.35164186640892 > 3.4809828444043256.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.9705864529267 (T) = (0 -53.40560999686117) / Math.Sqrt((0.2544494889099381 / (27)) + (2.0055519646321684 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.52995566211796 = (3.4388771712422113 - 53.40560999686117) / 3.4388771712422113 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 100.75093630244082 > 2.5689791309032763.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -157.76923156465816 (T) = (0 -103.15351484634087) / Math.Sqrt((1.7543732334827429 / (27)) + (2.714667877897384 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -35.381579434948314 = (2.8353226123891453 - 103.15351484634087) / 2.8353226123891453 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 164.7784630445423 > 3.405389211749646.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -115.61277880721319 (T) = (0 -165.75018680623077) / Math.Sqrt((0.4843466812489226 / (26)) + (15.609401806378917 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -46.52020628990368 = (3.4879938398214967 - 165.75018680623077) / 3.4879938398214967 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.860708851983748 > 0.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -79.01184343394037 (T) = (0 -14.87682488617489) / Math.Sqrt((0.26932251518356803 / (25)) + (0.18711557750979038 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -53.49005631753128 = (0.2730190770859695 - 14.87682488617489) / 0.2730190770859695 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.58491425785496 > 3.3769129329926275.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -101.61984894182413 (T) = (0 -86.79342739178949) / Math.Sqrt((0.7050353726839581 / (27)) + (4.538198127759418 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -24.988539798255644 = (3.339680800289329 - 86.79342739178949) / 3.339680800289329 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 114.99263575877816 > 3.569579388956724.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -83.15662279430514 (T) = (0 -115.20763018038306) / Math.Sqrt((0.3184506123839838 / (27)) + (14.342364219519606 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -31.92439534023259 = (3.4991570532991054 - 115.20763018038306) / 3.4991570532991054 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 166.75789067228735 > 19.96554624019212.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.75062993008808 (T) = (0 -164.61041736324844) / Math.Sqrt((2.061102583245866 / (27)) + (80.27181770550784 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.6010461515041525 = (19.138418102135326 - 164.61041736324844) / 19.138418102135326 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.646139390632314 > 3.3623256942503197.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -204.67434475688736 (T) = (0 -39.56674577680343) / Math.Sqrt((0.6014540737618285 / (27)) + (0.06962778569912068 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.170745264657114 = (3.5419969607567565 - 39.56674577680343) / 3.5419969607567565 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.44297267252048 > 5.3643237420864915.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.12870945649871 (T) = (0 -41.40899137387643) / Math.Sqrt((1.1418267068534775 / (27)) + (8.738239297220067 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.18943505041743 = (5.056391694780673 - 41.40899137387643) / 5.056391694780673 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.UnaryNegateOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 117.85495992189486 > 3.4001192780873906.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.99032847173265 (T) = (0 -118.34680672030233) / Math.Sqrt((1.2412293059465078 / (27)) + (59.58652187453697 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -33.855402561832086 = (3.3953647934594886 - 118.34680672030233) / 3.3953647934594886 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.47421168269186 > 2.1916889259310004.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.5271158038218 (T) = (0 -34.56054639955657) / Math.Sqrt((0.349242107916414 / (25)) + (5.523199459053562 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -14.525868822246744 = (2.225997578314933 - 34.56054639955657) / 2.225997578314933 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 104.55382830952729 > 3.703299557981213.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.204658702010185 (T) = (0 -109.32312574177566) / Math.Sqrt((0.2642661892948317 / (27)) + (58.26805549292968 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -30.7188371786378 = (3.4466309444472096 - 109.32312574177566) / 3.4466309444472096 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 169.20625619330744 > 3.74248353865527.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -152.31374583549086 (T) = (0 -167.50840416019952) / Math.Sqrt((1.4197058488275467 / (26)) + (8.813966046449842 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -44.03173039350623 = (3.719786086309376 - 167.50840416019952) / 3.719786086309376 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.60213144791026 > 3.439282432357466.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -87.27767151476307 (T) = (0 -53.440475772174786) / Math.Sqrt((0.6555853742598127 / (26)) + (2.447709504328718 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.628312670104059 = (3.213824326761373 - 53.440475772174786) / 3.213824326761373 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 115.25161516891477 > 3.6890174286260824.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -104.55275995881905 (T) = (0 -113.96361768257596) / Math.Sqrt((0.5047700802433244 / (27)) + (8.780137325098517 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -31.536565751041692 = (3.5026320403507025 - 113.96361768257596) / 3.5026320403507025 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.57130840449735 > 2.538556964005216.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.788354933567092 (T) = (0 -20.474946184192145) / Math.Sqrt((1.1636960907602403 / (26)) + (6.804285647287456 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.590576228024798 = (2.6974165819714178 - 20.474946184192145) / 2.6974165819714178 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 189.4778184182413 > 3.8160864663590384.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -100.83346282638048 (T) = (0 -178.6281339649445) / Math.Sqrt((1.2022269103772385 / (27)) + (23.68078893718564 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -45.458890821802996 = (3.8448643694505713 - 178.6281339649445) / 3.8448643694505713 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.971850165468005 > 2.446976602445056.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.105387725929482 (T) = (0 -29.708807941463427) / Math.Sqrt((1.3610754745536024 / (26)) + (12.454766297122847 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.119596049443173 = (2.9357701430284013 - 29.708807941463427) / 2.9357701430284013 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 111.33426455603512 > 3.551131660534651.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -119.20014183510297 (T) = (0 -111.90986192380072) / Math.Sqrt((0.7248615437594709 / (27)) + (6.444275629092631 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -34.440304104581536 = (3.1577003852326877 - 111.90986192380072) / 3.1577003852326877 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 127.34567084509962 > 3.605312729675658.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.10445007522877 (T) = (0 -109.05017264889923) / Math.Sqrt((1.3461277647663465 / (26)) + (64.70242163826478 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -33.170164509745035 = (3.1913856492496273 - 109.05017264889923) / 3.1913856492496273 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.556331847458814 > 2.371791034727036.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -39.12825736614201 (T) = (0 -19.127587227927737) / Math.Sqrt((0.5079554053007611 / (27)) + (1.311269064222045 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.963742305506816 = (2.401834024024268 - 19.127587227927737) / 2.401834024024268 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 100.96069702612601 > 2.705805891499769.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -61.53973730597615 (T) = (0 -105.92416619100142) / Math.Sqrt((0.4667346957867624 / (26)) + (22.320316284671033 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -36.80772360779114 = (2.801654161721954 - 105.92416619100142) / 2.801654161721954 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.3947028950951 > 3.31996618077061.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -131.53162780877742 (T) = (0 -52.98280657303641) / Math.Sqrt((0.45575950566964074 / (27)) + (1.006591915332541 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.078865155903586 = (3.295183214692426 - 52.98280657303641) / 3.295183214692426 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 129.56467302029074 > 3.3730405539735355.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -132.44628225948432 (T) = (0 -127.40785796557299) / Math.Sqrt((0.3746779987847613 / (27)) + (6.911691656992405 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -37.4346628227427 = (3.31492066297464 - 127.40785796557299) / 3.31492066297464 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 103.84216541872328 > 17.730057118772972.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.31857401555031 (T) = (0 -106.2971581656682) / Math.Sqrt((3.176377412407302 / (27)) + (50.03970694696512 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.202110551948473 = (17.138868660164977 - 106.2971581656682) / 17.138868660164977 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 108.34270762167075 > 2.6107173955565877.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -54.19100329407544 (T) = (0 -105.9819584320605) / Math.Sqrt((0.36311069535802915 / (26)) + (29.050249738350796 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -41.09604185557634 = (2.5176228871033723 - 105.9819584320605) / 2.5176228871033723 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.51130948262067 > 3.5293134120006973.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.580539292534482 (T) = (0 -56.212016119600904) / Math.Sqrt((0.33315177096708903 / (26)) + (81.19598252154609 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.74999480025789 = (3.355942302664801 - 56.212016119600904) / 3.355942302664801 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 110.21355520105298 > 3.6371208159732062.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -191.54516100464983 (T) = (0 -110.87207253329558) / Math.Sqrt((0.8204914352466453 / (27)) + (2.2610997945583162 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -28.925096061071926 = (3.7049863534949035 - 110.87207253329558) / 3.7049863534949035 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 100.65749822776733 > 2.326447395922769.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -83.98370331332926 (T) = (0 -104.49857452140037) / Math.Sqrt((0.41748548002476765 / (27)) + (11.687586642122152 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -41.61846694939384 = (2.451955267313684 - 104.49857452140037) / 2.451955267313684 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.548544058677834 > 3.4246054649161604.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.6268391061453 (T) = (0 -52.47058396405798) / Math.Sqrt((1.621173717147425 / (26)) + (1.4975387620453413 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.175158104657758 = (3.701587211702202 - 52.47058396405798) / 3.701587211702202 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<SByte>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 110.17707465633283 > 3.496827531432948.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -179.08164526807863 (T) = (0 -111.581578814896) / Math.Sqrt((1.3032585502023273 / (25)) + (2.5079375565527156 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -32.845779332505 = (3.296764944269865 - 111.581578814896) / 3.296764944269865 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
NegateBenchmark - Duration of single invocation	13.76 ns	72.69 ns	5.28	0.60	True
MultiplyBenchmark - Duration of single invocation	3.29 ns	56.69 ns	17.24	0.53	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.19 ns	52.01 ns	16.29	0.56	True
EqualsBenchmark - Duration of single invocation	7.21 ns	124.56 ns	17.28	0.63	False
GreaterThanAnyBenchmark - Duration of single invocation	3.00 ns	35.77 ns	11.93	0.62	False
GreaterThanAllBenchmark - Duration of single invocation	2.75 ns	31.95 ns	11.62	0.66	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.35 ns	47.25 ns	14.10	0.65	True
SubtractionOperatorBenchmark - Duration of single invocation	2.72 ns	40.16 ns	14.79	0.65	False
GreaterThanBenchmark - Duration of single invocation	3.11 ns	40.07 ns	12.87	0.64	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	4.90 ns	26.49 ns	5.41	0.69	False
LessThanOrEqualBenchmark - Duration of single invocation	3.13 ns	41.61 ns	13.28	0.69	False
AndNotBenchmark - Duration of single invocation	3.28 ns	48.46 ns	14.77	0.60	True
EqualityOperatorBenchmark - Duration of single invocation	2.48 ns	27.75 ns	11.17	0.72	False
LessThanBenchmark - Duration of single invocation	4.41 ns	44.50 ns	10.09	0.63	False
DivideBenchmark - Duration of single invocation	3.21 ns	51.60 ns	16.10	0.62	False
ConditionalSelectBenchmark - Duration of single invocation	3.53 ns	57.16 ns	16.18	0.65	True
LessThanAllBenchmark - Duration of single invocation	2.52 ns	30.49 ns	12.08	0.65	False
BitwiseAndBenchmark - Duration of single invocation	3.37 ns	50.77 ns	15.08	0.61	True
UnaryNegateOperatorBenchmark - Duration of single invocation	13.72 ns	57.64 ns	4.20	0.63	True
InequalityOperatorBenchmark - Duration of single invocation	2.14 ns	24.94 ns	11.63	0.74	False
EqualsStaticBenchmark - Duration of single invocation	3.15 ns	39.48 ns	12.52	0.62	False
LessThanOrEqualAnyBenchmark - Duration of single invocation	1.79 ns	41.35 ns	23.15	0.69	False
OnesComplementOperatorBenchmark - Duration of single invocation	6.04 ns	42.12 ns	6.98	0.59	True
SubtractBenchmark - Duration of single invocation	3.55 ns	52.55 ns	14.82	0.65	False
MinBenchmark - Duration of single invocation	3.81 ns	43.89 ns	11.52	0.60	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.27 ns	48.26 ns	14.75	0.60	True
LessThanAnyBenchmark - Duration of single invocation	2.57 ns	40.65 ns	15.81	0.64	False
AllBitsSetBenchmark - Duration of single invocation	2.15 ns	29.93 ns	13.94	0.65	True
AbsBenchmark - Duration of single invocation	3.31 ns	44.00 ns	13.27	0.59	False
AddBenchmark - Duration of single invocation	5.03 ns	57.88 ns	11.51	0.57	False
DivisionOperatorBenchmark - Duration of single invocation	9.39 ns	50.59 ns	5.39	0.62	False
XorBenchmark - Duration of single invocation	3.49 ns	48.17 ns	13.81	0.59	True
ZeroBenchmark - Duration of single invocation	1.94 ns	16.36 ns	8.43	0.62	True
EqualsAllBenchmark - Duration of single invocation	0.85 ns	38.03 ns	44.99	0.71	False
DotBenchmark - Duration of single invocation	7.38 ns	42.39 ns	5.74	0.86	False
GreaterThanOrEqualBenchmark - Duration of single invocation	1.08 ns	39.33 ns	36.51	0.59	False
MultiplyOperatorBenchmark - Duration of single invocation	3.46 ns	51.77 ns	14.96	0.65	False
SquareRootBenchmark - Duration of single invocation	20.23 ns	36.88 ns	1.82	0.68	False
CountBenchmark - Duration of single invocation	0.09 ns	14.73 ns	170.66	0.85	True
LessThanOrEqualAllBenchmark - Duration of single invocation	2.03 ns	24.65 ns	12.16	0.69	False
AddOperatorBenchmark - Duration of single invocation	3.15 ns	45.98 ns	14.59	0.64	False
SumBenchmark - Duration of single invocation	0.59 ns	24.28 ns	40.89	0.87	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.96 ns	36.35 ns	12.28	0.64	False
MaxBenchmark - Duration of single invocation	3.17 ns	43.37 ns	13.69	0.58	False
EqualsAnyBenchmark - Duration of single invocation	2.53 ns	43.00 ns	17.02	0.66	False
OnesComplementBenchmark - Duration of single invocation	3.16 ns	47.55 ns	15.05	0.59	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 72.6878455905805 > 14.372098677054153.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.968889297145413 (T) = (0 -72.59762824300141) / Math.Sqrt((1.1239214206602488 / (26)) + (75.23117654092708 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -4.0787044287742225 = (14.294517285094953 - 72.59762824300141) / 14.294517285094953 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.69054253594038 > 3.388663583559939.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.729276494813476 (T) = (0 -52.956671913212894) / Math.Sqrt((0.41633661672433303 / (26)) + (14.518084766750698 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.245735932622551 = (3.259727483743735 - 52.956671913212894) / 3.259727483743735 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.00855234181823 > 3.4524791282272322.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -90.79001049177037 (T) = (0 -49.163496002986264) / Math.Sqrt((0.8760336103378387 / (26)) + (1.7467309138061822 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.717069453246463 = (3.5841107439570905 - 49.163496002986264) / 3.5841107439570905 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 124.56046887425997 > 7.479520819594807.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.93834072207247 (T) = (0 -128.29551132560255) / Math.Sqrt((1.5265750612339244 / (27)) + (40.30429333703969 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -18.585984100074583 = (6.550373505363665 - 128.29551132560255) / 6.550373505363665 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.77329440707796 > 2.675145326790703.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.03688855926228 (T) = (0 -39.500144295605) / Math.Sqrt((1.1314495797217405 / (27)) + (10.255680466208148 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.969514163115727 = (2.638705830075083 - 39.500144295605) / 2.638705830075083 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.949195154795106 > 2.6808670083469406.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.115761022240623 (T) = (0 -28.74811209322649) / Math.Sqrt((0.2530437419070996 / (27)) + (5.6380523328641345 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.717719857476933 = (2.4533878982336885 - 28.74811209322649) / 2.4533878982336885 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.254083075931064 > 3.502302946094248.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -67.29417275043158 (T) = (0 -49.16257247411958) / Math.Sqrt((0.2885040492600719 / (27)) + (3.6121515185181994 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.4077938635878 = (3.4122207007948693 - 49.16257247411958) / 3.4122207007948693 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.160850424946105 > 3.601906698284915.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.337473726040805 (T) = (0 -43.34336032735482) / Math.Sqrt((1.791361653465649 / (26)) + (11.57510875819483 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.277411944332933 = (3.53033363414685 - 43.34336032735482) / 3.53033363414685 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.071216414959615 > 3.43348966290521.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.93493830782169 (T) = (0 -41.68102231759843) / Math.Sqrt((0.7887064495626068 / (27)) + (8.227436738645835 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -11.482783635719219 = (3.339080731827241 - 41.68102231759843) / 3.339080731827241 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.485586798250996 > 2.942606118487495.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.18122983149902 (T) = (0 -29.54917199755715) / Math.Sqrt((0.6395678426405994 / (27)) + (13.896124963757648 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.666045651811466 = (2.770396167631129 - 29.54917199755715) / 2.770396167631129 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.60562484234806 > 5.115501565123468.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -60.155933543864066 (T) = (0 -40.788647649066064) / Math.Sqrt((2.953476963740861 / (26)) + (2.1211021410122988 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.825270540160577 = (3.76791023353593 - 40.788647649066064) / 3.76791023353593 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.46380419401692 > 3.5043101309092393.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.97093154075639 (T) = (0 -50.741825262104435) / Math.Sqrt((1.011900612027125 / (27)) + (5.749023044505751 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -13.467776829423512 = (3.5072302994686373 - 50.741825262104435) / 3.5072302994686373 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.75126366810706 > 2.3910129284052397.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.68583872157923 (T) = (0 -27.422816884805375) / Math.Sqrt((0.2244614436325523 / (25)) + (5.263416763454832 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -10.602895799347126 = (2.3634459327255537 - 27.422816884805375) / 2.3634459327255537 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.49672990398761 > 3.326108928492693.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.65829404780827 (T) = (0 -42.73746107067114) / Math.Sqrt((0.28175226262123565 / (27)) + (9.16176118552592 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.836862007183935 = (3.3292763485931243 - 42.73746107067114) / 3.3292763485931243 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.59795842371794 > 3.4846794146009787.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.57781930434236 (T) = (0 -52.18092002965428) / Math.Sqrt((3.7401481574549242 / (27)) + (7.496895508370933 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.470469995000014 = (3.873726755564049 - 52.18092002965428) / 3.873726755564049 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.16166577912209 > 3.6750190495652775.
IsChangePoint: Marked as a change because one of 3/1/2023 10:00:31 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -70.84305674284255 (T) = (0 -53.88170630336881) / Math.Sqrt((0.6516378450035878 / (27)) + (3.8165664481411086 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.45422855958514 = (3.7277469414054503 - 53.88170630336881) / 3.7277469414054503 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.493827538697563 > 2.577581235431744.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.866225553962554 (T) = (0 -27.10072300628738) / Math.Sqrt((0.9876971493158929 / (26)) + (5.193431794634536 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.566927407916216 = (2.3429491731520757 - 27.10072300628738) / 2.3429491731520757 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.77319671631767 > 3.454162919842765.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.376204670088775 (T) = (0 -49.840225910081735) / Math.Sqrt((4.111311609267135 / (26)) + (5.648544713578824 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.652814603046796 = (3.9390623725791585 - 49.840225910081735) / 3.9390623725791585 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.UnaryNegateOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.643732094755066 > 14.402051470914108.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.103387073224965 (T) = (0 -59.85426828664782) / Math.Sqrt((3.3082956402351122 / (26)) + (6.873503547150999 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -2.974927789853865 = (15.057951100250884 - 59.85426828664782) / 15.057951100250884 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.944096479961196 > 2.422449184194104.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.876182188189002 (T) = (0 -27.018816496541714) / Math.Sqrt((0.3321194088771716 / (26)) + (9.942511372025118 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.78210028441934 = (2.5058954919557945 - 27.018816496541714) / 2.5058954919557945 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.476422597367794 > 3.3233540516212448.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.568662128238344 (T) = (0 -42.64442238343691) / Math.Sqrt((1.2123458677131937 / (27)) + (10.584927740228741 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.610174061158766 = (3.381747323757263 - 42.64442238343691) / 3.381747323757263 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.34709154271647 > 2.5075820748014896.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.044915783196103 (T) = (0 -42.242484782617296) / Math.Sqrt((0.3693616192266325 / (26)) + (28.44025360242407 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -16.00903844727959 = (2.4835316184127696 - 42.242484782617296) / 2.4835316184127696 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.12451151514339 > 6.388349648849437.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -76.35111633394196 (T) = (0 -42.76150419976807) / Math.Sqrt((1.4907889447021032 / (27)) + (1.3535702231719267 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.486436118166877 = (6.592449755267588 - 42.76150419976807) / 6.592449755267588 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.54798754071828 > 3.3994692082401055.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.26722979712512 (T) = (0 -54.4831219771482) / Math.Sqrt((1.2294746295527532 / (26)) + (25.682303132017392 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.727053786532537 = (3.4642929767178288 - 54.4831219771482) / 3.4642929767178288 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.89474481765089 > 3.560253102467168.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.148922704379366 (T) = (0 -43.3693549919047) / Math.Sqrt((1.1447246156721977 / (25)) + (9.239100676375553 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -10.537371278085743 = (3.759032620739276 - 43.3693549919047) / 3.759032620739276 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.261898441575255 > 3.4832666647349466.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -134.6052489980209 (T) = (0 -48.98023658574765) / Math.Sqrt((0.9040825027745293 / (25)) + (0.6132147296800411 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -11.995303156612495 = (3.7690722559884784 - 48.98023658574765) / 3.7690722559884784 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.64641834499603 > 2.625859813956314.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.44007267384299 (T) = (0 -38.14380519092936) / Math.Sqrt((0.38864878829616745 / (26)) + (9.449380283089722 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.313009140440517 = (2.664974556828614 - 38.14380519092936) / 2.664974556828614 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.933940993828 > 2.116796079975977.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -166.87777909971882 (T) = (0 -30.250010676635192) / Math.Sqrt((0.16334803794125896 / (27)) + (0.18083509093228844 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.1126686905077 = (2.001632623339072 - 30.250010676635192) / 2.001632623339072 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.99647509271221 > 3.5028230520623107.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -75.87209049679463 (T) = (0 -42.80972815128429) / Math.Sqrt((0.7695836524702125 / (27)) + (1.9634988492551007 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.814977554448184 = (3.0987910029213404 - 42.80972815128429) / 3.0987910029213404 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.88012310752799 > 3.4040669153032312.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.215516357671536 (T) = (0 -55.56348994773936) / Math.Sqrt((0.22931699974895947 / (27)) + (40.4852214529311 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.866538227916553 = (3.294303146082091 - 55.56348994773936) / 3.294303146082091 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.590901860545294 > 3.6478590869267875.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.776943409762445 (T) = (0 -43.84057456367249) / Math.Sqrt((2.91347864987276 / (26)) + (11.849824231579296 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.753492908740082 = (3.730003914927447 - 43.84057456367249) / 3.730003914927447 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.174079082545646 > 3.525480313251936.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -83.33051818982013 (T) = (0 -48.76190038981385) / Math.Sqrt((0.3832260816637326 / (27)) + (2.252323532817576 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.152046322083889 = (3.445572412642701 - 48.76190038981385) / 3.445572412642701 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.360492981933625 > 2.036584988249411.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.78953749672122 (T) = (0 -16.72355526933701) / Math.Sqrt((1.479157744405502 / (27)) + (0.47972479133903556 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.513571340685794 = (2.56749398979888 - 16.72355526933701) / 2.56749398979888 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.02720548478134 > 2.4314626930100576.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.723535134578842 (T) = (0 -41.03496877561153) / Math.Sqrt((0.7272488331372214 / (26)) + (14.117375085570261 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.922694928032037 = (2.577137159324024 - 41.03496877561153) / 2.577137159324024 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.38643032597514 > 3.996217126634935.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.208848746808286 (T) = (0 -42.54872469205977) / Math.Sqrt((3.9717679022825916 / (27)) + (26.67629375332277 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.30299069029038 = (2.9748131431662106 - 42.54872469205977) / 2.9748131431662106 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.325704806581435 > 3.469188128312264.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.52030312178197 (T) = (0 -42.022514588963325) / Math.Sqrt((1.4614102337168347 / (27)) + (8.54081551131493 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.569358140867063 = (3.343250635236058 - 42.022514588963325) / 3.343250635236058 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.76616142973315 > 3.718428911653991.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.848328698007425 (T) = (0 -43.898467504753775) / Math.Sqrt((0.7569848978159304 / (26)) + (29.957130098843553 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.918247258886518 = (3.3981752032618684 - 43.898467504753775) / 3.3981752032618684 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.876548601221415 > 22.749050693594857.
IsChangePoint: Marked as a change because one of 1/28/2023 8:08:27 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.94076598788794 (T) = (0 -38.790472638868096) / Math.Sqrt((10.772847921441217 / (26)) + (7.670972109067193 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.7275445387188161 = (22.454108574031867 - 38.790472638868096) / 22.454108574031867 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.731662392205758 > 0.19432978203345677.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.725210270285878 (T) = (0 -15.654044032653932) / Math.Sqrt((0.15830138783573797 / (27)) + (2.2484002298259584 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -57.49870354867135 = (0.26759642663926136 - 15.654044032653932) / 0.26759642663926136 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.653690631772285 > 2.5823178157353888.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.691116752511046 (T) = (0 -27.207034287211734) / Math.Sqrt((0.3427437102772765 / (27)) + (4.759470413176674 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.866943755330714 = (2.503650971218608 - 27.207034287211734) / 2.503650971218608 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.979151081807785 > 3.338119080477642.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.56968265186364 (T) = (0 -44.60912666294803) / Math.Sqrt((1.0998020605799845 / (26)) + (42.89242640983558 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.844255716097454 = (3.766308979830623 - 44.60912666294803) / 3.766308979830623 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.276378992432488 > 1.7046935871104678.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.824656540723257 (T) = (0 -26.82304495690082) / Math.Sqrt((1.2194788440725624 / (27)) + (6.1631640937944345 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.824503773123716 = (1.6950322955754853 - 26.82304495690082) / 1.6950322955754853 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.34716225583268 > 2.760014662298509.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.53901945167651 (T) = (0 -40.58149079112172) / Math.Sqrt((0.4216865453724108 / (27)) + (24.56467679748608 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.796604512400917 = (2.7426218465939733 - 40.58149079112172) / 2.7426218465939733 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.36954731469226 > 3.3372564837695573.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.77186091325947 (T) = (0 -43.406808006857915) / Math.Sqrt((0.6762756986843123 / (25)) + (10.507225686940833 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -12.785859409921601 = (3.1486472272898918 - 43.406808006857915) / 3.1486472272898918 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.9971935616696 > 2.652366769545525.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.196903211248724 (T) = (0 -40.073984379717295) / Math.Sqrt((0.6534795055954703 / (27)) + (12.132629874586367 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.4659898700319 = (2.5911037519407505 - 40.073984379717295) / 2.5911037519407505 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.55105264475201 > 3.3187416916968075.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -11.976735794616165 (T) = (0 -47.35425004170725) / Math.Sqrt((0.2189589430679696 / (27)) + (108.17292125161813 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.347628185047483 = (3.300493254422214 - 47.35425004170725) / 3.300493254422214 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConditionalSelectBenchmark - Duration of single invocation	3.41 ns	51.99 ns	15.26	0.65	False
DotBenchmark - Duration of single invocation	18.41 ns	171.03 ns	9.29	0.32	False
LessThanAllBenchmark - Duration of single invocation	2.69 ns	25.93 ns	9.63	0.68	False
MultiplyOperatorBenchmark - Duration of single invocation	16.28 ns	98.74 ns	6.06	0.39	False
MinBenchmark - Duration of single invocation	2.98 ns	135.75 ns	45.50	0.44	False
ZeroBenchmark - Duration of single invocation	2.00 ns	16.55 ns	8.28	0.64	True
AbsBenchmark - Duration of single invocation	4.75 ns	29.50 ns	6.21	0.61	True
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.14 ns	48.00 ns	15.29	0.61	True
DivideBenchmark - Duration of single invocation	104.43 ns	127.72 ns	1.22	0.09	False
MaxBenchmark - Duration of single invocation	3.24 ns	134.47 ns	41.56	0.47	False
GreaterThanAnyBenchmark - Duration of single invocation	2.41 ns	25.96 ns	10.75	0.73	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.56 ns	48.99 ns	13.75	0.58	True
GreaterThanAllBenchmark - Duration of single invocation	2.64 ns	125.71 ns	47.63	0.47	False
LessThanBenchmark - Duration of single invocation	3.27 ns	132.04 ns	40.41	0.42	False
InequalityOperatorBenchmark - Duration of single invocation	2.39 ns	18.58 ns	7.78	0.71	False
EqualsStaticBenchmark - Duration of single invocation	3.24 ns	131.17 ns	40.50	0.40	False
EqualsAnyBenchmark - Duration of single invocation	1.94 ns	121.89 ns	62.94	0.48	False
GreaterThanBenchmark - Duration of single invocation	2.45 ns	183.83 ns	75.13	0.47	False
AddBenchmark - Duration of single invocation	2.38 ns	103.85 ns	43.64	0.41	False
AndNotBenchmark - Duration of single invocation	3.25 ns	49.30 ns	15.19	0.61	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.48 ns	118.44 ns	47.77	0.51	False
AllBitsSetBenchmark - Duration of single invocation	1.42 ns	34.64 ns	24.41	0.64	True
BitwiseOrBenchmark - Duration of single invocation	3.36 ns	49.46 ns	14.74	0.60	True
EqualsAllBenchmark - Duration of single invocation	2.20 ns	24.34 ns	11.08	0.71	False
NegateBenchmark - Duration of single invocation	85.91 ns	109.75 ns	1.28	0.22	False
SubtractionOperatorBenchmark - Duration of single invocation	4.41 ns	97.81 ns	22.17	0.43	False
CountBenchmark - Duration of single invocation	0.11 ns	15.15 ns	138.89	0.91	True
LessThanAnyBenchmark - Duration of single invocation	2.34 ns	116.88 ns	49.99	0.50	False
SquareRootBenchmark - Duration of single invocation	99.86 ns	138.93 ns	1.39	0.28	False
OnesComplementOperatorBenchmark - Duration of single invocation	5.77 ns	42.04 ns	7.29	0.64	True
AddOperatorBenchmark - Duration of single invocation	4.71 ns	98.29 ns	20.85	0.41	False
XorBenchmark - Duration of single invocation	3.18 ns	48.54 ns	15.28	0.61	True
EqualityOperatorBenchmark - Duration of single invocation	1.06 ns	21.07 ns	19.95	0.74	False
LessThanOrEqualAllBenchmark - Duration of single invocation	3.33 ns	39.34 ns	11.80	0.74	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.31 ns	29.68 ns	12.84	0.70	False
SubtractBenchmark - Duration of single invocation	3.49 ns	112.18 ns	32.11	0.45	False
BitwiseAndBenchmark - Duration of single invocation	3.42 ns	53.55 ns	15.66	0.60	True
SumBenchmark - Duration of single invocation	3.53 ns	89.48 ns	25.35	0.52	False
GreaterThanOrEqualBenchmark - Duration of single invocation	3.20 ns	185.41 ns	57.99	0.46	False
MultiplyBenchmark - Duration of single invocation	19.66 ns	108.39 ns	5.51	0.37	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.51 ns	49.13 ns	14.01	0.61	True
OnesComplementBenchmark - Duration of single invocation	3.14 ns	41.84 ns	13.31	0.65	True
LessThanOrEqualBenchmark - Duration of single invocation	4.24 ns	125.88 ns	29.71	0.38	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.98710592767942 > 3.777879901061725.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -67.43755445458197 (T) = (0 -52.301844931084446) / Math.Sqrt((0.7655676750187784 / (27)) + (3.9295378045829623 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.161894575781163 = (3.693138983009235 - 52.301844931084446) / 3.693138983009235 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 171.027458650341 > 19.32750656487176.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.29099915546849 (T) = (0 -174.8141824560289) / Math.Sqrt((0.7510579119366676 / (26)) + (147.35821636587906 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.231152273274772 = (18.93741726719596 - 174.8141824560289) / 18.93741726719596 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.93234847433183 > 2.7209814205819947.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.380860964384397 (T) = (0 -31.197106523350094) / Math.Sqrt((0.37508574004560497 / (27)) + (15.615551518366 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.900691864288493 = (2.621453179286671 - 31.197106523350094) / 2.621453179286671 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 98.73784607720073 > 17.043848003688264.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -84.42126288663259 (T) = (0 -96.96539857011742) / Math.Sqrt((2.43379011089699 / (27)) + (6.398347166283223 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -4.596686289785574 = (17.325501832591094 - 96.96539857011742) / 17.325501832591094 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 135.751105914226 > 3.2801845517615575.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -133.92631184402572 (T) = (0 -136.32109489895785) / Math.Sqrt((0.5134134198482886 / (27)) + (7.712673796340581 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -37.60350562425529 = (3.531313871486967 - 136.32109489895785) / 3.531313871486967 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.55480240466311 > 2.141154987380723.
IsChangePoint: Marked as a change because one of 3/1/2023 5:53:50 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.70956975761371 (T) = (0 -17.00355297963967) / Math.Sqrt((0.39989510281984075 / (26)) + (1.353445598231359 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.2276457249771 = (1.6625089914988957 - 17.00355297963967) / 1.6625089914988957 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.502218304019998 > 5.761293657092583.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.92595008526699 (T) = (0 -31.023931155162124) / Math.Sqrt((0.40016117146253904 / (27)) + (4.557437717820932 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -4.302170586271121 = (5.851175598818379 - 31.023931155162124) / 5.851175598818379 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.995884911833706 > 3.3673387577785805.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -56.505385501965335 (T) = (0 -48.333108565958874) / Math.Sqrt((0.544576524052818 / (27)) + (4.86703323319106 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.672578665777158 = (3.535039713242827 - 48.333108565958874) / 3.535039713242827 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 127.72454458850396 > 107.9099919727754.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.727151979046972 (T) = (0 -126.23760536311016) / Math.Sqrt((12.087809019856397 / (26)) + (5.490712339946887 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.2138454420858793 = (103.99808821309466 - 126.23760536311016) / 103.99808821309466 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 134.4705864360186 > 3.569344342743176.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.55358313887219 (T) = (0 -140.60657107592277) / Math.Sqrt((0.37481987057700855 / (27)) + (63.74659967914291 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -40.003894315257604 = (3.429102855325693 - 140.60657107592277) / 3.429102855325693 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.964123141727807 > 2.6548118167265677.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.476147271075085 (T) = (0 -28.305567357127714) / Math.Sqrt((0.3365608440491908 / (26)) + (7.446911287101968 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -9.95399489990368 = (2.5840405820689774 - 28.305567357127714) / 2.5840405820689774 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.988561716821565 > 3.5422504618191812.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -63.190496855788076 (T) = (0 -50.05423739637233) / Math.Sqrt((1.0596273519354111 / (26)) + (4.076349735710276 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.749287978103352 = (3.1781904976252924 - 50.05423739637233) / 3.1781904976252924 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 125.71156764794434 > 2.5585342521841086.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -60.372064660038845 (T) = (0 -122.24515363887267) / Math.Sqrt((0.47752436194311754 / (25)) + (31.204751326564583 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -43.95603200137249 = (2.719215824811686 - 122.24515363887267) / 2.719215824811686 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 132.04066431635923 > 3.45288872196381.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -70.56943827623122 (T) = (0 -135.19246026074) / Math.Sqrt((1.7702066453349525 / (26)) + (27.167147387997144 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -34.11242710507073 = (3.8502738604821856 - 135.19246026074) / 3.8502738604821856 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.579361553594254 > 2.6403021071504944.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.92595216091469 (T) = (0 -18.529741535537816) / Math.Sqrt((1.3573590480434832 / (27)) + (0.9477819678484041 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.280664286863956 = (2.9502837103223096 - 18.529741535537816) / 2.9502837103223096 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 131.16616353266295 > 3.4049487301264287.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -123.18467383689999 (T) = (0 -131.36169999137064) / Math.Sqrt((0.9482473290864347 / (27)) + (8.33765408102835 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -36.50031381623688 = (3.5029493522396513 - 131.36169999137064) / 3.5029493522396513 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 121.88587736204269 > 2.6066383058192657.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -84.83708692562821 (T) = (0 -119.28922713064749) / Math.Sqrt((0.3686803733545973 / (26)) + (14.991685560685008 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -42.93875434851275 = (2.714897791240757 - 119.28922713064749) / 2.714897791240757 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 183.83033244921475 > 3.761291890237686.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -134.94857397000038 (T) = (0 -180.8221977709186) / Math.Sqrt((0.49166774356297444 / (25)) + (13.643081555627505 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -49.52199002541988 = (3.5790790837799307 - 180.8221977709186) / 3.5790790837799307 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 103.8512312118681 > 3.651867461199972.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -92.71208089316305 (T) = (0 -105.56727351587882) / Math.Sqrt((0.3565604145135322 / (27)) + (9.591460578269473 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -29.214708811216756 = (3.493903389090037 - 105.56727351587882) / 3.493903389090037 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.29963375714821 > 3.4017380070836074.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -69.39191932449853 (T) = (0 -50.150193307211296) / Math.Sqrt((0.46068908981537 / (27)) + (3.5219272161304715 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.553091334580746 = (3.2244517972904427 - 50.150193307211296) / 3.2244517972904427 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 118.43768994858779 > 2.5469107389847494.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -76.08762994791 (T) = (0 -120.10403820261543) / Math.Sqrt((0.15484369080062566 / (27)) + (19.062332272230694 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -46.81814344283399 = (2.511683422970997 - 120.10403820261543) / 2.511683422970997 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.638904667376046 > 2.1136390542672925.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.22763906602731 (T) = (0 -31.05002330398936) / Math.Sqrt((1.3984419574277391 / (27)) + (2.6571880255605054 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.905555896688698 = (2.405942336196162 - 31.05002330398936) / 2.405942336196162 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.45875517270117 > 3.4486959597413516.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -61.98305122446806 (T) = (0 -49.07919789341101) / Math.Sqrt((0.6966445707436897 / (27)) + (4.142473150771093 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.524275494710155 = (3.379115048546553 - 49.07919789341101) / 3.379115048546553 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.338172899953722 > 2.332979464529436.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.52824270302038 (T) = (0 -27.760460460919738) / Math.Sqrt((0.6127084286255748 / (27)) + (9.900588146032154 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.239519855213393 = (2.469897363813383 - 27.760460460919738) / 2.469897363813383 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 109.75150021872103 > 89.01378573867241.
IsChangePoint: Marked as a change because one of 1/28/2023 4:01:39 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -8.937418174236686 (T) = (0 -105.77724807023911) / Math.Sqrt((32.021164311123066 / (27)) + (25.36221801949258 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.21410827172668634 = (87.12340615207597 - 105.77724807023911) / 87.12340615207597 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 97.80876214000246 > 3.4751427670471666.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -74.13897042927834 (T) = (0 -98.93915784683874) / Math.Sqrt((3.70157120938265 / (27)) + (12.122830837833302 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -26.216414996312558 = (3.635275177140105 - 98.93915784683874) / 3.635275177140105 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.148945819721918 > 0.07506392148735663.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.179208596266776 (T) = (0 -15.54901228353546) / Math.Sqrt((0.02992102534056956 / (25)) + (1.836537631760514 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -170.25560056620074 = (0.09079418268440696 - 15.54901228353546) / 0.09079418268440696 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 116.88260241596639 > 2.3815059123190814.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -139.26526594716245 (T) = (0 -118.15126396886569) / Math.Sqrt((0.3107746106775219 / (27)) + (5.42545666780953 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -46.361928909734075 = (2.4946463686909217 - 118.15126396886569) / 2.4946463686909217 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 138.93253606960386 > 106.3262913719335.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.82314661061552 (T) = (0 -143.99575862543867) / Math.Sqrt((31.33384639786668 / (27)) + (43.29691696944942 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.42759420963091804 = (100.86602877344711 - 143.99575862543867) / 100.86602877344711 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.03824951785959 > 6.28834560882092.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -121.42731658063691 (T) = (0 -41.971004497887286) / Math.Sqrt((1.5914215645842813 / (26)) + (0.21716339749740232 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.140994566014621 = (5.8774732440821955 - 41.971004497887286) / 5.8774732440821955 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 98.28730893437832 > 3.715851821818133.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -82.96004438711904 (T) = (0 -98.61939473034238) / Math.Sqrt((1.4445369622333846 / (27)) + (10.039322468641275 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.477259282433387 = (3.724682894040036 - 98.61939473034238) / 3.724682894040036 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.536602522244614 > 3.3936966767699124.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -63.44016759041545 (T) = (0 -50.02166796864447) / Math.Sqrt((1.2516661312291708 / (27)) + (3.9455509748760176 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.616800950923595 = (3.4222035407469744 - 50.02166796864447) / 3.4222035407469744 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.071935682829174 > 2.3515814039293965.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.100903876717236 (T) = (0 -19.61343324458082) / Math.Sqrt((0.7215199599095172 / (27)) + (4.677310708191365 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.4088853423331855 = (2.3324652966594908 - 19.61343324458082) / 2.3324652966594908 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.338110100108544 > 2.498296174365465.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.198299959468168 (T) = (0 -33.13308963425298) / Math.Sqrt((0.4023147753137173 / (26)) + (37.34147136734801 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.76467359708029 = (2.407110448393128 - 33.13308963425298) / 2.407110448393128 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.68179853814841 > 2.5222863308811765.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.841434516008842 (T) = (0 -29.868740387753718) / Math.Sqrt((0.28565228685366106 / (26)) + (21.04436393799551 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.96324441589582 = (2.4967090322142442 - 29.868740387753718) / 2.4967090322142442 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 112.17995129995383 > 3.3676072585786234.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -74.52546157128228 (T) = (0 -105.78292176018923) / Math.Sqrt((0.7845647575403111 / (27)) + (13.023283705406547 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -30.66991278475414 = (3.3401709211877906 - 105.78292176018923) / 3.3401709211877906 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.55171131264762 > 3.508927677271015.
IsChangePoint: Marked as a change because one of 3/1/2023 10:00:31 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -70.26737307722254 (T) = (0 -49.951207394399844) / Math.Sqrt((1.3034879587953982 / (26)) + (3.1050458433318346 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.549892049389072 = (3.433098144291539 - 49.951207394399844) / 3.433098144291539 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 89.48222574216291 > 2.6940285460336075.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.10038230274548 (T) = (0 -97.28292151698489) / Math.Sqrt((1.047859930713201 / (27)) + (61.34986225611234 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -36.2464904753329 = (2.6118681324194046 - 97.28292151698489) / 2.6118681324194046 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 185.41200749043182 > 3.401595422041653.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -68.78721120980529 (T) = (0 -187.80896456051863) / Math.Sqrt((1.1481680182374805 / (25)) + (56.96037630705839 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -50.171814207760676 = (3.6701642782880985 - 187.80896456051863) / 3.6701642782880985 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 108.39438042247487 > 17.693074606714315.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -85.11100715543401 (T) = (0 -106.93699045832567) / Math.Sqrt((2.7340663169170876 / (27)) + (8.085132223934599 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.2208338926058175 = (17.19013757712333 - 106.93699045832567) / 17.19013757712333 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.13336288011361 > 3.6344735647013997.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -99.48506142246958 (T) = (0 -49.413763245024434) / Math.Sqrt((0.9518450838620802 / (27)) + (1.2397545330570865 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -12.84765966927807 = (3.5683837143002637 - 49.413763245024434) / 3.5683837143002637 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.843674272237564 > 3.3667913757156596.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -56.53652088656592 (T) = (0 -43.58383498052565) / Math.Sqrt((1.7707076067570382 / (26)) + (3.467348676021644 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.292200607171665 = (3.545649503563865 - 43.58383498052565) / 3.545649503563865 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 125.8771629898769 > 3.553125069449709.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -209.46651856622 (T) = (0 -127.52407281658506) / Math.Sqrt((0.4924705714373331 / (27)) + (2.3358008558528423 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -38.098566383248524 = (3.2616048262890214 - 127.52407281658506) / 3.2616048262890214 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTime

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	97.94 ns	158.89 ns	1.62	0.31	True
ToString - Duration of single invocation	182.58 ns	207.96 ns	1.14	0.25	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_DateTime.ToString(format: "r")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 158.8877766170686 > 93.47846008036448.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.09173478396038 (T) = (0 -156.06823580903028) / Math.Sqrt((21.693386545630844 / (27)) + (10.738721815824288 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.6530907133353432 = (94.40996464987735 - 156.06823580903028) / 94.40996464987735 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Tests.Perf_DateTime.ToString(format: "o")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 207.9577943703589 > 185.47309012336618.
IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/11/2023 10:53:42 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.825389769144952 (T) = (0 -203.89220046841052) / Math.Sqrt((639.4567664630825 / (27)) + (29.49733343171094 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3370975765109137 = (152.48864708920988 - 203.89220046841052) / 152.48864708920988 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
NegateBenchmark - Duration of single invocation	3.26 ns	21.05 ns	6.45	0.60	False
BitwiseOrBenchmark - Duration of single invocation	3.28 ns	52.57 ns	16.03	0.55	True
SquareRootBenchmark - Duration of single invocation	23.33 ns	35.38 ns	1.52	0.52	False
LessThanOrEqualAnyBenchmark - Duration of single invocation	3.63 ns	21.07 ns	5.81	0.69	False
MaxBenchmark - Duration of single invocation	3.35 ns	31.70 ns	9.47	0.59	False
LessThanAllBenchmark - Duration of single invocation	1.81 ns	25.92 ns	14.30	0.62	False
AddBenchmark - Duration of single invocation	3.79 ns	32.24 ns	8.50	0.61	False
GreaterThanAllBenchmark - Duration of single invocation	3.61 ns	22.18 ns	6.14	0.70	False
LessThanOrEqualAllBenchmark - Duration of single invocation	3.16 ns	26.37 ns	8.35	0.72	False
DivideBenchmark - Duration of single invocation	21.71 ns	43.88 ns	2.02	0.47	False
AbsBenchmark - Duration of single invocation	4.23 ns	16.61 ns	3.92	0.60	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.99 ns	22.95 ns	7.68	0.68	False
XorBenchmark - Duration of single invocation	3.28 ns	52.40 ns	15.98	0.63	True
MinBenchmark - Duration of single invocation	4.55 ns	25.82 ns	5.67	0.66	False
EqualityOperatorBenchmark - Duration of single invocation	2.23 ns	21.98 ns	9.87	0.67	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.39 ns	51.95 ns	15.31	0.62	True
LessThanOrEqualBenchmark - Duration of single invocation	5.90 ns	40.34 ns	6.84	0.66	False
EqualsAllBenchmark - Duration of single invocation	2.57 ns	27.10 ns	10.54	0.63	False
OnesComplementOperatorBenchmark - Duration of single invocation	4.36 ns	44.07 ns	10.11	0.66	True
MultiplyBenchmark - Duration of single invocation	3.45 ns	30.50 ns	8.84	0.62	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.68 ns	54.76 ns	14.87	0.58	True
BitwiseAndBenchmark - Duration of single invocation	2.08 ns	52.40 ns	25.16	0.58	True
EqualsStaticBenchmark - Duration of single invocation	3.15 ns	26.71 ns	8.47	0.55	False
GreaterThanAnyBenchmark - Duration of single invocation	3.23 ns	25.61 ns	7.92	0.69	False
ConditionalSelectBenchmark - Duration of single invocation	3.45 ns	183.93 ns	53.33	0.59	True
GreaterThanBenchmark - Duration of single invocation	5.49 ns	30.29 ns	5.52	0.59	False
DivisionOperatorBenchmark - Duration of single invocation	23.36 ns	31.41 ns	1.34	0.43	False
CountBenchmark - Duration of single invocation	0.00 ns	15.28 ns	∞	0.87	True
AddOperatorBenchmark - Duration of single invocation	3.15 ns	28.07 ns	8.90	0.59	False
LessThanAnyBenchmark - Duration of single invocation	2.67 ns	20.07 ns	7.52	0.71	False
ZeroBenchmark - Duration of single invocation	1.98 ns	16.99 ns	8.57	0.67	True
OneBenchmark - Duration of single invocation	3.10 ns	23.82 ns	7.68	0.66	False
SubtractBenchmark - Duration of single invocation	3.24 ns	31.15 ns	9.61	0.60	False
DotBenchmark - Duration of single invocation	2.46 ns	33.60 ns	13.68	0.84	False
SubtractionOperatorBenchmark - Duration of single invocation	4.95 ns	21.65 ns	4.37	0.61	False
InequalityOperatorBenchmark - Duration of single invocation	2.47 ns	17.49 ns	7.09	0.66	False
EqualsAnyBenchmark - Duration of single invocation	2.79 ns	23.02 ns	8.26	0.67	False
MultiplyOperatorBenchmark - Duration of single invocation	3.45 ns	27.72 ns	8.02	0.63	False
OnesComplementBenchmark - Duration of single invocation	1.65 ns	46.01 ns	27.90	0.66	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	3.62 ns	19.90 ns	5.49	0.69	False
GreaterThanOrEqualBenchmark - Duration of single invocation	6.64 ns	25.50 ns	3.84	0.58	False
AndNotBenchmark - Duration of single invocation	3.32 ns	86.94 ns	26.21	0.61	True
ExclusiveOrOperatorBenchmark - Duration of single invocation	4.32 ns	52.18 ns	12.07	0.62	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt64>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<UInt64>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.04538060088418 > 3.5164838653222645.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.818327123987222 (T) = (0 -24.4545556218252) / Math.Sqrt((1.9510074376565198 / (27)) + (28.84881948240314 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.59859395035013 = (3.7060252238323605 - 24.4545556218252) / 3.7060252238323605 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.56968811151159 > 3.499317533475936.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -83.03654360857122 (T) = (0 -53.431712580313786) / Math.Sqrt((1.3079909300952532 / (27)) + (2.508776240204137 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.40375852322296 = (3.468745144229524 - 53.431712580313786) / 3.468745144229524 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.382492475410444 > 24.493605430006415.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.774045960971446 (T) = (0 -34.72794852870636) / Math.Sqrt((2.610404658437462 / (27)) + (1.9272734871326713 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.4579479114985339 = (23.819745722610666 - 34.72794852870636) / 23.819745722610666 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.068269465036494 > 3.7492391205260773.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.018413478851354 (T) = (0 -20.450492736055274) / Math.Sqrt((1.04118969149487 / (26)) + (5.954899414870542 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -4.6704722689882 = (3.6064884485722595 - 20.450492736055274) / 3.6064884485722595 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.697482182898533 > 4.593741171759357.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.821792760035365 (T) = (0 -28.37919059305802) / Math.Sqrt((0.4035247501402256 / (27)) + (7.218288981437428 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.1602655299014355 = (4.606812880923347 - 28.37919059305802) / 4.606812880923347 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.922045705859947 > 3.539171624629349.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.493199433808243 (T) = (0 -26.658816557080502) / Math.Sqrt((0.7980428801576789 / (27)) + (11.124718341580424 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.77499983153589 = (3.428786769737365 - 26.658816557080502) / 3.428786769737365 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.24439329914966 > 3.738308410533722.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -54.47138991149975 (T) = (0 -31.600765584641838) / Math.Sqrt((0.7087928900950935 / (26)) + (1.9070899452900103 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.96306683229907 = (3.5256643932148486 - 31.600765584641838) / 3.5256643932148486 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.184462884906868 > 3.7008846994610907.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -29.286425716953207 (T) = (0 -20.81799202110535) / Math.Sqrt((0.2826239840288546 / (26)) + (2.7096784336366206 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -4.944076777400975 = (3.5023087353538425 - 20.81799202110535) / 3.5023087353538425 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.374328583954547 > 3.367006670734896.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.93684638506382 (T) = (0 -25.14631807198304) / Math.Sqrt((0.47337743068761917 / (27)) + (9.263257050019893 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.121083152757829 = (3.5312490435172714 - 25.14631807198304) / 3.5312490435172714 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.879187933146504 > 23.090877144506592.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.72845613686603 (T) = (0 -43.17921156278053) / Math.Sqrt((2.799439170974479 / (25)) + (1.8991287629578448 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.9061886637581658 = (22.65211853565959 - 43.17921156278053) / 22.65211853565959 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.606602383357046 > 4.50646459365735.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -12.465647906523674 (T) = (0 -14.105420388546067) / Math.Sqrt((0.9997556617163728 / (27)) + (4.936994199143056 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -2.5059816083297135 = (4.0232442620445 - 14.105420388546067) / 4.0232442620445 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.953132401085945 > 3.725273965257384.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.667125438290974 (T) = (0 -25.138819471746984) / Math.Sqrt((0.2224837019270973 / (26)) + (3.1904700639042516 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.8860199454327855 = (3.6507038421258904 - 25.138819471746984) / 3.6507038421258904 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.39512057860976 > 3.617909053802808.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -4.966528605798002 (T) = (0 -65.11927205098425) / Math.Sqrt((0.5553576837410903 / (27)) + (1231.6363397709963 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.65211787633465 = (3.4912535124821398 - 65.11927205098425) / 3.4912535124821398 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.82191347663817 > 4.7828702290099026.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.76925390289039 (T) = (0 -27.270185574692277) / Math.Sqrt((0.3325955690796811 / (27)) + (1.798560042928622 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -4.982413835048281 = (4.558391700508661 - 27.270185574692277) / 4.558391700508661 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.976740676270843 > 2.624952625414413.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.040333616113465 (T) = (0 -19.024970549840383) / Math.Sqrt((0.7285013447458814 / (27)) + (8.01621555738851 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.909007738494101 = (2.7536473065214855 - 19.024970549840383) / 2.7536473065214855 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.94735259206981 > 3.4118951481095854.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -98.2928915031341 (T) = (0 -53.47153572811909) / Math.Sqrt((2.5918647558931536 / (27)) + (1.29426161539076 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.992916253183907 = (3.566453305357711 - 53.47153572811909) / 3.566453305357711 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.33679179578075 > 4.947794589718535.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.09316616569522 (T) = (0 -34.7767886277395) / Math.Sqrt((1.042348104793617 / (27)) + (9.719372557478579 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.827316437865778 = (4.443002771614259 - 34.7767886277395) / 4.443002771614259 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.098625721908455 > 2.5009043914399434.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.636888053738314 (T) = (0 -29.064500409489636) / Math.Sqrt((0.5119937028014451 / (25)) + (11.94401148289947 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -10.882379692349225 = (2.4460168048832474 - 29.064500409489636) / 2.4460168048832474 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.07427175868631 > 4.7431756717292535.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.814095014114685 (T) = (0 -42.297145649193936) / Math.Sqrt((0.8105067965491443 / (27)) + (6.550186322825094 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.008677370681985 = (4.695156004459277 - 42.297145649193936) / 4.695156004459277 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.498285619967866 > 3.464588508982903.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.995441196935303 (T) = (0 -34.47603547266111) / Math.Sqrt((0.2691031645060648 / (27)) + (9.805964555694498 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.274254784605263 = (3.3555752894428226 - 34.47603547266111) / 3.3555752894428226 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.7577116091098 > 3.516656168507887.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -99.96561530593459 (T) = (0 -53.56471023663777) / Math.Sqrt((0.3362027623144849 / (27)) + (1.9087668431679279 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.40425496899455 = (3.4772671800390222 - 53.56471023663777) / 3.4772671800390222 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.4031978296344 > 3.530120303660992.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -87.54043525338953 (T) = (0 -53.37374324518788) / Math.Sqrt((1.241580867758733 / (27)) + (2.232053685785991 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.387276236036339 = (3.4686933818857995 - 53.37374324518788) / 3.4686933818857995 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.711082776216063 > 3.570827528926523.
IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.28230181321735 (T) = (0 -27.533933440420753) / Math.Sqrt((0.8283381684452586 / (26)) + (3.050533392003105 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.714025479092023 = (3.5693340027263725 - 27.533933440420753) / 3.5693340027263725 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.610721420417477 > 3.4143949746742526.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.228516070888768 (T) = (0 -25.25590967946473) / Math.Sqrt((0.8101483955786782 / (27)) + (18.999217524928984 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.9155713152047396 = (3.1906616305700575 - 25.25590967946473) / 3.1906616305700575 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 183.92809394155807 > 4.023450920795743.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -169.92871756663794 (T) = (0 -177.07926655382096) / Math.Sqrt((1.7188389412015184 / (26)) + (7.751175702652821 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -41.1430941290704 = (4.201857272545902 - 177.07926655382096) / 4.201857272545902 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.287645647434164 > 4.872033689598612.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.89458309613313 (T) = (0 -27.701710709040636) / Math.Sqrt((0.7251855779930336 / (26)) + (5.768421931168665 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.257850005079155 = (4.426713757369811 - 27.701710709040636) / 4.426713757369811 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.41003550683051 > 23.271965786826794.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.788437927655774 (T) = (0 -32.65831231100015) / Math.Sqrt((1.8992979828473002 / (26)) + (6.952949407747014 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.4719919265514034 = (22.186475157857934 - 32.65831231100015) / 22.186475157857934 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.280259456904497 > 0.009174939708230528.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.64564612714356 (T) = (0 -14.582858059903021) / Math.Sqrt((0.6647107991460123 / (27)) + (0.6594581749983028 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -47.19512077125823 = (0.3025795521732501 - 14.582858059903021) / 0.3025795521732501 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.070355077493925 > 3.397077170276226.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.00997526886975 (T) = (0 -24.87682838593425) / Math.Sqrt((0.32842140158608274 / (27)) + (3.98952845473433 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.258081251717096 = (3.427466230148493 - 24.87682838593425) / 3.427466230148493 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.069347470924985 > 3.3843220918330514.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.479976016031433 (T) = (0 -19.767057754691063) / Math.Sqrt((1.3122826805659211 / (27)) + (2.44607129323717 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -4.799014934862399 = (3.4086923342541975 - 19.767057754691063) / 3.4086923342541975 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.988186140402632 > 2.1749844960357962.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.799647175468685 (T) = (0 -16.62809936045695) / Math.Sqrt((0.3910529050852123 / (26)) + (1.519404976838316 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.451913242999278 = (2.231386600760317 - 16.62809936045695) / 2.231386600760317 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.81631550786176 > 2.0794040720773186.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.939541079064156 (T) = (0 -23.825699332633057) / Math.Sqrt((0.265084594366725 / (27)) + (2.2739677551854505 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -11.690762955425482 = (1.877404803502947 - 23.825699332633057) / 1.877404803502947 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.15305701535152 > 3.4183241516805656.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.39990500488604 (T) = (0 -31.834989572940497) / Math.Sqrt((0.32297712380223753 / (27)) + (12.840228871318072 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -8.49998299231362 = (3.351057533334322 - 31.834989572940497) / 3.351057533334322 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.604043926417994 > 2.710181627663014.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.159469077429996 (T) = (0 -34.569787990043324) / Math.Sqrt((3.0254145881587164 / (25)) + (7.689609373595808 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -9.820018669522684 = (3.1949841350475547 - 34.569787990043324) / 3.1949841350475547 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.648294965423272 > 3.718479620864091.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.79024792790853 (T) = (0 -24.970002253152128) / Math.Sqrt((1.3834847226885958 / (27)) + (9.693406278608359 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.479640421167097 = (3.8536092483747106 - 24.970002253152128) / 3.8536092483747106 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.490053722626538 > 2.7420750704575245.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.6080332774641 (T) = (0 -19.84403716891751) / Math.Sqrt((0.6807802029424036 / (27)) + (4.930537218778739 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.822025495603717 = (2.5369435551022725 - 19.84403716891751) / 2.5369435551022725 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.02124852293334 > 2.623133661720953.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.755167842975197 (T) = (0 -26.0068111451933) / Math.Sqrt((0.13644197512497633 / (27)) + (9.357234965157044 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.71251423925662 = (2.427703764433736 - 26.0068111451933) / 2.427703764433736 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.715119388955276 > 3.543401846067771.
IsChangePoint: Marked as a change because one of 1/27/2023 12:48:15 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.34711523323791 (T) = (0 -24.880383670807667) / Math.Sqrt((0.8355613351702835 / (27)) + (5.4707871151927305 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.210609935843413 = (3.450524143197527 - 24.880383670807667) / 3.450524143197527 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.00567326099863 > 2.7558378982915945.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.48049968596587 (T) = (0 -40.769505218552574) / Math.Sqrt((0.6237454750108894 / (27)) + (10.067603644600366 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.216871800331244 = (2.8676846630636894 - 40.769505218552574) / 2.8676846630636894 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.896736280599548 > 3.634271374034907.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.497898724522695 (T) = (0 -19.845230276389) / Math.Sqrt((0.8124181907173805 / (27)) + (2.571210075212192 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -4.26212745772847 = (3.7713321153485886 - 19.845230276389) / 3.7713321153485886 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.50229466729008 > 5.421547862449076.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.19596809559153 (T) = (0 -27.64049153566316) / Math.Sqrt((0.6824700905412466 / (27)) + (15.579185733381081 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -4.649056669426311 = (4.892939326535414 - 27.64049153566316) / 4.892939326535414 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 86.93607974484628 > 3.443405245319692.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -74.9096893405359 (T) = (0 -87.39980344726624) / Math.Sqrt((0.8681664104449756 / (26)) + (9.785193931100855 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -24.48539251873437 = (3.4294077826354235 - 87.39980344726624) / 3.4294077826354235 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<UInt64>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.17570595922009 > 3.475827292162546.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -122.28977741584754 (T) = (0 -52.72255751347183) / Math.Sqrt((1.8574722756894393 / (27)) + (0.6407990389547977 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -13.040597901068034 = (3.755008004998231 - 52.72255751347183) / 3.755008004998231 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
BitwiseOrBenchmark - Duration of single invocation	3.47 ns	50.13 ns	14.46	0.57	True
LessThanAllBenchmark - Duration of single invocation	2.26 ns	27.17 ns	12.00	0.70	False
OnesComplementBenchmark - Duration of single invocation	3.20 ns	42.62 ns	13.31	0.59	True
MaxBenchmark - Duration of single invocation	3.20 ns	41.85 ns	13.07	0.57	False
MultiplyOperatorBenchmark - Duration of single invocation	6.25 ns	27.49 ns	4.40	0.69	False
OnesComplementOperatorBenchmark - Duration of single invocation	5.79 ns	42.13 ns	7.28	0.59	True
DivisionOperatorBenchmark - Duration of single invocation	25.14 ns	33.78 ns	1.34	0.44	False
AddBenchmark - Duration of single invocation	2.99 ns	37.64 ns	12.57	0.61	False
AllBitsSetBenchmark - Duration of single invocation	1.92 ns	29.54 ns	15.37	0.66	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.36 ns	39.19 ns	16.59	0.64	False
AbsBenchmark - Duration of single invocation	3.43 ns	44.97 ns	13.12	0.60	False
ConditionalSelectBenchmark - Duration of single invocation	2.54 ns	55.45 ns	21.87	0.59	False
EqualityOperatorBenchmark - Duration of single invocation	3.47 ns	16.06 ns	4.63	0.69	False
LessThanBenchmark - Duration of single invocation	2.85 ns	40.53 ns	14.21	0.64	False
UnaryNegateOperatorBenchmark - Duration of single invocation	15.89 ns	20.90 ns	1.32	0.53	False
GreaterThanAnyBenchmark - Duration of single invocation	2.69 ns	32.64 ns	12.13	0.69	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.15 ns	47.38 ns	15.06	0.58	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.33 ns	51.88 ns	15.58	0.66	False
GreaterThanBenchmark - Duration of single invocation	4.04 ns	53.25 ns	13.20	0.69	False
EqualsAllBenchmark - Duration of single invocation	2.45 ns	31.49 ns	12.83	0.67	False
SquareRootBenchmark - Duration of single invocation	22.05 ns	41.08 ns	1.86	0.66	False
LessThanAnyBenchmark - Duration of single invocation	2.26 ns	37.07 ns	16.44	0.63	False
GreaterThanAllBenchmark - Duration of single invocation	2.60 ns	39.38 ns	15.17	0.71	False
ZeroBenchmark - Duration of single invocation	2.03 ns	16.11 ns	7.93	0.65	True
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.38 ns	47.28 ns	19.85	0.64	False
BitwiseAndOperatorBenchmark - Duration of single invocation	4.20 ns	48.90 ns	11.64	0.62	True
AddOperatorBenchmark - Duration of single invocation	3.74 ns	24.39 ns	6.53	0.66	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.58 ns	32.42 ns	12.58	0.69	False
BitwiseAndBenchmark - Duration of single invocation	3.27 ns	48.96 ns	14.96	0.58	True
EqualsStaticBenchmark - Duration of single invocation	3.59 ns	41.21 ns	11.47	0.60	False
DivideBenchmark - Duration of single invocation	24.90 ns	42.00 ns	1.69	0.47	False
LessThanOrEqualBenchmark - Duration of single invocation	3.18 ns	40.09 ns	12.59	0.65	False
NegateBenchmark - Duration of single invocation	17.76 ns	43.53 ns	2.45	0.61	False
MultiplyBenchmark - Duration of single invocation	3.30 ns	34.13 ns	10.35	0.65	False
DotBenchmark - Duration of single invocation	2.56 ns	43.55 ns	17.04	0.86	False
SubtractionOperatorBenchmark - Duration of single invocation	3.30 ns	24.26 ns	7.36	0.61	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	3.60 ns	24.97 ns	6.94	0.63	False
MinBenchmark - Duration of single invocation	3.33 ns	47.09 ns	14.13	0.65	False
CountBenchmark - Duration of single invocation	0.20 ns	15.34 ns	76.60	0.93	True
SubtractBenchmark - Duration of single invocation	4.03 ns	39.19 ns	9.72	0.58	False
SumBenchmark - Duration of single invocation	2.06 ns	29.37 ns	14.24	0.85	False
XorBenchmark - Duration of single invocation	3.49 ns	50.94 ns	14.58	0.61	True
AndNotBenchmark - Duration of single invocation	3.70 ns	56.13 ns	15.19	0.59	True
BitwiseOrOperatorBenchmark - Duration of single invocation	3.42 ns	48.77 ns	14.24	0.60	True
InequalityOperatorBenchmark - Duration of single invocation	2.34 ns	17.14 ns	7.33	0.66	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.12999802951454 > 3.5794213085191093.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -70.70126857899228 (T) = (0 -50.019110987354765) / Math.Sqrt((1.5657482518239199 / (26)) + (2.952061934715179 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.523135195901846 = (3.6987806645986163 - 50.019110987354765) / 3.6987806645986163 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.16718687495359 > 2.4877624998514.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -47.13776211321604 (T) = (0 -28.71244089425404) / Math.Sqrt((0.5250230741030026 / (27)) + (2.333824213008819 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.876302436194006 = (2.4176245972610566 - 28.71244089425404) / 2.4176245972610566 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.62007901408708 > 3.338024121409472.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.123022840187765 (T) = (0 -44.836753151138836) / Math.Sqrt((1.6355144034301405 / (27)) + (6.530326411597942 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.739622047836177 = (3.519472789913289 - 44.836753151138836) / 3.519472789913289 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.84537926023117 > 3.3605961706536025.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.493978462085245 (T) = (0 -45.48863481188104) / Math.Sqrt((0.6018259417356361 / (27)) + (11.211258555198214 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.497666853433469 = (3.137652097524093 - 45.48863481188104) / 3.137652097524093 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.48579721289122 > 3.922973052333962.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.701896861265606 (T) = (0 -24.027995905551418) / Math.Sqrt((0.9339635099494866 / (26)) + (5.578355741759146 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.437462545728391 = (3.7325259346938346 - 24.027995905551418) / 3.7325259346938346 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.131643933815326 > 5.983535919318814.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.13835058423438 (T) = (0 -43.44201145646354) / Math.Sqrt((0.9407942225457743 / (27)) + (6.010612994638619 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.145649302609398 = (6.079505110977066 - 43.44201145646354) / 6.079505110977066 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.78278232838715 > 27.239846220386685.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -6.853810321997231 (T) = (0 -34.94200829272364) / Math.Sqrt((3.272602967056485 / (27)) + (12.434751431872964 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3403033300298178 = (26.070224187196704 - 34.94200829272364) / 26.070224187196704 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.63870685200822 > 3.795452760198132.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.904718794836477 (T) = (0 -33.51511657365711) / Math.Sqrt((0.42717314901247866 / (26)) + (20.083406658628263 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.675229421997257 = (3.4640125946221323 - 33.51511657365711) / 3.4640125946221323 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.54460320562105 > 2.0449422108781747.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -168.65923126043754 (T) = (0 -29.54514986543962) / Math.Sqrt((0.11572082012084219 / (26)) + (0.17726636029296414 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.533076819459605 = (2.0329590376814797 - 29.54514986543962) / 2.0329590376814797 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.18600611120766 > 2.468514702880272.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.167128393560525 (T) = (0 -41.43272364285268) / Math.Sqrt((0.20857891698930375 / (27)) + (16.611687535851512 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.728119170377003 = (2.212326996956984 - 41.43272364285268) / 2.212326996956984 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.97476915037972 > 3.590433714853235.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.66085252301681 (T) = (0 -42.96158346615737) / Math.Sqrt((1.2082184718743378 / (25)) + (5.873319645011386 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -11.43394347967083 = (3.4551856807454873 - 42.96158346615737) / 3.4551856807454873 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.44602007068302 > 3.4182395705152446.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -77.954238627989 (T) = (0 -53.139165079309166) / Math.Sqrt((0.33639751429372994 / (26)) + (3.137762627112726 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.097756873839801 = (3.5196728575875076 - 53.139165079309166) / 3.5196728575875076 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.058914061497994 > 2.5551839883249294.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.818237944627917 (T) = (0 -19.43056506790393) / Math.Sqrt((0.3661953947514763 / (27)) + (8.305877376681517 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.903893281859134 = (2.182254936443581 - 19.43056506790393) / 2.182254936443581 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.531345596015285 > 3.3212206137157656.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.598248502388525 (T) = (0 -45.199791404419095) / Math.Sqrt((0.54522671638707 / (27)) + (21.201225194087193 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.415614132260382 = (3.369192864285478 - 45.199791404419095) / 3.369192864285478 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.UnaryNegateOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.904477032190275 > 15.97488980767301.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -8.342248279054107 (T) = (0 -22.29660591530632) / Math.Sqrt((1.8573938137254393 / (25)) + (6.243709485743827 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.5288475322897023 = (14.583930342559052 - 22.29660591530632) / 14.583930342559052 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.64053009850288 > 2.720747620320969.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.433910925787984 (T) = (0 -30.16792813091113) / Math.Sqrt((0.7706415808425159 / (27)) + (10.001471739453857 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.8870987247907 = (2.5378714208872113 - 30.16792813091113) / 2.5378714208872113 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.376314261642506 > 3.578880868603398.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -60.12742949718879 (T) = (0 -49.32292391796594) / Math.Sqrt((2.4413508995783535 / (26)) + (3.862612361005762 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.473569076922308 = (3.6607170406278495 - 49.32292391796594) / 3.6607170406278495 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.877248166938735 > 3.4062616277998203.
IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -43.233297975442255 (T) = (0 -51.11821933874405) / Math.Sqrt((1.1043840362384871 / (27)) + (7.057260869654743 / (6))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (6) - 2, .025) and -13.938067347094266 = (3.422010234053972 - 51.11821933874405) / 3.422010234053972 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.25465237172954 > 3.6433403161733215.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -74.43306550900303 (T) = (0 -50.35532889565774) / Math.Sqrt((0.2797560974155464 / (27)) + (3.0921986370984453 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.539633683204842 = (3.463314825725263 - 50.35532889565774) / 3.463314825725263 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.49053147942781 > 2.4228533834314185.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.321766845744257 (T) = (0 -30.072167505729375) / Math.Sqrt((0.5232050178656746 / (26)) + (18.32658265315586 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.54729803775236 = (2.219790796801475 - 30.072167505729375) / 2.219790796801475 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.083900069267436 > 23.198082305001517.
IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.190940686038589 (T) = (0 -40.345648056871454) / Math.Sqrt((10.18065209568889 / (26)) + (9.103360232668226 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.7699041005672953 = (22.795386509325414 - 40.345648056871454) / 22.795386509325414 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 37.06699089554201 > 2.8317344133008278.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.353506919091764 (T) = (0 -40.95230218855105) / Math.Sqrt((0.9864779807825327 / (27)) + (7.640559978681322 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.837253369680232 = (2.760099943580976 - 40.95230218855105) / 2.760099943580976 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.384973006181845 > 2.460232780598252.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.99896913255937 (T) = (0 -38.27300982932525) / Math.Sqrt((0.24845503954916076 / (27)) + (7.029837395338696 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.516929924744197 = (2.466532362712606 - 38.27300982932525) / 2.466532362712606 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.108030492942685 > 2.0986403346978584.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -88.6672383305119 (T) = (0 -16.554483725867097) / Math.Sqrt((0.4977138078293297 / (27)) + (0.0665968212872163 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.074221697265033 = (2.050288479380566 - 16.554483725867097) / 2.050288479380566 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.2793054027821 > 2.584663570657655.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.357036042325902 (T) = (0 -41.92414839700668) / Math.Sqrt((0.7811189455680473 / (26)) + (16.062557764840452 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.60283826477904 = (2.870958894211998 - 41.92414839700668) / 2.870958894211998 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.90069920745956 > 3.6771540298999414.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -72.187129002379 (T) = (0 -49.23126058747885) / Math.Sqrt((0.41194637313361887 / (27)) + (3.104869458439399 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.546428998919488 = (3.3844224304903805 - 49.23126058747885) / 3.3844224304903805 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.39242804916422 > 3.858081779984853.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.955175144628083 (T) = (0 -24.51771184502938) / Math.Sqrt((0.6205972490439122 / (27)) + (8.556692348050172 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.700045150552604 = (3.6593353170175593 - 24.51771184502938) / 3.6593353170175593 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.420087324895704 > 2.7116819052347068.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.93260072535919 (T) = (0 -29.637322808043898) / Math.Sqrt((0.5559739230817639 / (26)) + (13.386920678927499 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.417507161801197 = (2.3867369208543234 - 29.637322808043898) / 2.3867369208543234 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.96170723397807 > 3.532211748223351.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -95.80401882434252 (T) = (0 -49.6216608845277) / Math.Sqrt((0.3705468714451017 / (27)) + (1.7520464682481673 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.57824596029444 = (3.4038155906875285 - 49.6216608845277) / 3.4038155906875285 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.211119796547095 > 3.671099576627597.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.82411878019866 (T) = (0 -41.91104752740193) / Math.Sqrt((0.7009026017424123 / (27)) + (4.649533000171908 / (6))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (6) - 2, .025) and -10.684495879129287 = (3.5868939456996998 - 41.91104752740193) / 3.5868939456996998 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.00495776283271 > 26.91969200586609.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.317654490361887 (T) = (0 -46.191473273758795) / Math.Sqrt((4.602644145109631 / (27)) + (12.990510493106914 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.7991992916880597 = (25.673350076978213 - 46.191473273758795) / 25.673350076978213 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.08578884210661 > 3.9059311491385738.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.196151138858205 (T) = (0 -45.339441933248665) / Math.Sqrt((0.6896026322018923 / (27)) + (25.446029429865302 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.918526402529448 = (3.804114737173075 - 45.339441933248665) / 3.804114737173075 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.527683795635184 > 16.881967479298822.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.80916015898658 (T) = (0 -34.74619864368263) / Math.Sqrt((5.705935003995226 / (26)) + (27.59433293230781 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -1.1773870873296046 = (15.957749931499839 - 34.74619864368263) / 15.957749931499839 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.133270907407194 > 3.636721309020443.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.40020428565866 (T) = (0 -35.013110961197945) / Math.Sqrt((0.7918663234865836 / (26)) + (6.867387317791958 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.937710881329581 = (3.523257154419599 - 35.013110961197945) / 3.523257154419599 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.54693706474078 > 3.290770154533766.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.024985762158042 (T) = (0 -45.50788432901439) / Math.Sqrt((3.3363652229143566 / (27)) + (18.493098962487064 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.645567172347238 = (3.334993976742585 - 45.50788432901439) / 3.334993976742585 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.257251507565215 > 3.50227894828125.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.87895790027007 (T) = (0 -23.641112821460034) / Math.Sqrt((0.390445946820238 / (26)) + (2.159172584752186 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.907871680100732 = (3.4223439456123907 - 23.641112821460034) / 3.4223439456123907 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.966382322846446 > 2.5696671491122816.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.331431673165802 (T) = (0 -29.99316884083436) / Math.Sqrt((0.40893095813522107 / (27)) + (17.8566075226576 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.935183837334732 = (2.5130043449361894 - 29.99316884083436) / 2.5130043449361894 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.09449603782794 > 3.493983009509482.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.28353909477556 (T) = (0 -42.58080887037566) / Math.Sqrt((0.6880428158407197 / (26)) + (4.805617058825082 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.99014800530222 = (3.5513163683672464 - 42.58080887037566) / 3.5513163683672464 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.335699825673514 > 0.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -52.76511022925072 (T) = (0 -15.402127761162554) / Math.Sqrt((0.3379074728431819 / (27)) + (0.41717349474136495 / (6))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (6) - 2, .025) and -52.396976653713004 = (0.2884456897447124 - 15.402127761162554) / 0.2884456897447124 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.192951297632526 > 3.742587634386362.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.89203954435064 (T) = (0 -34.261759216968045) / Math.Sqrt((2.095686722375073 / (25)) + (11.250229406819722 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -7.839302483714062 = (3.876070456927285 - 34.261759216968045) / 3.876070456927285 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.37357951453873 > 1.9073961109667026.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.025916217663728 (T) = (0 -25.410384335003258) / Math.Sqrt((2.641644016208942 / (25)) + (8.745671288353007 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -9.638862301119673 = (2.388449405189592 - 25.410384335003258) / 2.388449405189592 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.94153962694589 > 3.595743124196203.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -107.66535744566201 (T) = (0 -49.02824507552952) / Math.Sqrt((0.650194075462937 / (26)) + (1.2337790460397715 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.221274605634502 = (3.447528188233171 - 49.02824507552952) / 3.447528188233171 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.12934500215432 > 3.5533817247325654.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.041344829904354 (T) = (0 -49.813376319152304) / Math.Sqrt((0.5716134033334025 / (25)) + (7.890265178988707 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -12.984959083978449 = (3.5619250667826314 - 49.813376319152304) / 3.5619250667826314 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.770342245618856 > 3.529884442416628.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -89.75175571122989 (T) = (0 -49.18193209088334) / Math.Sqrt((0.39526366772043336 / (26)) + (1.9511495461365462 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.064222659858265 = (3.4969534598778163 - 49.18193209088334) / 3.4969534598778163 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.138258303328353 > 2.663519530749893.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.727480293923286 (T) = (0 -19.439640061872502) / Math.Sqrt((0.7005554050363881 / (26)) + (4.113692331870055 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.145469873594081 = (2.720554477979292 - 19.439640061872502) / 2.720554477979292 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
DotBenchmark - Duration of single invocation	18.53 ns	163.16 ns	8.80	0.33	False
EqualityOperatorBenchmark - Duration of single invocation	6.92 ns	17.04 ns	2.46	0.63	False
GreaterThanBenchmark - Duration of single invocation	3.46 ns	117.25 ns	33.90	0.47	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.62 ns	54.38 ns	15.03	0.55	True
LessThanBenchmark - Duration of single invocation	2.93 ns	166.35 ns	56.82	0.51	False
BitwiseAndBenchmark - Duration of single invocation	3.19 ns	53.96 ns	16.93	0.58	True
OneBenchmark - Duration of single invocation	2.03 ns	28.84 ns	14.21	0.76	False
DivideBenchmark - Duration of single invocation	103.01 ns	126.54 ns	1.23	0.14	False
GreaterThanAnyBenchmark - Duration of single invocation	2.74 ns	101.23 ns	36.96	0.52	False
GreaterThanOrEqualBenchmark - Duration of single invocation	2.61 ns	109.98 ns	42.11	0.42	False
OnesComplementBenchmark - Duration of single invocation	3.90 ns	39.47 ns	10.13	0.61	True
SquareRootBenchmark - Duration of single invocation	104.96 ns	123.46 ns	1.18	0.21	False
MultiplyBenchmark - Duration of single invocation	15.97 ns	104.98 ns	6.57	0.33	False
EqualsAnyBenchmark - Duration of single invocation	1.32 ns	108.95 ns	82.76	0.54	False
AddOperatorBenchmark - Duration of single invocation	3.23 ns	94.99 ns	29.40	0.44	False
CountBenchmark - Duration of single invocation	0.00 ns	15.19 ns	49626.58	0.92	True
OnesComplementOperatorBenchmark - Duration of single invocation	4.51 ns	39.69 ns	8.80	0.65	True
SubtractBenchmark - Duration of single invocation	3.32 ns	101.73 ns	30.68	0.50	False
AndNotBenchmark - Duration of single invocation	2.41 ns	85.93 ns	35.66	0.53	True
ZeroBenchmark - Duration of single invocation	1.97 ns	17.08 ns	8.66	0.59	True
DivisionOperatorBenchmark - Duration of single invocation	102.46 ns	116.54 ns	1.14	0.17	False
InequalityOperatorBenchmark - Duration of single invocation	4.88 ns	17.20 ns	3.52	0.69	False
XorBenchmark - Duration of single invocation	3.33 ns	57.83 ns	17.37	0.63	True
MaxBenchmark - Duration of single invocation	1.15 ns	117.89 ns	102.39	0.41	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.44 ns	100.50 ns	41.19	0.50	False
ConditionalSelectBenchmark - Duration of single invocation	4.53 ns	193.63 ns	42.77	0.57	True
LessThanAnyBenchmark - Duration of single invocation	2.49 ns	31.07 ns	12.46	0.70	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.32 ns	55.64 ns	16.74	0.63	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.49 ns	16.88 ns	6.77	0.64	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	4.80 ns	23.37 ns	4.87	0.68	False
EqualsAllBenchmark - Duration of single invocation	2.14 ns	32.47 ns	15.17	0.69	False
AbsBenchmark - Duration of single invocation	4.43 ns	13.40 ns	3.02	0.53	False
MultiplyOperatorBenchmark - Duration of single invocation	16.17 ns	96.67 ns	5.98	0.32	False
BitwiseOrBenchmark - Duration of single invocation	3.67 ns	53.76 ns	14.65	0.55	True
MinBenchmark - Duration of single invocation	3.96 ns	122.25 ns	30.84	0.42	False
EqualsStaticBenchmark - Duration of single invocation	4.35 ns	116.24 ns	26.74	0.48	False
SubtractionOperatorBenchmark - Duration of single invocation	3.23 ns	106.63 ns	33.00	0.46	False
GreaterThanAllBenchmark - Duration of single invocation	2.58 ns	18.78 ns	7.27	0.66	False
AddBenchmark - Duration of single invocation	4.50 ns	120.45 ns	26.79	0.43	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	2.01 ns	105.33 ns	52.44	0.51	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<Byte>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 163.15829044048445 > 19.923618734509173.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -122.69441268224705 (T) = (0 -162.3969846122798) / Math.Sqrt((1.6787845588758672 / (27)) + (10.390325019480374 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.4313726978337815 = (19.261037369870202 - 162.3969846122798) / 19.261037369870202 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.043255003230705 > 2.4923363965210132.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.93803635439249 (T) = (0 -18.706706948317073) / Math.Sqrt((1.479277010745622 / (27)) + (3.895095036380608 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.305519813758925 = (2.5606264064995905 - 18.706706948317073) / 2.5606264064995905 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 117.2538452561853 > 3.457991801188342.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -98.748790886349 (T) = (0 -114.49426710961383) / Math.Sqrt((0.8012288096022725 / (26)) + (9.892832254809647 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -33.454026291793866 = (3.323102680074394 - 114.49426710961383) / 3.323102680074394 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.37643956815001 > 3.406925277413783.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -120.58423766753306 (T) = (0 -53.44947854992734) / Math.Sqrt((0.7710104657380216 / (27)) + (1.1375688292144805 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.759042439869273 = (3.621473328482465 - 53.44947854992734) / 3.621473328482465 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 166.3540532967347 > 3.836802291074388.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.19413248509457 (T) = (0 -172.92555115968213) / Math.Sqrt((1.213210909772166 / (27)) + (195.41668676016667 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -44.86998965283491 = (3.76990604245743 - 172.92555115968213) / 3.76990604245743 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.961594413539814 > 3.4032174034324516.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -153.8041790070741 (T) = (0 -52.907432048016105) / Math.Sqrt((1.0184953866352207 / (27)) + (0.5255657029739481 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.35279215419105 = (3.446111398933599 - 52.907432048016105) / 3.446111398933599 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.OneBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.8363227284128 > 2.090402099169571.
IsChangePoint: Marked as a change because one of 3/6/2023 8:17:12 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.1185457330371 (T) = (0 -27.16044957827753) / Math.Sqrt((0.1980285649282044 / (26)) + (13.801562887277017 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.62449616548934 = (1.993501209026325 - 27.16044957827753) / 1.993501209026325 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 126.53608608334574 > 108.72157376186601.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.857069681716844 (T) = (0 -124.00600156732406) / Math.Sqrt((4.637066857891628 / (27)) + (3.237891177924918 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.2056370065428483 = (102.85517190859129 - 124.00600156732406) / 102.85517190859129 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.22679731136675 > 2.529177718671103.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -78.8260306777706 (T) = (0 -104.10194899845297) / Math.Sqrt((0.44637762450506685 / (27)) + (13.140459647509905 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -39.513607318530774 = (2.5695551664893865 - 104.10194899845297) / 2.5695551664893865 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 109.98104265675745 > 3.1575943410534624.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -117.57142431620235 (T) = (0 -112.28701990488348) / Math.Sqrt((2.133460760495511 / (26)) + (6.192413144350403 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -31.056615797749387 = (3.5027721146025295 - 112.28701990488348) / 3.5027721146025295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.47440272674937 > 3.407586204146644.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -59.834543279062046 (T) = (0 -40.554382052461676) / Math.Sqrt((1.0048112651211174 / (27)) + (2.4716857188185815 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -11.782208725380933 = (3.17272100023958 - 40.554382052461676) / 3.17272100023958 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 123.46413421383757 > 110.59543637631778.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.362874129253882 (T) = (0 -126.29841907529789) / Math.Sqrt((10.85885918035032 / (27)) + (13.936245270755037 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.18333400721433174 = (106.73099759265352 - 126.29841907529789) / 106.73099759265352 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 104.98137076310931 > 17.058851287933873.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -139.3887232279075 (T) = (0 -103.31951626841656) / Math.Sqrt((1.0756989293267234 / (26)) + (2.77111768497075 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.253706884465901 = (16.52132378078999 - 103.31951626841656) / 16.52132378078999 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 108.94731333484154 > 3.0419512427404434.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -98.33990464371878 (T) = (0 -102.77101321708773) / Math.Sqrt((0.5284614309663965 / (26)) + (8.166814874347988 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -41.34754298696273 = (2.426847131337164 - 102.77101321708773) / 2.426847131337164 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 94.98943015846105 > 3.43945516658032.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -80.67065786522177 (T) = (0 -97.25963122637745) / Math.Sqrt((0.3146131699101041 / (26)) + (10.715133481983084 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -26.972206872091306 = (3.4770095785118853 - 97.25963122637745) / 3.4770095785118853 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.185864398569246 > 0.014524133112387268.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.252318229827807 (T) = (0 -15.758186619605643) / Math.Sqrt((0.15356169769430766 / (26)) + (5.196922116606446 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -91.32291390177267 = (0.17068554223030297 - 15.758186619605643) / 0.17068554223030297 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.69260653940301 > 4.700920572700883.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.7772278669677 (T) = (0 -39.90680324606889) / Math.Sqrt((2.517006673387222 / (27)) + (0.24516395499506372 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -7.158607510257482 = (4.891374317969788 - 39.90680324606889) / 4.891374317969788 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 101.73059403643946 > 3.819291552567518.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -58.0125781282536 (T) = (0 -104.76185849469566) / Math.Sqrt((1.2024356677071752 / (27)) + (23.89520915153972 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -26.891505067287127 = (3.7560489561951536 - 104.76185849469566) / 3.7560489561951536 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.92791526504259 > 3.440378159869971.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.49428797765173 (T) = (0 -88.08973468434289) / Math.Sqrt((0.13817856476067508 / (27)) + (24.389333900628497 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.330222736182787 = (3.34557499064718 - 88.08973468434289) / 3.34557499064718 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.077318907383468 > 2.0763336203120466.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.749586818621804 (T) = (0 -17.16933668801638) / Math.Sqrt((0.35388646123289524 / (27)) + (6.374126939668986 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -7.191897643472578 = (2.095892482457609 - 17.16933668801638) / 2.095892482457609 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 116.54061197677116 > 107.51955629508191.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.85268600987105 (T) = (0 -117.33428181229772) / Math.Sqrt((3.234947689415053 / (27)) + (7.445877503625589 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.13766780912789087 = (103.1358019194051 - 117.33428181229772) / 103.1358019194051 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.197619671415488 > 2.6695674474003583.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.799143849561222 (T) = (0 -18.144335475180004) / Math.Sqrt((2.108337945962263 / (26)) + (1.6142567338193587 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -5.4175366401902805 = (2.827305318609295 - 18.144335475180004) / 2.827305318609295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.82634852085692 > 3.7385459719446734.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.39635951338463 (T) = (0 -54.92281360626749) / Math.Sqrt((0.5998164754856764 / (27)) + (7.247648485040161 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.782979538123245 = (3.47987612057681 - 54.92281360626749) / 3.47987612057681 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 117.8928606460322 > 3.405737115065988.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -145.57314583063882 (T) = (0 -119.85609619930511) / Math.Sqrt((0.5119889907764787 / (27)) + (4.984311815302692 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -36.27313875665623 = (3.215615861647853 - 119.85609619930511) / 3.215615861647853 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 100.49808457210816 > 2.551566903841227.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -70.98472165399956 (T) = (0 -103.25425004513984) / Math.Sqrt((0.2830347358410176 / (27)) + (16.089290371862827 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -43.41125137697096 = (2.3249570062482268 - 103.25425004513984) / 2.3249570062482268 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 193.62661664867207 > 3.7063435376087317.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -75.51672179695453 (T) = (0 -179.50461325896237) / Math.Sqrt((2.6093476553002226 / (26)) + (42.24768946386968 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -40.51945857752854 = (4.323385212834041 - 179.50461325896237) / 4.323385212834041 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.069694119011107 > 2.4679976843053724.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.555391462079584 (T) = (0 -21.643462362701342) / Math.Sqrt((0.8384146443318585 / (26)) + (15.993224867829582 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -8.315648831409579 = (2.3233445951425375 - 21.643462362701342) / 2.3233445951425375 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.63787449521148 > 3.712779175132874.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -95.25272071284223 (T) = (0 -53.507708577634794) / Math.Sqrt((0.40871440782432855 / (27)) + (2.0756999289264755 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.89181157965323 = (3.5930959971816114 - 53.507708577634794) / 3.5930959971816114 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.880836652991484 > 3.157400825043168.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.81406715438766 (T) = (0 -19.900618702277058) / Math.Sqrt((1.0166209057187907 / (27)) + (3.8148896181432375 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.05976338269419 = (2.8188789940269157 - 19.900618702277058) / 2.8188789940269157 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 23.370306656031712 > 2.5010500168580374.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.56632362284602 (T) = (0 -20.40783304964669) / Math.Sqrt((1.0566296762106078 / (26)) + (4.6214031696632105 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.662744001529451 = (2.6632539264750816 - 20.40783304964669) / 2.6632539264750816 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.4713403008662 > 2.2677269240767237.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.00692788850284 (T) = (0 -27.292644065347382) / Math.Sqrt((0.2345947822348721 / (25)) + (13.757550757048019 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -10.86843668414818 = (2.2995989102591925 - 27.292644065347382) / 2.2995989102591925 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.39961614412129 > 4.689005155873156.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.276337927066692 (T) = (0 -16.474286144616162) / Math.Sqrt((0.9445711989039384 / (27)) + (6.257802767670179 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -2.683442224218281 = (4.472524649986174 - 16.474286144616162) / 4.472524649986174 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 96.66602098679883 > 16.802662443476322.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.80076875173292 (T) = (0 -97.0823884469517) / Math.Sqrt((0.8965133372860898 / (27)) + (30.800012149703292 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -4.819937934072948 = (16.681000647546572 - 97.0823884469517) / 16.681000647546572 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.75908535834336 > 3.8843425219734717.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -84.28007924513915 (T) = (0 -52.66033053975784) / Math.Sqrt((1.3499766487856895 / (26)) + (2.253717979340801 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.23439680676446 = (3.9790502966362404 - 52.66033053975784) / 3.9790502966362404 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 122.25476693648211 > 3.7357562803446234.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.14875347123099 (T) = (0 -118.95028814367099) / Math.Sqrt((0.3240799087251548 / (27)) + (11.222379892725087 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -34.02318411098465 = (3.3963299215379874 - 118.95028814367099) / 3.3963299215379874 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 116.23887820710858 > 3.5563425857851407.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -111.70032870458093 (T) = (0 -112.46421201918709) / Math.Sqrt((0.6784543774327694 / (26)) + (7.409029823031878 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -31.45827463840639 = (3.4648857116426437 - 112.46421201918709) / 3.4648857116426437 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 106.63405770976425 > 3.4020237903563353.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -56.4521184873374 (T) = (0 -98.84676680668667) / Math.Sqrt((0.9461124014606657 / (27)) + (22.53618496204943 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -27.160561047645523 = (3.51011354636882 - 98.84676680668667) / 3.51011354636882 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 18.778587337257687 > 2.6964055989177886.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.546943889164503 (T) = (0 -20.84744524900334) / Math.Sqrt((1.4608674312635441 / (25)) + (5.695976165235104 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -6.4123684709197555 = (2.8125214404535 - 20.84744524900334) / 2.8125214404535 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 120.45168491101754 > 3.575269492355839.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.00404265192244 (T) = (0 -108.58043187960087) / Math.Sqrt((0.52538966426791 / (26)) + (49.78355376679219 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -28.929495104109392 = (3.6278738248642393 - 108.58043187960087) / 3.6278738248642393 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Numerics.Tests.Perf_VectorOf<Byte>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 105.33278504502616 > 2.4010916125640667.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -84.76082169784124 (T) = (0 -103.60291668400437) / Math.Sqrt((1.2418190596464262 / (27)) + (10.971694463295268 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -37.524264577432476 = (2.689289927281181 - 103.60291668400437) / 2.689289927281181 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryFormat - Duration of single invocation	40.48 ns	132.01 ns	3.26	0.44	False
Parse - Duration of single invocation	33.38 ns	50.68 ns	1.52	0.70	False
Parse - Duration of single invocation	30.09 ns	54.52 ns	1.81	0.69	False
ParseSpan - Duration of single invocation	52.94 ns	66.66 ns	1.26	0.50	False
Parse - Duration of single invocation	51.40 ns	68.14 ns	1.33	0.58	False
TryParse - Duration of single invocation	24.16 ns	32.44 ns	1.34	0.69	False
ParseSpan - Duration of single invocation	38.96 ns	54.28 ns	1.39	0.63	False
TryParse - Duration of single invocation	44.17 ns	54.79 ns	1.24	0.55	False
ParseSpan - Duration of single invocation	31.62 ns	41.29 ns	1.31	0.66	False
ToString - Duration of single invocation	80.41 ns	167.00 ns	2.08	0.37	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 132.01028387602972 > 43.011995108414645.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -47.4724395597647 (T) = (0 -131.9766664274925) / Math.Sqrt((3.5421129536529206 / (26)) + (27.440464108956014 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -2.118046671801937 = (42.326712945326896 - 131.9766664274925) / 42.326712945326896 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.Parse(value: "12345")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.67820221897566 > 34.55422018338526.
IsChangePoint: Marked as a change because one of 4/17/2023 6:40:18 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -2.7705805270575565 (T) = (0 -70.56700967392044) / Math.Sqrt((15.954859446084585 / (30)) + (617.2983615322269 / (4))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (4) - 2, .025) and -0.9553313628264843 = (36.08954012373326 - 70.56700967392044) / 36.08954012373326 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.Parse(value: "0")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.52459131600407 > 32.312062142415115.
IsChangePoint: Marked as a change because one of 4/17/2023 6:40:18 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -11.15464259035111 (T) = (0 -50.01136530420315) / Math.Sqrt((13.859618354552406 / (30)) + (9.15641638996941 / (4))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (4) - 2, .025) and -0.5871679487293746 = (31.509813025294722 - 50.01136530420315) / 31.509813025294722 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.ParseSpan(value: "18446744073709551615")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.65643839452893 > 55.84756886230414.
IsChangePoint: Marked as a change because one of 2/2/2023 8:11:01 PM, 4/17/2023 6:40:18 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -5.218881444948029 (T) = (0 -66.38922549419533) / Math.Sqrt((8.925389712769535 / (31)) + (14.61256500661071 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.18491562832016856 = (56.02865208919054 - 66.38922549419533) / 56.02865208919054 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.Parse(value: "18446744073709551615")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.13693595492732 > 52.65602135937626.
IsChangePoint: Marked as a change because one of 4/17/2023 6:40:18 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -11.78876671798175 (T) = (0 -68.26306018792087) / Math.Sqrt((10.627702134495523 / (31)) + (6.5275743820988135 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.3204474318479547 = (51.6969161675655 - 68.26306018792087) / 51.6969161675655 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.TryParse(value: "0")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.441809271907424 > 29.2932723416009.
IsChangePoint: Marked as a change because one of 4/17/2023 6:40:18 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -4.637396805411847 (T) = (0 -36.98021032361669) / Math.Sqrt((7.666750822048706 / (31)) + (17.026670512172817 / (4))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (4) - 2, .025) and -0.36264983128993644 = (27.1384544102646 - 36.98021032361669) / 27.1384544102646 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.ParseSpan(value: "12345")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.278235688091996 > 38.319534217098465.
IsChangePoint: Marked as a change because one of 4/18/2023 3:11:52 AM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.79141988329518 (T) = (0 -53.88083114141239) / Math.Sqrt((11.64729091157603 / (32)) + (0.31586074744324116 / (2))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (32) + (2) - 2, .025) and -0.33681734535998814 = (40.30530522993997 - 53.88083114141239) / 40.30530522993997 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.TryParse(value: "18446744073709551615")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.78559559268525 > 47.05008635475055.
IsChangePoint: Marked as a change because one of 4/17/2023 1:54:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.479733249841575 (T) = (0 -53.584524925702794) / Math.Sqrt((13.069113154282489 / (29)) + (1.674226431767824 / (5))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (5) - 2, .025) and -0.14118074177882373 = (46.95533578859518 - 53.584524925702794) / 46.95533578859518 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.ParseSpan(value: "0")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.28866137228154 > 35.17548824430808.
IsChangePoint: Marked as a change because one of 4/17/2023 6:40:18 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -3.778831436587597 (T) = (0 -44.37715189783793) / Math.Sqrt((7.755489669015701 / (30)) + (22.36618344141841 / (4))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (4) - 2, .025) and -0.25937897781707303 = (35.237329413548295 - 44.37715189783793) / 35.237329413548295 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_UInt64.ToString(value: 18446744073709551615)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 166.9974167171931 > 81.47290119773992.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -58.49818211817289 (T) = (0 -173.92110817831906) / Math.Sqrt((8.469024081394485 / (27)) + (19.66888384216435 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -1.2728634324590105 = (76.52070322155426 - 173.92110817831906) / 76.52070322155426 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Tests.Perf_CancellationToken

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CreateLinkedTokenSource2 - Duration of single invocation	226.62 ns	246.81 ns	1.09	0.28	False
CreateLinkedTokenSource3 - Duration of single invocation	303.53 ns	351.52 ns	1.16	0.24	False
CreateManyRegisterMultipleDispose - Duration of single invocation	400.16 ns	470.38 ns	1.18	0.28	False
RegisterAndUnregister_Serial - Duration of single invocation	93.22 ns	109.60 ns	1.18	0.39	False
CreateManyRegisterDispose - Duration of single invocation	81.05 ns	94.23 ns	1.16	0.34	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_CancellationToken*'

Payloads

Baseline
Compare

Histogram

System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource2

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 246.81212552820668 > 239.1651054622706.
IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -8.162132411770141 (T) = (0 -250.4610759248587) / Math.Sqrt((59.531088949862664 / (26)) + (60.385794103691424 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.1138522958280919 = (224.86022326564742 - 250.4610759248587) / 224.86022326564742 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Threading.Tests.Perf_CancellationToken.CreateLinkedTokenSource3

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 351.51723093495184 > 324.900703109126.
IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.200401364177635 (T) = (0 -364.38986376670914) / Math.Sqrt((59.33322282621035 / (25)) + (198.20374843417918 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.1707636834435384 = (311.24117438878716 - 364.38986376670914) / 311.24117438878716 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterMultipleDispose

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 470.37639993333335 > 420.07876744749996.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -12.944081110465197 (T) = (0 -479.82495539004117) / Math.Sqrt((177.35507231164945 / (27)) + (165.71482182862476 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.16401936731962877 = (412.2138933950278 - 479.82495539004117) / 412.2138933950278 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Threading.Tests.Perf_CancellationToken.RegisterAndUnregister_Serial

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 109.59630943842562 > 102.00862718084821.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.573576962794169 (T) = (0 -112.85064106955339) / Math.Sqrt((18.5341558035417 / (26)) + (19.20643302499349 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.1343295613977056 = (99.48664383788108 - 112.85064106955339) / 99.48664383788108 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Threading.Tests.Perf_CancellationToken.CreateManyRegisterDispose

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 94.2307709375 > 83.82625521778846.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -6.495972776267139 (T) = (0 -97.4893591160428) / Math.Sqrt((11.067574214554055 / (27)) + (45.85728078447686 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.19780130498851448 = (81.39025956143671 - 97.4893591160428) / 81.39025956143671 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SubtractBenchmark - Duration of single invocation	3.23 ns	52.09 ns	16.11	0.54	False
AbsBenchmark - Duration of single invocation	2.94 ns	74.00 ns	25.13	0.55	False
XorBenchmark - Duration of single invocation	3.24 ns	51.16 ns	15.81	0.60	True
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.68 ns	72.59 ns	27.14	0.55	False
GreaterThanAllBenchmark - Duration of single invocation	2.23 ns	66.14 ns	29.71	0.56	False
SquareRootBenchmark - Duration of single invocation	44.43 ns	79.86 ns	1.80	0.54	False
BitwiseOrBenchmark - Duration of single invocation	3.27 ns	49.11 ns	15.02	0.60	True
BitwiseOrOperatorBenchmark - Duration of single invocation	3.53 ns	73.11 ns	20.70	0.61	True
EqualityOperatorBenchmark - Duration of single invocation	2.27 ns	21.31 ns	9.39	0.68	False
MaxBenchmark - Duration of single invocation	3.23 ns	74.66 ns	23.10	0.47	False
LessThanAnyBenchmark - Duration of single invocation	2.95 ns	68.59 ns	23.27	0.59	False
MinBenchmark - Duration of single invocation	3.25 ns	83.86 ns	25.83	0.50	False
DotBenchmark - Duration of single invocation	2.90 ns	100.19 ns	34.56	0.55	False
SumBenchmark - Duration of single invocation	2.63 ns	52.85 ns	20.10	0.55	False
LessThanOrEqualBenchmark - Duration of single invocation	3.78 ns	84.05 ns	22.25	0.45	False
AndNotBenchmark - Duration of single invocation	5.75 ns	48.73 ns	8.47	0.68	True
DivideBenchmark - Duration of single invocation	41.65 ns	60.83 ns	1.46	0.40	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.73 ns	27.57 ns	10.09	0.68	False
MultiplyBenchmark - Duration of single invocation	4.08 ns	53.52 ns	13.11	0.54	False
InequalityOperatorBenchmark - Duration of single invocation	3.47 ns	17.55 ns	5.06	0.66	False
AddOperatorBenchmark - Duration of single invocation	4.97 ns	44.98 ns	9.04	0.51	False
MultiplyOperatorBenchmark - Duration of single invocation	3.15 ns	54.31 ns	17.22	0.56	False
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.39 ns	50.66 ns	14.93	0.61	True
BitwiseAndOperatorBenchmark - Duration of single invocation	3.34 ns	48.81 ns	14.61	0.58	True
EqualsAnyBenchmark - Duration of single invocation	2.47 ns	65.89 ns	26.73	0.55	False
GreaterThanAnyBenchmark - Duration of single invocation	2.48 ns	32.98 ns	13.32	0.64	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.52 ns	69.48 ns	27.59	0.55	False
LessThanAllBenchmark - Duration of single invocation	2.42 ns	26.97 ns	11.17	0.68	False
AllBitsSetBenchmark - Duration of single invocation	2.01 ns	30.35 ns	15.10	0.61	True
LessThanBenchmark - Duration of single invocation	2.81 ns	80.46 ns	28.63	0.52	False
DivisionOperatorBenchmark - Duration of single invocation	41.76 ns	55.13 ns	1.32	0.31	False
GreaterThanBenchmark - Duration of single invocation	3.25 ns	126.45 ns	38.87	0.53	False
BitwiseAndBenchmark - Duration of single invocation	3.28 ns	49.64 ns	15.12	0.59	True
EqualsAllBenchmark - Duration of single invocation	2.24 ns	28.48 ns	12.72	0.64	False
SubtractionOperatorBenchmark - Duration of single invocation	3.24 ns	42.48 ns	13.11	0.56	False
ConditionalSelectBenchmark - Duration of single invocation	3.42 ns	52.17 ns	15.23	0.67	False
NegateBenchmark - Duration of single invocation	37.65 ns	60.78 ns	1.61	0.42	False
AddBenchmark - Duration of single invocation	3.03 ns	52.24 ns	17.21	0.44	False
OnesComplementBenchmark - Duration of single invocation	3.24 ns	42.46 ns	13.09	0.64	True
OnesComplementOperatorBenchmark - Duration of single invocation	6.58 ns	42.48 ns	6.46	0.56	True
EqualsStaticBenchmark - Duration of single invocation	3.27 ns	110.26 ns	33.74	0.51	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.092277650914106 > 3.621589509452868.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.35850767066359 (T) = (0 -54.82565086326341) / Math.Sqrt((1.082348469504505 / (27)) + (19.763271712793884 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.421824783921833 = (3.555068977338039 - 54.82565086326341) / 3.555068977338039 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.0032188671215 > 3.3916509168353923.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.15265698025229 (T) = (0 -68.44584613847704) / Math.Sqrt((0.9615101845739521 / (26)) + (32.69797001820898 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -20.731552989404456 = (3.149606757135527 - 68.44584613847704) / 3.149606757135527 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.16106661257477 > 3.6915158522440197.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -69.15151211176729 (T) = (0 -49.46662925061546) / Math.Sqrt((0.366926330823964 / (26)) + (3.418804985147896 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.051020424067625 = (3.5205008431903897 - 49.46662925061546) / 3.5205008431903897 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 72.59077685419251 > 2.612676574773652.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -58.88517899412427 (T) = (0 -67.98035385911307) / Math.Sqrt((0.6058231338550651 / (27)) + (9.725300904670519 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -26.647373094815176 = (2.4588359127638673 - 67.98035385911307) / 2.4588359127638673 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.1352983125396 > 2.384022087338845.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -49.77821690238674 (T) = (0 -68.66796496189929) / Math.Sqrt((0.7459930534505783 / (27)) + (13.939062461043678 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -27.118099244673978 = (2.4421268437946106 - 68.66796496189929) / 2.4421268437946106 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 79.86409394588424 > 47.752262669208434.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.410160870942969 (T) = (0 -73.81562165311135) / Math.Sqrt((5.793903945971897 / (27)) + (35.503533708064026 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.6443567384020522 = (44.8902722439923 - 73.81562165311135) / 44.8902722439923 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.10585637741291 > 3.6104779686711317.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -46.17843176426875 (T) = (0 -49.92175191137697) / Math.Sqrt((0.6067783728451669 / (26)) + (7.851195376154389 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -12.737129245840173 = (3.6340745593912276 - 49.92175191137697) / 3.6340745593912276 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 73.11217629767197 > 3.534622418665757.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.878905862924363 (T) = (0 -52.24338500258709) / Math.Sqrt((0.6472709632010575 / (26)) + (75.6789910818753 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.639111656361758 = (3.3405596270767246 - 52.24338500258709) / 3.3405596270767246 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.305846143728132 > 2.381649059284592.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.249328013859785 (T) = (0 -19.116367949763685) / Math.Sqrt((1.2109170375731915 / (27)) + (4.272828691659506 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -6.015169693990719 = (2.725004352516091 - 19.116367949763685) / 2.725004352516091 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.66238299553544 > 3.3781042356395417.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -112.81739697412497 (T) = (0 -76.97370001981017) / Math.Sqrt((0.11546082622257149 / (27)) + (2.9626760067071145 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -22.991335520266738 = (3.2083957958399796 - 76.97370001981017) / 3.2083957958399796 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.59411135961372 > 2.601373869059802.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -57.88611405208805 (T) = (0 -68.08392612865137) / Math.Sqrt((0.9667471470171771 / (27)) + (9.950187093133925 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.145506493371307 = (2.604039288583403 - 68.08392612865137) / 2.604039288583403 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 83.86151528834931 > 3.523437655998357.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.05618029356056 (T) = (0 -76.94437485591746) / Math.Sqrt((0.2857182424319289 / (27)) + (17.307341715192127 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -23.511685010057462 = (3.1390895739867 - 76.94437485591746) / 3.1390895739867 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 100.18603656611376 > 3.0447901235832533.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.57905216203847 (T) = (0 -105.8086382588215) / Math.Sqrt((0.21353529478158542 / (26)) + (32.943928224669484 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -33.49785336253212 = (3.067107890653264 - 105.8086382588215) / 3.067107890653264 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.85380662639962 > 2.807973074204021.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.741532045389974 (T) = (0 -54.593883738961416) / Math.Sqrt((0.5738714802067816 / (26)) + (10.215328459431786 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -21.185277621599607 = (2.460815891968319 - 54.593883738961416) / 2.460815891968319 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 84.051431404957 > 3.623415514956531.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -90.99629415473423 (T) = (0 -83.978626007004) / Math.Sqrt((1.0432842737714547 / (27)) + (5.9773105630568555 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -24.337287069140352 = (3.314428485490307 - 83.978626007004) / 3.314428485490307 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.73131480327582 > 3.923962173687064.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -110.67348197663482 (T) = (0 -48.83387644571281) / Math.Sqrt((3.757743264841503 / (27)) + (0.22281819101183437 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.554903803240402 = (3.6026722988649102 - 48.83387644571281) / 3.6026722988649102 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 60.82941283723972 > 45.59661741413375.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -12.25025299138099 (T) = (0 -63.004615259087345) / Math.Sqrt((9.642113938112724 / (25)) + (15.572979033884085 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.4223493422861584 = (44.296160855826955 - 63.004615259087345) / 44.296160855826955 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.573987951463153 > 2.620233434962957.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.09041461221098 (T) = (0 -28.602679845385254) / Math.Sqrt((0.8555561697533804 / (26)) + (8.37885492079467 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.32876753514321 = (2.5247830142737304 - 28.602679845385254) / 2.5247830142737304 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.524348695698684 > 3.3718060055285384.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -63.797396703463924 (T) = (0 -54.421683980715464) / Math.Sqrt((0.5104398467699798 / (27)) + (5.017357694828222 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -16.320095133423425 = (3.1421123014327623 - 54.421683980715464) / 3.1421123014327623 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.54939745447586 > 2.7284762553358743.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.909924774612037 (T) = (0 -18.973306409879985) / Math.Sqrt((2.6339334559514707 / (27)) + (2.8434491318066324 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -5.585790514694802 = (2.880945934667229 - 18.973306409879985) / 2.880945934667229 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.97943339247444 > 4.242218743150613.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -47.09995251248884 (T) = (0 -46.275815459081535) / Math.Sqrt((1.2688862482366685 / (27)) + (6.152848807215423 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.418064267117561 = (3.7264918640836537 - 46.275815459081535) / 3.7264918640836537 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.30507286812854 > 3.6103683917148133.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.989417729827704 (T) = (0 -49.29807689122352) / Math.Sqrt((0.41972185198693146 / (27)) + (17.42164685426002 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.482826210750629 = (3.403898947197852 - 49.29807689122352) / 3.403898947197852 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.65917888401611 > 3.5164173691260636.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -73.144876306959 (T) = (0 -49.54201067844112) / Math.Sqrt((1.0362634491164457 / (27)) + (2.864862266972179 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.217142688749476 = (3.4846671910837226 - 49.54201067844112) / 3.4846671910837226 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.813848398813235 > 3.756483445487966.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -88.63178561092835 (T) = (0 -49.77425646196069) / Math.Sqrt((1.1484034950627042 / (27)) + (1.8307176043237556 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.81518140079284 = (3.602866659362445 - 49.77425646196069) / 3.602866659362445 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 65.89412468240327 > 2.583473562625763.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -59.597729208511204 (T) = (0 -66.00374968679485) / Math.Sqrt((1.5392625480140487 / (26)) + (8.543805180264185 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -23.180298110232023 = (2.729649956584489 - 66.00374968679485) / 2.729649956584489 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.98062328869781 > 2.57496098158127.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.346744649813623 (T) = (0 -30.768946610626777) / Math.Sqrt((1.144020618252433 / (27)) + (9.424023370698974 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.114902773544557 = (2.768260527106214 - 30.768946610626777) / 2.768260527106214 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.48456274884191 > 2.588410594337842.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.552786442782036 (T) = (0 -67.5940066793979) / Math.Sqrt((0.4335436108184902 / (26)) + (13.157414539171581 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -26.761769412400906 = (2.434787411252121 - 67.5940066793979) / 2.434787411252121 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.974290217669086 > 2.5613601835392203.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.496518474482086 (T) = (0 -29.433331382888184) / Math.Sqrt((0.9005550402453147 / (27)) + (27.254390397875344 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.561987253285233 = (2.5456983075746753 - 29.433331382888184) / 2.5456983075746753 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.352953040606113 > 2.0837239203750673.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -78.90744894347579 (T) = (0 -30.532960689771983) / Math.Sqrt((0.38037135332369465 / (26)) + (0.9201814996479688 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.398659567088472 = (2.120541884298887 - 30.532960689771983) / 2.120541884298887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 80.46277228559869 > 3.424596401723593.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.662380547222 (T) = (0 -84.67193410547722) / Math.Sqrt((0.07698842982304589 / (27)) + (32.01462311352339 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -24.661125181882856 = (3.2996189179287 - 84.67193410547722) / 3.2996189179287 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.DivisionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.12977178801638 > 45.205792764963945.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.115776958830349 (T) = (0 -54.71008229792255) / Math.Sqrt((4.26548943321975 / (27)) + (2.7490906688324954 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.24328832552166163 = (44.00434008335691 - 54.71008229792255) / 44.00434008335691 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 126.4507018492365 > 3.48486218219677.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.911196157895226 (T) = (0 -115.46140809402665) / Math.Sqrt((0.5349818383991944 / (26)) + (87.3360885392556 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -33.880272396521804 = (3.3102209404058507 - 115.46140809402665) / 3.3102209404058507 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.63725039891814 > 3.5398630105878186.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -183.16913505211542 (T) = (0 -48.843887780305046) / Math.Sqrt((0.34739255995708057 / (27)) + (0.39254493038853283 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.98629831587445 = (3.2592363204572314 - 48.843887780305046) / 3.2592363204572314 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.476679806328132 > 2.280043852873246.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.79557071303651 (T) = (0 -28.227035961543898) / Math.Sqrt((2.4218656728195045 / (27)) + (14.343676022568818 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.579682966253431 = (2.43763460915171 - 28.227035961543898) / 2.43763460915171 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.47529066772735 > 3.4413509853507778.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.71699582057272 (T) = (0 -47.53156101606667) / Math.Sqrt((1.1732337877385928 / (27)) + (23.05882373765121 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.416871023476416 = (3.54267108425634 - 47.53156101606667) / 3.54267108425634 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.16777076766549 > 3.6374158876990985.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -84.39375731975414 (T) = (0 -53.18237998588868) / Math.Sqrt((0.3764980876344552 / (26)) + (2.6623659410968714 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.419655250994406 = (3.448999288259637 - 53.18237998588868) / 3.448999288259637 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 60.783556099855325 > 45.87135805772977.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.063802626716058 (T) = (0 -53.29999751754991) / Math.Sqrt((10.844233447234329 / (27)) + (14.815562470538875 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3427900429476945 = (39.693470917125424 - 53.29999751754991) / 39.693470917125424 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.238230804546 > 3.3669956847063545.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.962478242428276 (T) = (0 -54.67335468786621) / Math.Sqrt((1.5762403707648351 / (26)) + (17.721405195007204 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.90086184152055 = (3.4383893925235163 - 54.67335468786621) / 3.4383893925235163 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.464922388421094 > 3.360682314989454.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.277863740691046 (T) = (0 -43.80135852810585) / Math.Sqrt((0.50922410048881 / (27)) + (6.518468251905381 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.984906187481764 = (3.37325182759757 - 43.80135852810585) / 3.37325182759757 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.4844194132391 > 6.086288532901127.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -114.96970352325518 (T) = (0 -42.998369799607545) / Math.Sqrt((0.7219666956533212 / (27)) + (0.6106185015211493 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.062260278909289 = (6.08847141021094 - 42.998369799607545) / 6.08847141021094 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 110.25858468234073 > 3.4402969848325946.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.370023867160967 (T) = (0 -86.63412145419844) / Math.Sqrt((0.2446071158930179 / (25)) + (101.71233803955862 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -25.47628333454633 = (3.272140593130682 - 86.63412145419844) / 3.272140593130682 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<StructRecord>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SerializeToUtf8Bytes - Duration of single invocation	912.08 ns	1.01 μs	1.11	0.16	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<StructRecord>*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToUtf8Bytes(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.008111866723158 > 967.9000812443657.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -8.581012928179785 (T) = (0 -1008.7257965263316) / Math.Sqrt((1761.8301555832397 / (26)) + (437.828701432717 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.1039349229502238 = (913.7547653901106 - 1008.7257965263316) / 913.7547653901106 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
XorBenchmark - Duration of single invocation	3.34 ns	48.16 ns	14.41	0.60	True
MinBenchmark - Duration of single invocation	3.24 ns	73.73 ns	22.77	0.52	False
AbsBenchmark - Duration of single invocation	5.89 ns	30.71 ns	5.21	0.59	True
GreaterThanOrEqualBenchmark - Duration of single invocation	2.29 ns	106.04 ns	46.36	0.51	False
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.44 ns	70.60 ns	28.89	0.57	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.65 ns	30.05 ns	11.34	0.71	False
BitwiseAndBenchmark - Duration of single invocation	4.99 ns	48.58 ns	9.73	0.58	True
AddOperatorBenchmark - Duration of single invocation	3.34 ns	43.96 ns	13.15	0.53	False
MaxBenchmark - Duration of single invocation	3.47 ns	78.86 ns	22.76	0.51	False
OnesComplementBenchmark - Duration of single invocation	1.92 ns	42.68 ns	22.26	0.56	True
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.30 ns	52.09 ns	15.78	0.63	True
LessThanAllBenchmark - Duration of single invocation	0.61 ns	32.85 ns	53.57	0.72	False
BitwiseOrOperatorBenchmark - Duration of single invocation	2.54 ns	46.81 ns	18.42	0.60	True
LessThanOrEqualBenchmark - Duration of single invocation	4.06 ns	81.41 ns	20.06	0.57	False
AndNotBenchmark - Duration of single invocation	3.24 ns	52.15 ns	16.10	0.62	True
SumBenchmark - Duration of single invocation	2.82 ns	54.42 ns	19.31	0.56	False
AddBenchmark - Duration of single invocation	3.32 ns	53.25 ns	16.05	0.54	False
GreaterThanAnyBenchmark - Duration of single invocation	2.38 ns	28.33 ns	11.90	0.67	False
CountBenchmark - Duration of single invocation	0.00 ns	14.96 ns	∞	0.91	True
DotBenchmark - Duration of single invocation	3.26 ns	105.11 ns	32.21	0.52	False
LessThanAnyBenchmark - Duration of single invocation	3.80 ns	63.39 ns	16.69	0.56	False
BitwiseOrBenchmark - Duration of single invocation	3.14 ns	49.45 ns	15.76	0.63	True
EqualsStaticBenchmark - Duration of single invocation	3.27 ns	85.03 ns	26.02	0.57	False
MultiplyOperatorBenchmark - Duration of single invocation	3.16 ns	46.31 ns	14.65	0.55	False
GreaterThanAllBenchmark - Duration of single invocation	2.42 ns	67.20 ns	27.82	0.60	False
SubtractBenchmark - Duration of single invocation	3.34 ns	53.11 ns	15.89	0.53	False
EqualsAllBenchmark - Duration of single invocation	2.22 ns	26.91 ns	12.12	0.66	False
AllBitsSetBenchmark - Duration of single invocation	1.98 ns	33.06 ns	16.67	0.62	True
InequalityOperatorBenchmark - Duration of single invocation	2.08 ns	17.56 ns	8.43	0.70	False
LessThanBenchmark - Duration of single invocation	2.45 ns	84.56 ns	34.56	0.57	False
SubtractionOperatorBenchmark - Duration of single invocation	3.80 ns	45.37 ns	11.95	0.47	False
OnesComplementOperatorBenchmark - Duration of single invocation	5.87 ns	42.37 ns	7.22	0.58	True
ConditionalSelectBenchmark - Duration of single invocation	3.43 ns	51.73 ns	15.08	0.57	False
EqualityOperatorBenchmark - Duration of single invocation	2.23 ns	17.58 ns	7.87	0.65	False
GreaterThanBenchmark - Duration of single invocation	3.77 ns	112.88 ns	29.98	0.53	False
BitwiseAndOperatorBenchmark - Duration of single invocation	3.01 ns	50.86 ns	16.91	0.65	True
EqualsAnyBenchmark - Duration of single invocation	4.14 ns	63.61 ns	15.35	0.53	False
MultiplyBenchmark - Duration of single invocation	7.30 ns	53.33 ns	7.31	0.53	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.70 ns	63.29 ns	23.48	0.59	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.16103983445984 > 3.471057956770034.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -80.73995098151283 (T) = (0 -48.833560903797704) / Math.Sqrt((0.20684944263025745 / (26)) + (2.465585503175949 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.214602247491394 = (3.435450394851245 - 48.833560903797704) / 3.435450394851245 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 73.72927676035519 > 3.401782985104369.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.118570992721274 (T) = (0 -74.90559679145663) / Math.Sqrt((1.8082164214034075 / (27)) + (20.358163302554285 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.771968522024213 = (3.6060904247970202 - 74.90559679145663) / 3.6060904247970202 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.705485614458162 > 6.042664138117488.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.51183507667895 (T) = (0 -32.357574626743286) / Math.Sqrt((2.058688629117059 / (26)) + (9.574145489164577 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -4.579756514140713 = (5.799101545872093 - 32.357574626743286) / 5.799101545872093 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 106.03634786120854 > 3.4158480933674165.
IsChangePoint: Marked as a change because one of 1/26/2023 7:55:58 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -48.45459654706083 (T) = (0 -109.89764137638839) / Math.Sqrt((0.7106992364040648 / (27)) + (33.59076633564448 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -30.73655786048075 = (3.4628091004549684 - 109.89764137638839) / 3.4628091004549684 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 70.60010513363048 > 2.5641801690263066.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -59.02703205494059 (T) = (0 -68.14474491872765) / Math.Sqrt((1.3153847264642347 / (27)) + (9.449475552588085 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -24.39684800846272 = (2.6831969422355293 - 68.14474491872765) / 2.6831969422355293 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.051834517361126 > 2.6490616633316386.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.450860967465456 (T) = (0 -28.848152302391522) / Math.Sqrt((0.1783429136671365 / (26)) + (5.549391682505763 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.427489341151073 = (2.5244523482955787 - 28.848152302391522) / 2.5244523482955787 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.57697636339487 > 3.5289904481695227.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -68.80833108826504 (T) = (0 -49.04023577002412) / Math.Sqrt((1.1373645883136665 / (27)) + (3.1274718307168583 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.04466874516047 = (3.7594082861029254 - 49.04023577002412) / 3.7594082861029254 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.959813964284976 > 3.550978166904056.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.40704577332728 (T) = (0 -46.22307648029212) / Math.Sqrt((1.4313951667662672 / (27)) + (9.42423345030735 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.80583627567284 = (3.609532051264921 - 46.22307648029212) / 3.609532051264921 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 78.85774413538242 > 3.2766164457693616.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -61.96190104335033 (T) = (0 -74.70786746811946) / Math.Sqrt((0.5247990804343471 / (27)) + (10.524416914841522 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -22.975447247754968 = (3.1160155927900375 - 74.70786746811946) / 3.1160155927900375 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.67878202714917 > 3.360080113425885.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -116.21999642860504 (T) = (0 -43.15759046419393) / Math.Sqrt((0.28089051623135053 / (27)) + (0.859451085675257 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.227662926555407 = (3.2626769145706165 - 43.15759046419393) / 3.2626769145706165 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.094062980865374 > 3.4657859926979167.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -65.68608512822802 (T) = (0 -50.12246373344812) / Math.Sqrt((0.3103688491174174 / (27)) + (3.9676904714868746 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.050259682335136 = (3.3303387975609553 - 50.12246373344812) / 3.3303387975609553 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 32.853842835515415 > 2.651672117050922.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.51830059146125 (T) = (0 -31.399530833155275) / Math.Sqrt((1.7200398910185641 / (27)) + (4.952654683325451 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -9.914974086698281 = (2.876738926152912 - 31.399530833155275) / 2.876738926152912 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.81396679225118 > 3.3066491130735507.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -58.17522685354613 (T) = (0 -49.431593838143904) / Math.Sqrt((0.9416703294394498 / (26)) + (4.748879085173273 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.15031500001452 = (3.262743635237718 - 49.431593838143904) / 3.262743635237718 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 81.40920429027159 > 3.5532000393551386.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -44.34955965275773 (T) = (0 -85.43581386371056) / Math.Sqrt((0.7916340608903506 / (27)) + (27.25472563304043 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.487191735834497 = (3.2255519843624847 - 85.43581386371056) / 3.2255519843624847 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.15153411836932 > 3.6298908863855477.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -91.61208471606514 (T) = (0 -49.54966286120109) / Math.Sqrt((0.9191277231970761 / (27)) + (1.7309630407796848 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.370558392164648 = (3.7058783491224982 - 49.54966286120109) / 3.7058783491224982 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.42168998691109 > 2.8805623075763434.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -41.274821512850515 (T) = (0 -54.45416247549934) / Math.Sqrt((0.5613987195543289 / (26)) + (12.554179788612549 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -21.74189967292161 = (2.394442120432753 - 54.45416247549934) / 2.394442120432753 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.24733934025808 > 3.6632937814532274.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -51.21489499386048 (T) = (0 -55.24334543885499) / Math.Sqrt((1.5224023320444295 / (26)) + (7.621006363394996 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.759259878387244 = (3.7429617673275546 - 55.24334543885499) / 3.7429617673275546 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.333271458271458 > 2.5111304370638017.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.67288681002168 (T) = (0 -28.11136227278045) / Math.Sqrt((0.03500300201926885 / (27)) + (4.1367662125359965 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.58239220024854 = (2.427077393578265 - 28.11136227278045) / 2.427077393578265 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.958226125998028 > 0.002380738252784484.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.15141493490359 (T) = (0 -14.393261519836447) / Math.Sqrt((0.12873170024781258 / (27)) + (1.3365361470422032 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -83.63455641604033 = (0.1700636492862692 - 14.393261519836447) / 0.1700636492862692 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 105.10839506769706 > 2.916251510779068.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -92.60458191976358 (T) = (0 -103.7345653198843) / Math.Sqrt((0.49729749672087203 / (26)) + (9.295140429288553 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -32.49734834582099 = (3.096799312260365 - 103.7345653198843) / 3.096799312260365 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.39129769648405 > 2.5319374747727443.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -37.69221742718722 (T) = (0 -67.89814230809021) / Math.Sqrt((0.9284217900673968 / (27)) + (23.757998854688967 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -25.436784004085922 = (2.5683208024696293 - 67.89814230809021) / 2.5683208024696293 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.45467542214494 > 3.3807417123093986.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -73.47619191049004 (T) = (0 -48.48079919985133) / Math.Sqrt((0.933534805189471 / (26)) + (2.739704793344134 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.761008114190881 = (3.2843826671460907 - 48.48079919985133) / 3.2843826671460907 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 85.02732871711571 > 3.4369133619545327.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -47.96183626342775 (T) = (0 -86.1133872068783) / Math.Sqrt((4.19060366617395 / (25)) + (21.94071024482371 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -19.056078733686544 = (4.293630292856835 - 86.1133872068783) / 4.293630292856835 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.31055425496077 > 3.3215407377934025.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -42.72455858348652 (T) = (0 -47.270676448255735) / Math.Sqrt((0.3632331684273178 / (27)) + (8.392044283794311 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.625524195031307 = (3.232067159980145 - 47.270676448255735) / 3.232067159980145 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.20049729813108 > 2.5895476377408935.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -121.04604117107631 (T) = (0 -67.47622953299178) / Math.Sqrt((0.402000117359217 / (27)) + (2.1713224524506654 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -23.920693817930573 = (2.7076384801310094 - 67.47622953299178) / 2.7076384801310094 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.11034510419833 > 3.4573837267100087.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.81512533233325 (T) = (0 -55.816760515912264) / Math.Sqrt((1.079966151018634 / (27)) + (41.43997521221423 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.12511254411399 = (3.6903368720805734 - 55.816760515912264) / 3.6903368720805734 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.906121594443853 > 2.496025898780703.
IsChangePoint: Marked as a change because one of 1/27/2023 7:12:54 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.46287417332067 (T) = (0 -28.26486393245304) / Math.Sqrt((0.22583398172038288 / (27)) + (8.131511506045735 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.359818093072183 = (2.488144061892192 - 28.26486393245304) / 2.488144061892192 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 33.058039989245756 > 2.0962629500268464.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -57.38163295343184 (T) = (0 -30.376961044408723) / Math.Sqrt((0.9011633894181666 / (26)) + (1.6649215121485892 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.439450581910542 = (2.1037477064719052 - 30.376961044408723) / 2.1037477064719052 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.563673094756208 > 2.7124810759121334.
IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -26.144713012494844 (T) = (0 -19.036394490891023) / Math.Sqrt((1.0320585167803782 / (27)) + (2.895200212523315 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.61926732466344 = (2.498454730584204 - 19.036394490891023) / 2.498454730584204 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 84.56283926951684 > 3.476355259499175.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -69.23412022381186 (T) = (0 -86.79806214923727) / Math.Sqrt((1.0473515107978026 / (27)) + (11.284302055769286 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -24.170193327318298 = (3.4484463834066617 - 86.79806214923727) / 3.4484463834066617 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SubtractionOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.36674094712035 > 3.7147141628531832.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -59.87635366583552 (T) = (0 -45.78193929961901) / Math.Sqrt((1.7565948393179438 / (27)) + (3.4811705543541542 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.330914022363917 = (3.434268589746758 - 45.78193929961901) / 3.434268589746758 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.370123541744526 > 6.147028492870065.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.9727534071964 (T) = (0 -43.32545505112138) / Math.Sqrt((0.982308821232306 / (27)) + (9.554786054465692 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.6863581662547285 = (5.6366687726487035 - 43.32545505112138) / 5.6366687726487035 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.734480524291534 > 3.514629570742695.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.75511218630805 (T) = (0 -52.74248497122268) / Math.Sqrt((0.1685719350722047 / (25)) + (1.9893978111502668 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -14.799825193591023 = (3.3381688926923654 - 52.74248497122268) / 3.3381688926923654 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.580658398090677 > 2.5071363550142265.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -25.52122678900781 (T) = (0 -18.979647897380765) / Math.Sqrt((0.5825296241064962 / (27)) + (3.1613415932218207 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.578943227938856 = (2.5042604656826817 - 18.979647897380765) / 2.5042604656826817 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 112.8832109630922 > 3.4319006893857593.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -85.72412694804547 (T) = (0 -112.99742520556272) / Math.Sqrt((0.5371442540560816 / (26)) + (12.97768493808974 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -35.20596094785344 = (3.1209619147606698 - 112.99742520556272) / 3.1209619147606698 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.85694248787839 > 3.331721360737145.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -76.11318169636866 (T) = (0 -49.307461143172546) / Math.Sqrt((0.9321054425258614 / (27)) + (2.622000211140796 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.105406499462788 = (3.4956426916906254 - 49.307461143172546) / 3.4956426916906254 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.61351904878488 > 3.5388753080383153.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.5576864509132 (T) = (0 -66.92929469465356) / Math.Sqrt((1.572407161776661 / (26)) + (12.300287596372781 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -21.17643525999031 = (3.0180366641434153 - 66.92929469465356) / 3.0180366641434153 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.32956680637491 > 3.564634363864269.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -40.73498876435206 (T) = (0 -55.24644945181562) / Math.Sqrt((0.854668977611158 / (27)) + (12.712344261480748 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -15.305960093849704 = (3.3881138635101604 - 55.24644945181562) / 3.3881138635101604 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 63.29236875720692 > 2.6234307801820553.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.16102676501146 (T) = (0 -65.77817364871049) / Math.Sqrt((1.5417619489873082 / (26)) + (2.8749197885679516 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -21.597221478192353 = (2.9108965326639957 - 65.77817364871049) / 2.9108965326639957 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FrozenDictionary - Duration of single invocation	5.67 μs	8.22 μs	1.45	0.09	True
Dictionary - Duration of single invocation	5.38 μs	7.93 μs	1.47	0.11	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CtorFromCollection<Int32>.FrozenDictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 8.217891054468664 > 5.962534030076172.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -214.83570191193027 (T) = (0 -8195.40292479061) / Math.Sqrt((788.212377566928 / (26)) + (850.6017179665627 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.4418089325572865 = (5684.111632083391 - 8195.40292479061) / 5684.111632083391 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Collections.CtorFromCollection<Int32>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.930442294973545 > 5.668899569654127.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -74.18417938278475 (T) = (0 -7868.769428473252) / Math.Sqrt((416.7876510863645 / (26)) + (8736.354148733788 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.4573563717234233 = (5399.344718387511 - 7868.769428473252) / 5399.344718387511 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollection<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FrozenDictionary - Duration of single invocation	10.75 μs	13.48 μs	1.25	0.11	True
Dictionary - Duration of single invocation	10.56 μs	13.50 μs	1.28	0.03	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CtorFromCollection<String>.FrozenDictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.484260391609393 > 11.322217374440125.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.30903408281631 (T) = (0 -13710.801864820129) / Math.Sqrt((39933.748408378946 / (27)) + (163252.96961827172 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.2631721666825377 = (10854.262171425717 - 13710.801864820129) / 10854.262171425717 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Collections.CtorFromCollection<String>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.504973308910598 > 11.125353076495559.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -27.198830585700673 (T) = (0 -13125.41167586383) / Math.Sqrt((13595.175447186457 / (25)) + (64780.15726827183 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.23859193383730307 = (10597.042752571273 - 13125.41167586383) / 10597.042752571273 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	15.74 μs	22.21 μs	1.41	0.64	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse<Int32, Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsKeyFalse<Int32, Int32>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.207467294053462 > 16.063988285549996.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -5.5217959592903565 (T) = (0 -19218.488911830416) / Math.Sqrt((958918.6338810066 / (27)) + (3419652.876900795 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.24300235703453105 = (15461.34550998001 - 19218.488911830416) / 15461.34550998001 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Guids

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteGuids - Duration of single invocation	6.33 ms	7.04 ms	1.11	0.03	False
WriteGuids - Duration of single invocation	6.10 ms	7.33 ms	1.20	0.02	False
WriteGuids - Duration of single invocation	7.21 ms	7.84 ms	1.09	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Guids*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: False)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.035657056891026 > 6.704287853004808.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.934968829229177 (T) = (0 -7197886.41340955) / Math.Sqrt((3847231628.1815267 / (25)) + (86161402233.1997 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.13022598559231932 = (6368537.359046246 - 7197886.41340955) / 6368537.359046246 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: True)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.325357636111112 > 6.429424217187501.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -4.841836279694535 (T) = (0 -7848562.582576885) / Math.Sqrt((1522695789.7831292 / (26)) + (979191537801.5045 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.27531522349313264 = (6154213.827291577 - 7848562.582576885) / 6154213.827291577 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: True, SkipValidation: False)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.8419999802083336 > 7.611989848437501.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -5.8371966924624825 (T) = (0 -8065873.090494791) / Math.Sqrt((7836508812.531417 / (25)) + (136492223545.82462 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.10545207311001309 = (7296447.56810012 - 8065873.090494791) / 7296447.56810012 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterDecimal - Duration of single invocation	59.30 ns	154.33 ns	2.60	0.36	True
FormatterUInt32 - Duration of single invocation	15.62 ns	34.65 ns	2.22	0.63	True
FormatterDateTimeOffsetNow - Duration of single invocation	43.33 ns	54.16 ns	1.25	0.39	False
FormatterUInt64 - Duration of single invocation	12.74 ns	48.22 ns	3.78	0.60	True
FormatterInt32 - Duration of single invocation	13.24 ns	48.50 ns	3.66	0.58	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 154.32726388422884 > 63.38086116741223.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -54.55756098332011 (T) = (0 -159.29887338689915) / Math.Sqrt((5.26088252724373 / (26)) + (25.334309125812553 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -1.692795727549864 = (59.15742949126071 - 159.29887338689915) / 59.15742949126071 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt32(value: 0)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.64853659385887 > 12.324433797249391.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.43528690348716 (T) = (0 -37.39860133444673) / Math.Sqrt((4.002353133239041 / (26)) + (10.568449982722177 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -1.9728402158388059 = (12.580091299624213 - 37.39860133444673) / 12.580091299624213 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value: 12/30/2017 3:45:22 AM -08:00)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.155738530407554 > 45.97003446827547.
IsChangePoint: Marked as a change because one of 3/3/2023 1:35:24 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.057510985646742 (T) = (0 -52.13683592636165) / Math.Sqrt((4.053178907634971 / (27)) + (3.1210433986679065 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.15488904267762982 = (45.144454575031304 - 52.13683592636165) / 45.144454575031304 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterUInt64(value: 0)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.21884197831913 > 13.47374003070659.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -30.796571445667844 (T) = (0 -43.99711968576784) / Math.Sqrt((1.904291678593838 / (26)) + (7.732078208192405 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -2.493386307398568 = (12.59440434417095 - 43.99711968576784) / 12.59440434417095 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.50134785835689 > 13.229635831641724.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.218778033169432 (T) = (0 -46.611770934677516) / Math.Sqrt((3.8958400390152494 / (26)) + (10.356333799431367 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -2.670866551887641 = (12.697756858175275 - 46.611770934677516) / 12.697756858175275 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	45.18 μs	50.12 μs	1.11	0.14	False
IDictionary - Duration of single invocation	48.35 μs	54.72 μs	1.13	0.16	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndClear<String>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.11937671703298 > 47.08190227752459.
IsChangePoint: Marked as a change because one of 3/10/2023 4:14:40 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -12.008735562043572 (T) = (0 -51121.2288193652) / Math.Sqrt((1025476.2233682923 / (26)) + (1956287.8588592703 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.1430933931828491 = (44721.83036332872 - 51121.2288193652) / 44721.83036332872 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Collections.CreateAddAndClear<String>.IDictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 54.71620565372127 > 50.778114626889376.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.248589016185504 (T) = (0 -55388.569601756884) / Math.Sqrt((1363525.4691664132 / (26)) + (4813977.049390306 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.15614152664321207 = (47908.122254352624 - 55388.569601756884) / 47908.122254352624 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.AddGivenSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	33.88 μs	39.02 μs	1.15	0.24	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.AddGivenSize<String>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.01539420679071 > 36.212882037898126.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.541933696083709 (T) = (0 -37624.46549618828) / Math.Sqrt((1717655.968810124 / (26)) + (470059.3864631415 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.0762178303774802 = (34959.89792604682 - 37624.46549618828) / 34959.89792604682 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Deep

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteDeepUtf8 - Duration of single invocation	15.04 ms	19.70 ms	1.31	0.12	False
WriteDeepUtf16 - Duration of single invocation	16.99 ms	19.32 ms	1.14	0.09	False
WriteDeepUtf8 - Duration of single invocation	14.81 ms	20.16 ms	1.36	0.14	False
WriteDeepUtf16 - Duration of single invocation	14.40 ms	21.03 ms	1.46	0.15	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Deep*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: False)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.70104444444444 > 15.782056718203124.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.52670750649845 (T) = (0 -20075239.463428933) / Math.Sqrt((1551341115528.486 / (25)) + (276445445933.6918 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.4333375016126372 = (14005940.290296203 - 20075239.463428933) / 14005940.290296203 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: False)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.324999972222223 > 16.26711315205128.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.83463336559371 (T) = (0 -19890308.297062658) / Math.Sqrt((2722310048408.9014 / (26)) + (600326301212.9371 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.41821096065772034 = (14024929.188135859 - 19890308.297062658) / 14024929.188135859 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf8(Formatted: False, SkipValidation: True)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.15529167857143 > 15.802055266778847.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -18.2875287752172 (T) = (0 -19549689.90162546) / Math.Sqrt((2141353475139.6147 / (26)) + (135720604540.01474 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.41806005941134416 = (13786221.374672098 - 19549689.90162546) / 13786221.374672098 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Tests.Perf_Deep.WriteDeepUtf16(Formatted: False, SkipValidation: True)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.032642393939394 > 15.976920375020834.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.972723964603562 (T) = (0 -19955986.6237849) / Math.Sqrt((1698483056351.3982 / (27)) + (1149906609563.468 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.46689538281318715 = (13604233.033656187 - 19955986.6237849) / 13604233.033656187 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Basic

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteBasicUtf8 - Duration of single invocation	6.43 ms	10.85 ms	1.69	0.23	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Basic*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: True, SkipValidation: True, DataSize: 100000)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 10.845104904017857 > 6.6866910331129805.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.4801671386426 (T) = (0 -11163363.478038419) / Math.Sqrt((1439779304906.5037 / (25)) + (435363888426.68744 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -1.1011111272045924 = (5313076.178360272 - 11163363.478038419) / 5313076.178360272 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
PropertyIndexer - Duration of single invocation	11.77 μs	15.46 μs	1.31	0.26	False
PropertyIndexer - Duration of single invocation	10.25 μs	13.28 μs	1.30	0.26	False
PropertyIndexer - Duration of single invocation	10.23 μs	13.77 μs	1.35	0.27	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: ObjectProperties)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.462730264945648 > 11.250557225030263.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -12.776659611354068 (T) = (0 -14663.890468428679) / Math.Sqrt((274699.8094059741 / (27)) + (650007.3726479344 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3576837321542335 = (10800.667431701137 - 14663.890468428679) / 10800.667431701137 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.276107434089514 > 10.959936870947033.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -4.8267376422598 (T) = (0 -13715.575775110463) / Math.Sqrt((508273.8445812683 / (27)) + (2869062.726291496 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.27585038910665305 = (10750.144289812908 - 13715.575775110463) / 10750.144289812908 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 13.773436030522817 > 10.83400809583865.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.727793652497242 (T) = (0 -13993.601551219019) / Math.Sqrt((174703.46037725417 / (27)) + (1610173.1519572658 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.3363677010139595 = (10471.370671860352 - 13993.601551219019) / 10471.370671860352 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	29.85 μs	35.50 μs	1.19	0.23	False
IDictionary - Duration of single invocation	32.61 μs	38.02 μs	1.17	0.17	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndClear<Int32>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 35.501272602680125 > 30.72533817402718.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.366661798693638 (T) = (0 -36533.28538065712) / Math.Sqrt((1257280.4829839661 / (25)) + (644073.957538992 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -0.2525379551980034 = (29167.407845043606 - 36533.28538065712) / 29167.407845043606 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Collections.CreateAddAndClear<Int32>.IDictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 38.01843286192214 > 33.69108046878953.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.300137377863763 (T) = (0 -38606.6009542466) / Math.Sqrt((1526784.9682088494 / (26)) + (310170.9850220747 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.18496674565705754 = (32580.324381035225 - 38606.6009542466) / 32580.324381035225 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToStringD - Duration of single invocation	1.01 μs	1.53 μs	1.51	0.00	True
GreatestCommonDivisor - Duration of single invocation	5.35 ms	5.82 ms	1.09	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_BigInteger.ToStringD(numberString: 12345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890123456789012345678901234567890)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.5253852825408514 > 1.0564873922024778.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -57.36076964423855 (T) = (0 -1534.1828437250283) / Math.Sqrt((118.23772104577847 / (26)) + (644.4083744451933 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.5264955958554655 = (1005.035879494467 - 1534.1828437250283) / 1005.035879494467 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 65536,65536 bits)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 5.816232370192308 > 5.606891040156251.
IsChangePoint: Marked as a change because one of 4/12/2023 9:47:42 AM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.94564071051086 (T) = (0 -5825807.930785583) / Math.Sqrt((2115309607.4173546 / (25)) + (1013425335.3228387 / (10))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (10) - 2, .025) and -0.08631525552084927 = (5362907.223458182 - 5825807.930785583) / 5362907.223458182 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	e7ed417c2bf4a24a0694a387f33ba843a2318fdc
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SquareRootBenchmark - Duration of single invocation	28.47 ns	44.87 ns	1.58	0.62	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.SquareRootBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.87413737476123 > 30.157801166375712.
IsChangePoint: Marked as a change because one of 1/27/2023 3:53:39 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.487448255720413 (T) = (0 -48.68912278822226) / Math.Sqrt((6.350225158173205 / (26)) + (12.952947164785014 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.6080640213621176 = (30.27809971581848 - 48.68912278822226) / 30.27809971581848 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTimeOffset

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	185.73 ns	245.36 ns	1.32	0.32	False
ToString - Duration of single invocation	101.45 ns	173.94 ns	1.71	0.24	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_DateTimeOffset.ToString(format: "o")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 245.3563768327667 > 193.95838958630307.
IsChangePoint: Marked as a change because one of 4/9/2023 4:09:45 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -11.081609560936364 (T) = (0 -228.78954150428206) / Math.Sqrt((755.2409807157378 / (26)) + (86.53378160301736 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.44053934871434036 = (158.8221395746484 - 228.78954150428206) / 158.8221395746484 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Tests.Perf_DateTimeOffset.ToString(format: "r")

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 173.93722726824217 > 107.16431670330442.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.36440474462927 (T) = (0 -169.83424298003925) / Math.Sqrt((18.129451993759464 / (26)) + (25.954557579037722 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.6085889606825726 = (105.5796397533236 - 169.83424298003925) / 105.5796397533236 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SerializeToUtf8Bytes - Duration of single invocation	887.47 ns	1.08 μs	1.21	0.18	False
SerializeToWriter - Duration of single invocation	667.86 ns	731.70 ns	1.10	0.18	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToUtf8Bytes(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0751576152327877 > 935.5838233016706.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -7.468682817399374 (T) = (0 -1016.5175316526643) / Math.Sqrt((519.7275500052575 / (27)) + (2398.8535353312586 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.151078023841648 = (883.1004593937978 - 1016.5175316526643) / 883.1004593937978 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToWriter(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 731.704311959118 > 705.3623699587035.
IsChangePoint: Marked as a change because one of 2/12/2023 11:53:55 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.974632163597247 (T) = (0 -771.9629151885933) / Math.Sqrt((447.83898664754304 / (27)) + (620.4205538188147 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.16000717550699955 = (665.4811551930226 - 771.9629151885933) / 665.4811551930226 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	19.13 μs	21.61 μs	1.13	0.37	False
IDictionary - Duration of single invocation	22.45 μs	24.73 μs	1.10	0.28	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.60671390617796 > 20.798566574929012.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -6.956995543725373 (T) = (0 -23183.128504525124) / Math.Sqrt((456777.2561676089 / (26)) + (1680920.6670946893 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.1671211176700275 = (19863.51557994818 - 23183.128504525124) / 19863.51557994818 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Collections.AddGivenSize<Int32>.IDictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.73367170551581 > 23.824759150187457.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -8.734158325748593 (T) = (0 -24875.158258242445) / Math.Sqrt((580847.5664598745 / (26)) + (236023.21567706988 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -0.0868936694973256 = (22886.468986195207 - 24875.158258242445) / 22886.468986195207 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Concurrent.Count<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Queue - Duration of single invocation	34.91 ns	49.03 ns	1.40	0.63	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.Count<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.Count<String>.Queue(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.03275657354753 > 33.67584515017763.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -12.114162373984936 (T) = (0 -48.0464605880056) / Math.Sqrt((9.37542249671391 / (27)) + (9.34493475647153 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.45006706177701067 = (33.133957631674086 - 48.0464605880056) / 33.133957631674086 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndRemove<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	45.35 μs	55.83 μs	1.23	0.21	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove<Int32>*'

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndRemove<Int32>.Dictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.830668066801614 > 47.575325121941965.
IsChangePoint: Marked as a change because one of 3/18/2023 7:37:20 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.293811191028361 (T) = (0 -55091.88371980307) / Math.Sqrt((2251916.9012968033 / (27)) + (3050544.2428817907 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.19688416594316543 = (46029.41979467972 - 55091.88371980307) / 46029.41979467972 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in LinqBenchmarks

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Count00ForX - Duration of single invocation	1.13 secs	1.43 secs	1.27	0.28	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'LinqBenchmarks*'

Payloads

Baseline
Compare

Histogram

LinqBenchmarks.Count00ForX

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.4276153847692308 > 1.183564892267308.
IsChangePoint: Marked as a change because one of 3/30/2023 4:24:24 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -4.9950940343068995 (T) = (0 -1310205055.3917127) / Math.Sqrt((9272936817873614 / (27)) + (4745859030858366 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.13209335936135544 = (1157329512.2328382 - 1310205055.3917127) / 1157329512.2328382 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SerializeToUtf8Bytes - Duration of single invocation	555.32 ns	639.10 ns	1.15	0.23	False
SerializeToWriter - Duration of single invocation	379.99 ns	428.64 ns	1.13	0.23	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 639.1012164676249 > 582.6227051190327.
IsChangePoint: Marked as a change because one of 3/2/2023 11:02:42 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -8.555561076552795 (T) = (0 -631.1277873218697) / Math.Sqrt((345.3569256603991 / (27)) + (401.81376521205874 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.12058937070260267 = (563.2105781318954 - 631.1277873218697) / 563.2105781318954 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToWriter(Mode: SourceGen)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 428.63660519698243 > 401.36498754385696.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.871714498786353 (T) = (0 -445.6411899261049) / Math.Sqrt((130.56208349468855 / (27)) + (218.37793131802326 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.1604818201841259 = (384.0139347080836 - 445.6411899261049) / 384.0139347080836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	c1b7a9feb6f3b4d9ca27dc4f74d8260e4edb73e8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddDefaultSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Dictionary - Duration of single invocation	43.18 μs	53.12 μs	1.23	0.18	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryAddDefaultSize<String>.Dictionary(Count: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 53.12389285714286 > 46.18812917830048.
IsChangePoint: Marked as a change because one of 3/11/2023 1:35:17 AM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.260555353840076 (T) = (0 -52415.32367068351) / Math.Sqrt((959701.1490713658 / (27)) + (1638922.727423633 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.17939605172735673 = (44442.51241465107 - 52415.32367068351) / 44442.51241465107 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[lewing]

cc @SamMonoRT @sblom

[SamMonoRT]

Fixed via revert PR - dotnet/runtime#85048