[Perf] Linux/x64: 10 Improvements on 10/18/2022 8:25:03 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	e8fa4a736d6bdcfbbe2c2dc1dd1303214bb97085
Compare	51e3afb2ba42609c3711cb50fb5eaa6800bc1fde
Diff	Diff

Improvements in System.IO.Tests.Perf_File

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CopyTo - Duration of single invocation	75.59 μs	39.15 μs	0.52	0.01	False
ReadAllBytesAsync - Duration of single invocation	42.79 μs	25.84 μs	0.60	0.01	False
ReadAllBytes - Duration of single invocation	26.00 μs	13.05 μs	0.50	0.02	False
ReadAllBytesAsync - Duration of single invocation	43.79 μs	26.66 μs	0.61	0.01	False
ReadAllBytes - Duration of single invocation	26.15 μs	12.41 μs	0.47	0.02	False
ReadAllBytes - Duration of single invocation	33.71 μs	20.15 μs	0.60	0.02	False
ReadAllBytesAsync - Duration of single invocation	51.69 μs	39.07 μs	0.76	0.01	False
CopyToOverwrite - Duration of single invocation	70.11 μs	43.25 μs	0.62	0.22	False
CopyToOverwrite - Duration of single invocation	67.91 μs	43.28 μs	0.64	0.24	False
CopyTo - Duration of single invocation	76.25 μs	39.72 μs	0.52	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_File*'

Related Issues

Regressions

• [Perf] Windows/x64: 4 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Windows/x64: 4 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Windows/x86: 2 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Linux/arm64: 2 Regressions on 10/18/2022 8:25:03 PM

Improvements

• [Perf] Linux/x64: 8 Improvements on 10/18/2022 8:25:03 PM
• [Perf] Alpine/x64: 8 Improvements on 10/18/2022 8:25:03 PM
• [Perf] Linux/arm64: 3 Improvements on 10/18/2022 8:25:03 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.IO.Tests.Perf_File.CopyTo(size: 4096)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.150633816120916 < 71.84401591255289.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 14.3061234037783 (T) = (0 -39715.9555604852) / Math.Sqrt((279148102.3694047 / (299)) + (308022.2520744802 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.259614488086071 = (53642.26463294469 - 39715.9555604852) / 53642.26463294469 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytesAsync(size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.836639873621866 < 40.618308947081765.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 16.124072222210813 (T) = (0 -26083.835993124292) / Math.Sqrt((55145813.88359867 / (299)) + (50251.7664798814 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.21080506522121858 = (33051.19539374113 - 26083.835993124292) / 33051.19539374113 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytes(size: 4096)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.049121371612024 < 24.756577181856734.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 14.650738602304518 (T) = (0 -13184.51936886617) / Math.Sqrt((34497205.51733876 / (299)) + (39414.91803283076 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.27555257756554236 = (18199.415113605435 - 13184.51936886617) / 18199.415113605435 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytesAsync(size: 4096)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 26.655644030351045 < 41.56744789810875.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 16.142373551982914 (T) = (0 -26729.179063174837) / Math.Sqrt((55908611.636986084 / (299)) + (74909.06738308154 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.20855663176685163 = (33772.699520935006 - 26729.179063174837) / 33772.699520935006 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytes(size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 12.406815765244945 < 24.459137876122472.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 14.854441950381034 (T) = (0 -12710.916404229669) / Math.Sqrt((34954680.76266993 / (299)) + (35281.85033382047 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.28688824510998884 = (17824.578429772446 - 12710.916404229669) / 17824.578429772446 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytes(size: 16384)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 20.148266353686633 < 32.01234561441408.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 14.593548330484863 (T) = (0 -20771.669463955113) / Math.Sqrt((35556959.71023124 / (299)) + (117550.09156242856 / (21))) is greater than 1.967451947860886 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (21) - 2, .975) and 0.1986638848379832 = (25921.29453663202 - 20771.669463955113) / 25921.29453663202 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytesAsync(size: 16384)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.06931820175438 < 49.01322972153464.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 18.36427021562263 (T) = (0 -39139.562934854606) / Math.Sqrt((29616184.70406068 / (299)) + (263395.4354419129 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.13520101426318937 = (45258.56711257312 - 39139.562934854606) / 45258.56711257312 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.CopyToOverwrite(size: 4096)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.24508769248189 < 66.51099689376801.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 15.627011759138295 (T) = (0 -42941.07010318838) / Math.Sqrt((128397953.65805656 / (299)) + (188688.976894298 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.19409871370736878 = (53283.28770975063 - 42941.07010318838) / 53283.28770975063 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.CopyToOverwrite(size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 43.278942297453696 < 63.68111457378137.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 11.67363721075605 (T) = (0 -44336.94167284352) / Math.Sqrt((128030417.48127444 / (299)) + (3454077.2195809213 / (21))) is greater than 1.967451947860886 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (21) - 2, .975) and 0.16853587781628962 = (53323.93844775825 - 44336.94167284352) / 53323.93844775825 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.CopyTo(size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.72466479007633 < 72.28256367772624.
IsChangePoint: Marked as a change because one of 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 2:56:59 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 2:56:59 AM.
IsImprovementStdDev: Marked as improvement because 14.442371562704123 (T) = (0 -39607.91971607612) / Math.Sqrt((279432891.098475 / (299)) + (217786.31862666697 / (22))) is greater than 1.9674283869023508 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (22) - 2, .975) and 0.261645213925497 = (53643.47934500897 - 39607.91971607612) / 53643.47934500897 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository