[Perf] Linux/x64: 6 Improvements on 10/11/2023 2:25:16 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	c9b5dd4850a824cd927eb41e6084f07669a979e9
Compare	7c82eaafe6c67cfd85cb213cd5647e50074fb48e
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in Microsoft.Extensions.Logging.EventSourceLogger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
NestedScopes_TwoMessages - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	16.63 μs	1.21 μs	0.07	0.20	False
NestedScopes_TwoMessages - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	43.03 μs	1.20 μs	0.03	0.22	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Logging.EventSourceLogger*'

Payloads

Baseline
Compare

Microsoft.Extensions.Logging.EventSourceLogger.NestedScopes_TwoMessages(HasSubscribers: True, Json: False)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.210204725554344 < 15.677364590811264.
IsChangePoint: Marked as a change because one of 10/10/2023 11:35:22 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 95.81007481482159 (T) = (0 -1185.5824893554275) / Math.Sqrt((6197123.252615403 / (221)) + (454.69110529211014 / (3))) is greater than 1.9707073953201992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (221) + (3) - 2, .975) and 0.9313612586613865 = (17272.788897841656 - 1185.5824893554275) / 17272.788897841656 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Microsoft.Extensions.Logging.EventSourceLogger.NestedScopes_TwoMessages(HasSubscribers: True, Json: True)

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.1979433975353584 < 40.91950806305418.
IsChangePoint: Marked as a change because one of 10/10/2023 11:35:22 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 231.54086470455425 (T) = (0 -1198.171384365283) / Math.Sqrt((7169050.147343849 / (221)) + (650.2537155425922 / (3))) is greater than 1.9707073953201992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (221) + (3) - 2, .975) and 0.9721613066462113 = (43039.785277932744 - 1198.171384365283) / 43039.785277932744 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	c9b5dd4850a824cd927eb41e6084f07669a979e9
Compare	7c82eaafe6c67cfd85cb213cd5647e50074fb48e
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Improvements in System.Diagnostics.Tracing.Perf_EventListener

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
WriteEvent_MixedParams - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.07 μs	81.63 ns	0.08	0.27	False
WriteEvent_IntParams - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	794.22 ns	22.67 ns	0.03	0.41	False
WriteEvent_NoParams - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	409.74 ns	27.84 ns	0.07	0.41	False
WriteEvent_StringParams - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.14 μs	30.95 ns	0.03	0.28	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Diagnostics.Tracing.Perf_EventListener*'

Payloads

Baseline
Compare

System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_MixedParams

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 81.6296761763737 < 1.021308636830812.
IsChangePoint: Marked as a change because one of 10/10/2023 11:35:22 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 76.93297864468127 (T) = (0 -85.78752037831202) / Math.Sqrt((36173.26183506537 / (221)) + (22.550896903738234 / (3))) is greater than 1.9707073953201992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (221) + (3) - 2, .975) and 0.9214684598062228 = (1092.3957452843879 - 85.78752037831202) / 1092.3957452843879 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_IntParams

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 22.67129153439561 < 767.6550596832245.
IsChangePoint: Marked as a change because one of 10/10/2023 11:35:22 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 94.19918965549233 (T) = (0 -22.466542600136194) / Math.Sqrt((16211.422009352016 / (219)) + (0.35510329736927876 / (3))) is greater than 1.970805592384696 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (219) + (3) - 2, .975) and 0.9730481873588958 = (833.5818781209719 - 22.466542600136194) / 833.5818781209719 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_NoParams

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 27.84096980228188 < 390.1029900933703.
IsChangePoint: Marked as a change because one of 10/10/2023 11:35:22 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 60.18279783407417 (T) = (0 -27.697066613605532) / Math.Sqrt((10648.085622922774 / (222)) + (0.015735788297354808 / (3))) is greater than 1.9706589608356722 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (222) + (3) - 2, .975) and 0.9376927028059335 = (444.52364106468 - 27.697066613605532) / 444.52364106468 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

System.Diagnostics.Tracing.Perf_EventListener.WriteEvent_StringParams

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 30.953643955390135 < 1.0269810442313607.
IsChangePoint: Marked as a change because one of 10/10/2023 11:35:22 PM, 10/11/2023 8:44:35 PM falls between 10/3/2023 8:20:31 AM and 10/11/2023 8:44:35 PM.
IsImprovementStdDev: Marked as improvement because 65.7475028136293 (T) = (0 -31.006787214962486) / Math.Sqrt((64345.711519108896 / (221)) + (0.2153132017382178 / (3))) is greater than 1.9707073953201992 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (221) + (3) - 2, .975) and 0.9731081048955772 = (1153.0160702531878 - 31.006787214962486) / 1153.0160702531878 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository