-
Notifications
You must be signed in to change notification settings - Fork 322
Update Maven smoke test fixtures with coverage report upload capability #9446
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
nikita-tkachenko-datadog
merged 1 commit into
master
from
nikita-tkachenko/smoke-tests-fixtures
Sep 1, 2025
Merged
Update Maven smoke test fixtures with coverage report upload capability #9446
nikita-tkachenko-datadog
merged 1 commit into
master
from
nikita-tkachenko/smoke-tests-fixtures
Sep 1, 2025
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
daniel-mohedano
approved these changes
Sep 1, 2025
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1049555
Total [baseline] (10.712 s) : 0, 10711564
Agent [candidate] (1.048 s) : 0, 1048160
Total [candidate] (10.822 s) : 0, 10821562
section appsec
Agent [baseline] (1.222 s) : 0, 1221853
Total [baseline] (10.807 s) : 0, 10807108
Agent [candidate] (1.22 s) : 0, 1220333
Total [candidate] (10.775 s) : 0, 10774857
section iast
Agent [baseline] (1.178 s) : 0, 1177997
Total [baseline] (10.906 s) : 0, 10906439
Agent [candidate] (1.187 s) : 0, 1186938
Total [candidate] (10.988 s) : 0, 10988382
section profiling
Agent [baseline] (1.198 s) : 0, 1198073
Total [baseline] (10.926 s) : 0, 10926095
Agent [candidate] (1.205 s) : 0, 1205399
Total [candidate] (10.88 s) : 0, 10879692
gantt
title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (734.38 ms) : 0, 734380
BytebuddyAgent [candidate] (733.118 ms) : 0, 733118
GlobalTracer [baseline] (242.725 ms) : 0, 242725
GlobalTracer [candidate] (243.332 ms) : 0, 243332
AppSec [baseline] (30.047 ms) : 0, 30047
AppSec [candidate] (30.202 ms) : 0, 30202
Debugger [baseline] (6.071 ms) : 0, 6071
Debugger [candidate] (6.07 ms) : 0, 6070
Remote Config [baseline] (671.594 µs) : 0, 672
Remote Config [candidate] (666.99 µs) : 0, 667
Telemetry [baseline] (13.051 ms) : 0, 13051
Telemetry [candidate] (12.206 ms) : 0, 12206
section appsec
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (754.31 ms) : 0, 754310
BytebuddyAgent [candidate] (753.073 ms) : 0, 753073
GlobalTracer [baseline] (234.624 ms) : 0, 234624
GlobalTracer [candidate] (235.128 ms) : 0, 235128
AppSec [baseline] (170.304 ms) : 0, 170304
AppSec [candidate] (169.062 ms) : 0, 169062
Debugger [baseline] (6.598 ms) : 0, 6598
Debugger [candidate] (6.488 ms) : 0, 6488
Remote Config [baseline] (641.371 µs) : 0, 641
Remote Config [candidate] (639.445 µs) : 0, 639
Telemetry [baseline] (9.114 ms) : 0, 9114
Telemetry [candidate] (9.911 ms) : 0, 9911
IAST [baseline] (23.662 ms) : 0, 23662
IAST [candidate] (23.484 ms) : 0, 23484
section iast
crashtracking [baseline] (1.44 ms) : 0, 1440
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (850.412 ms) : 0, 850412
BytebuddyAgent [candidate] (857.236 ms) : 0, 857236
GlobalTracer [baseline] (233.864 ms) : 0, 233864
GlobalTracer [candidate] (234.253 ms) : 0, 234253
AppSec [baseline] (25.057 ms) : 0, 25057
AppSec [candidate] (26.868 ms) : 0, 26868
Debugger [baseline] (7.439 ms) : 0, 7439
Debugger [candidate] (6.599 ms) : 0, 6599
Remote Config [baseline] (612.443 µs) : 0, 612
Remote Config [candidate] (606.487 µs) : 0, 606
Telemetry [baseline] (8.163 ms) : 0, 8163
Telemetry [candidate] (8.402 ms) : 0, 8402
IAST [baseline] (29.976 ms) : 0, 29976
IAST [candidate] (30.31 ms) : 0, 30310
section profiling
ProfilingAgent [baseline] (108.429 ms) : 0, 108429
ProfilingAgent [candidate] (108.363 ms) : 0, 108363
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.451 ms) : 0, 1451
BytebuddyAgent [baseline] (762.486 ms) : 0, 762486
BytebuddyAgent [candidate] (767.018 ms) : 0, 767018
GlobalTracer [baseline] (222.43 ms) : 0, 222430
GlobalTracer [candidate] (223.992 ms) : 0, 223992
AppSec [baseline] (30.048 ms) : 0, 30048
AppSec [candidate] (30.225 ms) : 0, 30225
Debugger [baseline] (6.264 ms) : 0, 6264
Debugger [candidate] (6.348 ms) : 0, 6348
Remote Config [baseline] (716.371 µs) : 0, 716
Remote Config [candidate] (712.331 µs) : 0, 712
Telemetry [baseline] (15.778 ms) : 0, 15778
Telemetry [candidate] (15.747 ms) : 0, 15747
Profiling [baseline] (109.064 ms) : 0, 109064
Profiling [candidate] (109.798 ms) : 0, 109798
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1050990
Total [baseline] (8.638 s) : 0, 8637905
Agent [candidate] (1.054 s) : 0, 1053827
Total [candidate] (8.616 s) : 0, 8616344
section iast
Agent [baseline] (1.191 s) : 0, 1191188
Total [baseline] (9.345 s) : 0, 9345423
Agent [candidate] (1.183 s) : 0, 1182667
Total [candidate] (9.373 s) : 0, 9373486
gantt
title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.468 ms) : 0, 1468
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (734.737 ms) : 0, 734737
BytebuddyAgent [candidate] (736.893 ms) : 0, 736893
GlobalTracer [baseline] (243.741 ms) : 0, 243741
GlobalTracer [candidate] (244.054 ms) : 0, 244054
AppSec [baseline] (30.129 ms) : 0, 30129
AppSec [candidate] (30.473 ms) : 0, 30473
Debugger [baseline] (6.077 ms) : 0, 6077
Debugger [candidate] (6.105 ms) : 0, 6105
Remote Config [baseline] (677.853 µs) : 0, 678
Remote Config [candidate] (680.406 µs) : 0, 680
Telemetry [baseline] (13.115 ms) : 0, 13115
Telemetry [candidate] (13.078 ms) : 0, 13078
section iast
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (860.004 ms) : 0, 860004
BytebuddyAgent [candidate] (853.024 ms) : 0, 853024
GlobalTracer [baseline] (234.701 ms) : 0, 234701
GlobalTracer [candidate] (233.758 ms) : 0, 233758
AppSec [baseline] (28.828 ms) : 0, 28828
AppSec [candidate] (25.497 ms) : 0, 25497
Debugger [baseline] (6.621 ms) : 0, 6621
Debugger [candidate] (7.499 ms) : 0, 7499
Remote Config [baseline] (603.511 µs) : 0, 604
Remote Config [candidate] (606.19 µs) : 0, 606
Telemetry [baseline] (8.5 ms) : 0, 8500
Telemetry [candidate] (8.306 ms) : 0, 8306
IAST [baseline] (29.191 ms) : 0, 29191
IAST [candidate] (31.485 ms) : 0, 31485
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section baseline
no_agent (37.365 ms) : 37058, 37673
. : milestone, 37365,
appsec (48.646 ms) : 48228, 49064
. : milestone, 48646,
code_origins (44.597 ms) : 44215, 44980
. : milestone, 44597,
iast (45.906 ms) : 45491, 46321
. : milestone, 45906,
profiling (49.311 ms) : 48862, 49760
. : milestone, 49311,
tracing (44.792 ms) : 44407, 45177
. : milestone, 44792,
section candidate
no_agent (36.944 ms) : 36641, 37247
. : milestone, 36944,
appsec (47.256 ms) : 46823, 47688
. : milestone, 47256,
code_origins (45.128 ms) : 44730, 45526
. : milestone, 45128,
iast (45.325 ms) : 44931, 45719
. : milestone, 45325,
profiling (48.53 ms) : 48039, 49021
. : milestone, 48530,
tracing (44.214 ms) : 43837, 44590
. : milestone, 44214,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section baseline
no_agent (4.521 ms) : 4468, 4574
. : milestone, 4521,
iast (9.588 ms) : 9420, 9756
. : milestone, 9588,
iast_FULL (14.019 ms) : 13741, 14297
. : milestone, 14019,
iast_GLOBAL (10.044 ms) : 9868, 10221
. : milestone, 10044,
profiling (8.575 ms) : 8438, 8712
. : milestone, 8575,
tracing (7.657 ms) : 7550, 7764
. : milestone, 7657,
section candidate
no_agent (4.41 ms) : 4358, 4462
. : milestone, 4410,
iast (9.183 ms) : 9026, 9340
. : milestone, 9183,
iast_FULL (13.832 ms) : 13557, 14107
. : milestone, 13832,
iast_GLOBAL (10.681 ms) : 10491, 10871
. : milestone, 10681,
profiling (9.078 ms) : 8929, 9226
. : milestone, 9078,
tracing (7.643 ms) : 7532, 7754
. : milestone, 7643,
DacapoParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section baseline
no_agent (15.008 s) : 15008000, 15008000
. : milestone, 15008000,
appsec (14.896 s) : 14896000, 14896000
. : milestone, 14896000,
iast (18.413 s) : 18413000, 18413000
. : milestone, 18413000,
iast_GLOBAL (17.879 s) : 17879000, 17879000
. : milestone, 17879000,
profiling (15.153 s) : 15153000, 15153000
. : milestone, 15153000,
tracing (14.697 s) : 14697000, 14697000
. : milestone, 14697000,
section candidate
no_agent (15.606 s) : 15606000, 15606000
. : milestone, 15606000,
appsec (14.953 s) : 14953000, 14953000
. : milestone, 14953000,
iast (18.32 s) : 18320000, 18320000
. : milestone, 18320000,
iast_GLOBAL (17.835 s) : 17835000, 17835000
. : milestone, 17835000,
profiling (15.514 s) : 15514000, 15514000
. : milestone, 15514000,
tracing (14.962 s) : 14962000, 14962000
. : milestone, 14962000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~422add76d8, baseline=1.53.0-SNAPSHOT~7224c81311
dateFormat X
axisFormat %s
section baseline
no_agent (1.47 ms) : 1458, 1481
. : milestone, 1470,
appsec (3.657 ms) : 3441, 3873
. : milestone, 3657,
iast (2.185 ms) : 2122, 2247
. : milestone, 2185,
iast_GLOBAL (2.235 ms) : 2172, 2298
. : milestone, 2235,
profiling (2.039 ms) : 1988, 2089
. : milestone, 2039,
tracing (2.015 ms) : 1966, 2064
. : milestone, 2015,
section candidate
no_agent (1.47 ms) : 1458, 1481
. : milestone, 1470,
appsec (2.397 ms) : 2347, 2447
. : milestone, 2397,
iast (2.189 ms) : 2127, 2252
. : milestone, 2189,
iast_GLOBAL (2.236 ms) : 2173, 2299
. : milestone, 2236,
profiling (2.061 ms) : 2009, 2114
. : milestone, 2061,
tracing (2.006 ms) : 1958, 2055
. : milestone, 2006,
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
comp: ci visibility
Continuous Integration Visibility
comp: testing
Testing
tag: no release notes
Changes to exclude from release notes
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Updates Maven smoke test fixtures with new coverage report upload capability introduced in #9425
Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any usefull labelsclose,fixor any linking keywords when referencing an issue.Use
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]