Skip to content

Update system-tests to 15713a66e48f82b7d995cea2eb6eb78bec0270df #7539

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
PerfectSlayer merged 1 commit into from
Sep 2, 2024
Merged

Update system-tests to 15713a66e48f82b7d995cea2eb6eb78bec0270df #7539

PerfectSlayer merged 1 commit into from
Sep 2, 2024

Conversation

@PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Aug 30, 2024 •
edited
Loading

What Does This Do

This PR updates the pinned version of system tests.

Motivation

Relevant changes from system tests:

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer requested a review from a team as a code owner August 30, 2024 16:09
@PerfectSlayer PerfectSlayer requested a review from dougqh August 30, 2024 16:09
@PerfectSlayer PerfectSlayer added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Aug 30, 2024
@pr-commenter
Copy link

pr-commenter bot commented Aug 30, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/system-tests
git_commit_date 1725033924 1725033986
git_commit_sha e024c38 0969d1d
release_version 1.39.0-SNAPSHOT~e024c381c7 1.39.0-SNAPSHOT~0969d1d88b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1725036472 1725036472
ci_job_id 623240618 623240618
ci_pipeline_id 43271958 43271958
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058640
Total [baseline] (8.538 s) : 0, 8538190
Agent [candidate] (1.05 s) : 0, 1050026
Total [candidate] (8.504 s) : 0, 8504320
section iast
Agent [baseline] (1.186 s) : 0, 1185668
Total [baseline] (9.011 s) : 0, 9010556
Agent [candidate] (1.178 s) : 0, 1177797
Total [candidate] (8.998 s) : 0, 8998245
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.176 s) : 0, 1175542
Total [baseline] (8.963 s) : 0, 8963391
Agent [candidate] (1.185 s) : 0, 1184899
Total [candidate] (8.963 s) : 0, 8962967
section iast_TELEMETRY_OFF
Agent [baseline] (1.172 s) : 0, 1171500
Total [baseline] (9.002 s) : 0, 9001960
Agent [candidate] (1.174 s) : 0, 1174499
Total [candidate] (8.969 s) : 0, 8969472
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.186 s 127.028 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.176 s 116.902 ms (11.0%)
Agent iast_TELEMETRY_OFF 1.172 s 112.86 ms (10.7%)
Total tracing 8.538 s -
Total iast 9.011 s 472.365 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 8.963 s 425.201 ms (5.0%)
Total iast_TELEMETRY_OFF 9.002 s 463.77 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.178 s 127.771 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.185 s 134.874 ms (12.8%)
Agent iast_TELEMETRY_OFF 1.174 s 124.473 ms (11.9%)
Total tracing 8.504 s -
Total iast 8.998 s 493.925 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.963 s 458.647 ms (5.4%)
Total iast_TELEMETRY_OFF 8.969 s 465.152 ms (5.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (675.113 ms) : 0, 675113
BytebuddyAgent [candidate] (669.231 ms) : 0, 669231
GlobalTracer [baseline] (309.209 ms) : 0, 309209
GlobalTracer [candidate] (306.734 ms) : 0, 306734
AppSec [baseline] (52.442 ms) : 0, 52442
AppSec [candidate] (52.281 ms) : 0, 52281
Remote Config [baseline] (669.96 µs) : 0, 670
Remote Config [candidate] (672.05 µs) : 0, 672
Telemetry [baseline] (7.511 ms) : 0, 7511
Telemetry [candidate] (7.519 ms) : 0, 7519
section iast
BytebuddyAgent [baseline] (788.044 ms) : 0, 788044
BytebuddyAgent [candidate] (782.049 ms) : 0, 782049
GlobalTracer [baseline] (298.612 ms) : 0, 298612
GlobalTracer [candidate] (297.327 ms) : 0, 297327
AppSec [baseline] (54.572 ms) : 0, 54572
AppSec [candidate] (53.393 ms) : 0, 53393
IAST [baseline] (21.274 ms) : 0, 21274
IAST [candidate] (23.428 ms) : 0, 23428
Remote Config [baseline] (601.851 µs) : 0, 602
Remote Config [candidate] (588.125 µs) : 0, 588
Telemetry [baseline] (8.863 ms) : 0, 8863
Telemetry [candidate] (7.349 ms) : 0, 7349
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.783 ms) : 0, 780783
BytebuddyAgent [candidate] (787.292 ms) : 0, 787292
GlobalTracer [baseline] (296.413 ms) : 0, 296413
GlobalTracer [candidate] (299.082 ms) : 0, 299082
AppSec [baseline] (54.676 ms) : 0, 54676
AppSec [candidate] (54.911 ms) : 0, 54911
IAST [baseline] (22.066 ms) : 0, 22066
IAST [candidate] (20.348 ms) : 0, 20348
Remote Config [baseline] (583.287 µs) : 0, 583
Remote Config [candidate] (590.399 µs) : 0, 590
Telemetry [baseline] (7.365 ms) : 0, 7365
Telemetry [candidate] (8.902 ms) : 0, 8902
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (777.361 ms) : 0, 777361
BytebuddyAgent [candidate] (779.903 ms) : 0, 779903
GlobalTracer [baseline] (296.355 ms) : 0, 296355
GlobalTracer [candidate] (296.942 ms) : 0, 296942
AppSec [baseline] (54.754 ms) : 0, 54754
AppSec [candidate] (54.721 ms) : 0, 54721
IAST [baseline] (21.558 ms) : 0, 21558
IAST [candidate] (21.489 ms) : 0, 21489
Remote Config [baseline] (573.669 µs) : 0, 574
Remote Config [candidate] (578.934 µs) : 0, 579
Telemetry [baseline] (7.262 ms) : 0, 7262
Telemetry [candidate] (7.179 ms) : 0, 7179
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053655
Total [baseline] (10.383 s) : 0, 10382854
Agent [candidate] (1.057 s) : 0, 1056877
Total [candidate] (10.466 s) : 0, 10465737
section appsec
Agent [baseline] (1.186 s) : 0, 1186374
Total [baseline] (10.657 s) : 0, 10657100
Agent [candidate] (1.19 s) : 0, 1190323
Total [candidate] (10.639 s) : 0, 10638595
section iast
Agent [baseline] (1.178 s) : 0, 1178461
Total [baseline] (10.906 s) : 0, 10906319
Agent [candidate] (1.175 s) : 0, 1175257
Total [candidate] (10.862 s) : 0, 10862049
section profiling
Agent [baseline] (1.253 s) : 0, 1252501
Total [baseline] (10.608 s) : 0, 10607700
Agent [candidate] (1.266 s) : 0, 1266498
Total [candidate] (10.634 s) : 0, 10634067
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.186 s 132.719 ms (12.6%)
Agent iast 1.178 s 124.806 ms (11.8%)
Agent profiling 1.253 s 198.847 ms (18.9%)
Total tracing 10.383 s -
Total appsec 10.657 s 274.246 ms (2.6%)
Total iast 10.906 s 523.464 ms (5.0%)
Total profiling 10.608 s 224.846 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.19 s 133.446 ms (12.6%)
Agent iast 1.175 s 118.381 ms (11.2%)
Agent profiling 1.266 s 209.621 ms (19.8%)
Total tracing 10.466 s -
Total appsec 10.639 s 172.859 ms (1.7%)
Total iast 10.862 s 396.313 ms (3.8%)
Total profiling 10.634 s 168.33 ms (1.6%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (671.329 ms) : 0, 671329
BytebuddyAgent [candidate] (672.448 ms) : 0, 672448
GlobalTracer [baseline] (308.076 ms) : 0, 308076
GlobalTracer [candidate] (309.476 ms) : 0, 309476
AppSec [baseline] (52.488 ms) : 0, 52488
AppSec [candidate] (53.048 ms) : 0, 53048
Remote Config [baseline] (670.953 µs) : 0, 671
Remote Config [candidate] (699.43 µs) : 0, 699
Telemetry [baseline] (7.49 ms) : 0, 7490
Telemetry [candidate] (7.565 ms) : 0, 7565
section appsec
BytebuddyAgent [baseline] (691.715 ms) : 0, 691715
BytebuddyAgent [candidate] (694.032 ms) : 0, 694032
GlobalTracer [baseline] (301.503 ms) : 0, 301503
GlobalTracer [candidate] (301.624 ms) : 0, 301624
AppSec [baseline] (160.088 ms) : 0, 160088
AppSec [candidate] (160.86 ms) : 0, 160860
Remote Config [baseline] (612.886 µs) : 0, 613
Remote Config [candidate] (612.274 µs) : 0, 612
Telemetry [baseline] (8.906 ms) : 0, 8906
Telemetry [candidate] (8.959 ms) : 0, 8959
IAST [baseline] (19.886 ms) : 0, 19886
IAST [candidate] (21.105 ms) : 0, 21105
section iast
BytebuddyAgent [baseline] (782.627 ms) : 0, 782627
BytebuddyAgent [candidate] (780.662 ms) : 0, 780662
GlobalTracer [baseline] (297.238 ms) : 0, 297238
GlobalTracer [candidate] (296.558 ms) : 0, 296558
AppSec [baseline] (52.603 ms) : 0, 52603
AppSec [candidate] (53.09 ms) : 0, 53090
Remote Config [baseline] (602.418 µs) : 0, 602
Remote Config [candidate] (599.438 µs) : 0, 599
Telemetry [baseline] (8.142 ms) : 0, 8142
Telemetry [candidate] (8.051 ms) : 0, 8051
IAST [baseline] (23.616 ms) : 0, 23616
IAST [candidate] (22.671 ms) : 0, 22671
section profiling
BytebuddyAgent [baseline] (666.764 ms) : 0, 666764
BytebuddyAgent [candidate] (674.377 ms) : 0, 674377
GlobalTracer [baseline] (390.281 ms) : 0, 390281
GlobalTracer [candidate] (394.257 ms) : 0, 394257
AppSec [baseline] (53.126 ms) : 0, 53126
AppSec [candidate] (53.577 ms) : 0, 53577
Remote Config [baseline] (683.904 µs) : 0, 684
Remote Config [candidate] (692.704 µs) : 0, 693
Telemetry [baseline] (7.409 ms) : 0, 7409
Telemetry [candidate] (7.477 ms) : 0, 7477
ProfilingAgent [baseline] (96.287 ms) : 0, 96287
ProfilingAgent [candidate] (97.664 ms) : 0, 97664
Profiling [baseline] (96.31 ms) : 0, 96310
Profiling [candidate] (97.688 ms) : 0, 97688
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-30T16:18:27 2024-08-30T16:25:17
git_branch master bbujon/system-tests
git_commit_date 1725033924 1725033986
git_commit_sha e024c38 0969d1d
release_version 1.39.0-SNAPSHOT~e024c381c7 1.39.0-SNAPSHOT~0969d1d88b
start_time 2024-08-30T16:18:13 2024-08-30T16:25:04
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1725035465 1725035465
ci_job_id 623240620 623240620
ci_pipeline_id 43271958 43271958
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7
    dateFormat X
    axisFormat %s
section baseline
no_agent (368.317 µs) : 349, 388
.   : milestone, 368,
iast (484.934 µs) : 463, 507
.   : milestone, 485,
iast_FULL (559.722 µs) : 539, 581
.   : milestone, 560,
iast_GLOBAL (501.617 µs) : 481, 523
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (489.515 µs) : 467, 512
.   : milestone, 490,
iast_INACTIVE (451.658 µs) : 430, 473
.   : milestone, 452,
iast_TELEMETRY_OFF (479.061 µs) : 457, 501
.   : milestone, 479,
tracing (445.808 µs) : 425, 466
.   : milestone, 446,
section candidate
no_agent (371.114 µs) : 352, 390
.   : milestone, 371,
iast (479.536 µs) : 457, 502
.   : milestone, 480,
iast_FULL (561.854 µs) : 540, 583
.   : milestone, 562,
iast_GLOBAL (515.625 µs) : 493, 538
.   : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (489.945 µs) : 468, 512
.   : milestone, 490,
iast_INACTIVE (453.604 µs) : 433, 475
.   : milestone, 454,
iast_TELEMETRY_OFF (481.935 µs) : 459, 505
.   : milestone, 482,
tracing (452.205 µs) : 430, 474
.   : milestone, 452,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.317 µs [348.871 µs, 387.763 µs] -
iast 484.934 µs [463.045 µs, 506.823 µs] 116.617 µs (31.7%)
iast_FULL 559.722 µs [538.596 µs, 580.848 µs] 191.405 µs (52.0%)
iast_GLOBAL 501.617 µs [480.67 µs, 522.564 µs] 133.3 µs (36.2%)
iast_HARDCODED_SECRET_DISABLED 489.515 µs [467.124 µs, 511.906 µs] 121.197 µs (32.9%)
iast_INACTIVE 451.658 µs [430.384 µs, 472.933 µs] 83.341 µs (22.6%)
iast_TELEMETRY_OFF 479.061 µs [456.662 µs, 501.46 µs] 110.744 µs (30.1%)
tracing 445.808 µs [425.403 µs, 466.213 µs] 77.491 µs (21.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.114 µs [351.759 µs, 390.469 µs] -
iast 479.536 µs [457.348 µs, 501.724 µs] 108.422 µs (29.2%)
iast_FULL 561.854 µs [540.439 µs, 583.27 µs] 190.74 µs (51.4%)
iast_GLOBAL 515.625 µs [492.75 µs, 538.499 µs] 144.511 µs (38.9%)
iast_HARDCODED_SECRET_DISABLED 489.945 µs [467.739 µs, 512.152 µs] 118.831 µs (32.0%)
iast_INACTIVE 453.604 µs [432.548 µs, 474.66 µs] 82.49 µs (22.2%)
iast_TELEMETRY_OFF 481.935 µs [459.281 µs, 504.589 µs] 110.821 µs (29.9%)
tracing 452.205 µs [430.408 µs, 474.003 µs] 81.091 µs (21.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.37 ms) : 1351, 1390
.   : milestone, 1370,
appsec (1.725 ms) : 1702, 1749
.   : milestone, 1725,
appsec_no_iast (1.754 ms) : 1730, 1778
.   : milestone, 1754,
iast (1.472 ms) : 1449, 1495
.   : milestone, 1472,
profiling (1.482 ms) : 1458, 1505
.   : milestone, 1482,
tracing (1.476 ms) : 1452, 1500
.   : milestone, 1476,
section candidate
no_agent (1.37 ms) : 1351, 1389
.   : milestone, 1370,
appsec (1.748 ms) : 1725, 1772
.   : milestone, 1748,
appsec_no_iast (1.727 ms) : 1702, 1752
.   : milestone, 1727,
iast (1.47 ms) : 1447, 1493
.   : milestone, 1470,
profiling (1.523 ms) : 1499, 1548
.   : milestone, 1523,
tracing (1.482 ms) : 1458, 1507
.   : milestone, 1482,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.351 ms, 1.39 ms] -
appsec 1.725 ms [1.702 ms, 1.749 ms] 354.909 µs (25.9%)
appsec_no_iast 1.754 ms [1.73 ms, 1.778 ms] 383.914 µs (28.0%)
iast 1.472 ms [1.449 ms, 1.495 ms] 101.485 µs (7.4%)
profiling 1.482 ms [1.458 ms, 1.505 ms] 111.306 µs (8.1%)
tracing 1.476 ms [1.452 ms, 1.5 ms] 105.57 µs (7.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.351 ms, 1.389 ms] -
appsec 1.748 ms [1.725 ms, 1.772 ms] 378.617 µs (27.6%)
appsec_no_iast 1.727 ms [1.702 ms, 1.752 ms] 356.993 µs (26.1%)
iast 1.47 ms [1.447 ms, 1.493 ms] 100.451 µs (7.3%)
profiling 1.523 ms [1.499 ms, 1.548 ms] 153.4 µs (11.2%)
tracing 1.482 ms [1.458 ms, 1.507 ms] 112.357 µs (8.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/system-tests
git_commit_date 1725033924 1725033986
git_commit_sha e024c38 0969d1d
release_version 1.39.0-SNAPSHOT~e024c381c7 1.39.0-SNAPSHOT~0969d1d88b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1725035861 1725035861
ci_job_id 623240622 623240622
ci_pipeline_id 43271958 43271958
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.238 ms) : 2202, 2273
.   : milestone, 2238,
iast (1.965 ms) : 1923, 2006
.   : milestone, 1965,
iast_GLOBAL (2.019 ms) : 1976, 2063
.   : milestone, 2019,
profiling (1.854 ms) : 1820, 1888
.   : milestone, 1854,
tracing (1.846 ms) : 1813, 1878
.   : milestone, 1846,
section candidate
no_agent (1.458 ms) : 1447, 1469
.   : milestone, 1458,
appsec (2.22 ms) : 2185, 2255
.   : milestone, 2220,
iast (1.976 ms) : 1933, 2018
.   : milestone, 1976,
iast_GLOBAL (2.021 ms) : 1978, 2064
.   : milestone, 2021,
profiling (1.86 ms) : 1825, 1896
.   : milestone, 1860,
tracing (1.835 ms) : 1803, 1868
.   : milestone, 1835,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.476 ms] -
appsec 2.238 ms [2.202 ms, 2.273 ms] 773.066 µs (52.8%)
iast 1.965 ms [1.923 ms, 2.006 ms] 500.088 µs (34.1%)
iast_GLOBAL 2.019 ms [1.976 ms, 2.063 ms] 555.043 µs (37.9%)
profiling 1.854 ms [1.82 ms, 1.888 ms] 389.67 µs (26.6%)
tracing 1.846 ms [1.813 ms, 1.878 ms] 381.1 µs (26.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.458 ms [1.447 ms, 1.469 ms] -
appsec 2.22 ms [2.185 ms, 2.255 ms] 761.597 µs (52.2%)
iast 1.976 ms [1.933 ms, 2.018 ms] 517.563 µs (35.5%)
iast_GLOBAL 2.021 ms [1.978 ms, 2.064 ms] 563.011 µs (38.6%)
profiling 1.86 ms [1.825 ms, 1.896 ms] 402.233 µs (27.6%)
tracing 1.835 ms [1.803 ms, 1.868 ms] 377.424 µs (25.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~0969d1d88b, baseline=1.39.0-SNAPSHOT~e024c381c7
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.249 s) : 15249000, 15249000
.   : milestone, 15249000,
appsec (15.074 s) : 15074000, 15074000
.   : milestone, 15074000,
iast (18.603 s) : 18603000, 18603000
.   : milestone, 18603000,
iast_GLOBAL (18.156 s) : 18156000, 18156000
.   : milestone, 18156000,
profiling (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
tracing (15.083 s) : 15083000, 15083000
.   : milestone, 15083000,
section candidate
no_agent (15.379 s) : 15379000, 15379000
.   : milestone, 15379000,
appsec (15.141 s) : 15141000, 15141000
.   : milestone, 15141000,
iast (18.84 s) : 18840000, 18840000
.   : milestone, 18840000,
iast_GLOBAL (17.94 s) : 17940000, 17940000
.   : milestone, 17940000,
profiling (15.369 s) : 15369000, 15369000
.   : milestone, 15369000,
tracing (14.803 s) : 14803000, 14803000
.   : milestone, 14803000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.249 s [15.249 s, 15.249 s] -
appsec 15.074 s [15.074 s, 15.074 s] -175.0 ms (-1.1%)
iast 18.603 s [18.603 s, 18.603 s] 3.354 s (22.0%)
iast_GLOBAL 18.156 s [18.156 s, 18.156 s] 2.907 s (19.1%)
profiling 14.979 s [14.979 s, 14.979 s] -270.0 ms (-1.8%)
tracing 15.083 s [15.083 s, 15.083 s] -166.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.379 s [15.379 s, 15.379 s] -
appsec 15.141 s [15.141 s, 15.141 s] -238.0 ms (-1.5%)
iast 18.84 s [18.84 s, 18.84 s] 3.461 s (22.5%)
iast_GLOBAL 17.94 s [17.94 s, 17.94 s] 2.561 s (16.7%)
profiling 15.369 s [15.369 s, 15.369 s] -10.0 ms (-0.1%)
tracing 14.803 s [14.803 s, 14.803 s] -576.0 ms (-3.7%)

@PerfectSlayer PerfectSlayer merged commit 09922b0 into master Sep 2, 2024
@PerfectSlayer PerfectSlayer deleted the bbujon/system-tests branch September 2, 2024 06:58
@PerfectSlayer PerfectSlayer added this to the 1.39.0 milestone Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@smola smola smola approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh was automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.39.0

Development

Successfully merging this pull request may close these issues.

3 participants

@PerfectSlayer @smola