Skip to content

Mark virtual thread tests as flaky #10122

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
PerfectSlayer merged 1 commit into from
Dec 9, 2025
Merged

Mark virtual thread tests as flaky #10122

PerfectSlayer merged 1 commit into from
Dec 9, 2025

Conversation

@PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Dec 9, 2025 •
edited by atlassian bot
Loading

What Does This Do

Disabling flaky tests.

Motivation

There is a class loading deadlock with Groovy dynamic code generation. This should not impact customers so I left the instrumentation enabled by default.

Additional Notes

Refers to #10040

Contributor Checklist

Jira ticket: APMLP-782

@PerfectSlayer PerfectSlayer added the tag: no release notes Changes to exclude from release notes label Dec 9, 2025
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner December 9, 2025 14:01
@PerfectSlayer PerfectSlayer added tag: flaky test Flaky tests tag: flaky test/disabled Disabled flaky tests inst: java Core Java language instrumentation labels Dec 9, 2025
@PerfectSlayer PerfectSlayer enabled auto-merge (squash) December 9, 2025 14:09
@pr-commenter
Copy link

pr-commenter bot commented Dec 9, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/virtual-threads
git_commit_date 1765270216 1765288506
git_commit_sha ea52d2d df052db
release_version 1.57.0-SNAPSHOT~ea52d2d1fb 1.57.0-SNAPSHOT~df052db0e6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765290624 1765290624
ci_job_id 1279530681 1279530681
ci_pipeline_id 85584037 85584037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gkhpc5w1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gkhpc5w1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 6 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config better
[-73.052µs; -13.677µs] or [-10.984%; -2.056%]		 621.730µs 665.095µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080911
Total [baseline] (10.792 s) : 0, 10791739
Agent [candidate] (1.083 s) : 0, 1082742
Total [candidate] (11.062 s) : 0, 11061785
section appsec
Agent [baseline] (1.268 s) : 0, 1267761
Total [baseline] (11.166 s) : 0, 11166305
Agent [candidate] (1.266 s) : 0, 1265528
Total [candidate] (11.095 s) : 0, 11094576
section iast
Agent [baseline] (1.232 s) : 0, 1232061
Total [baseline] (11.223 s) : 0, 11223196
Agent [candidate] (1.222 s) : 0, 1221863
Total [candidate] (11.12 s) : 0, 11120116
section profiling
Agent [baseline] (1.207 s) : 0, 1207197
Total [baseline] (11.087 s) : 0, 11086572
Agent [candidate] (1.213 s) : 0, 1212616
Total [candidate] (11.054 s) : 0, 11054431
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.268 s 186.849 ms (17.3%)
Agent iast 1.232 s 151.15 ms (14.0%)
Agent profiling 1.207 s 126.286 ms (11.7%)
Total tracing 10.792 s -
Total appsec 11.166 s 374.565 ms (3.5%)
Total iast 11.223 s 431.456 ms (4.0%)
Total profiling 11.087 s 294.832 ms (2.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.083 s -
Agent appsec 1.266 s 182.787 ms (16.9%)
Agent iast 1.222 s 139.122 ms (12.8%)
Agent profiling 1.213 s 129.874 ms (12.0%)
Total tracing 11.062 s -
Total appsec 11.095 s 32.791 ms (0.3%)
Total iast 11.12 s 58.33 ms (0.5%)
Total profiling 11.054 s -7.354 ms (-0.1%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (648.189 ms) : 0, 648189
BytebuddyAgent [candidate] (650.143 ms) : 0, 650143
GlobalTracer [baseline] (281.735 ms) : 0, 281735
GlobalTracer [candidate] (282.464 ms) : 0, 282464
AppSec [baseline] (32.291 ms) : 0, 32291
AppSec [candidate] (32.239 ms) : 0, 32239
Debugger [baseline] (68.562 ms) : 0, 68562
Debugger [candidate] (67.721 ms) : 0, 67721
Remote Config [baseline] (654.277 µs) : 0, 654
Remote Config [candidate] (626.793 µs) : 0, 627
Telemetry [baseline] (9.044 ms) : 0, 9044
Telemetry [candidate] (9.024 ms) : 0, 9024
Flare Poller [baseline] (3.751 ms) : 0, 3751
Flare Poller [candidate] (3.755 ms) : 0, 3755
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (691.017 ms) : 0, 691017
BytebuddyAgent [candidate] (689.131 ms) : 0, 689131
GlobalTracer [baseline] (259.798 ms) : 0, 259798
GlobalTracer [candidate] (260.011 ms) : 0, 260011
AppSec [baseline] (175.124 ms) : 0, 175124
AppSec [candidate] (174.019 ms) : 0, 174019
Debugger [baseline] (66.523 ms) : 0, 66523
Debugger [candidate] (67.269 ms) : 0, 67269
Remote Config [baseline] (714.678 µs) : 0, 715
Remote Config [candidate] (714.431 µs) : 0, 714
Telemetry [baseline] (9.163 ms) : 0, 9163
Telemetry [candidate] (9.147 ms) : 0, 9147
Flare Poller [baseline] (3.945 ms) : 0, 3945
Flare Poller [candidate] (3.984 ms) : 0, 3984
IAST [baseline] (24.726 ms) : 0, 24726
IAST [candidate] (24.514 ms) : 0, 24514
section iast
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (796.522 ms) : 0, 796522
BytebuddyAgent [candidate] (789.766 ms) : 0, 789766
GlobalTracer [baseline] (257.051 ms) : 0, 257051
GlobalTracer [candidate] (255.193 ms) : 0, 255193
AppSec [baseline] (34.723 ms) : 0, 34723
AppSec [candidate] (35.273 ms) : 0, 35273
Debugger [baseline] (67.182 ms) : 0, 67182
Debugger [candidate] (65.672 ms) : 0, 65672
Remote Config [baseline] (548.909 µs) : 0, 549
Remote Config [candidate] (545.864 µs) : 0, 546
Telemetry [baseline] (8.419 ms) : 0, 8419
Telemetry [candidate] (8.343 ms) : 0, 8343
Flare Poller [baseline] (3.422 ms) : 0, 3422
Flare Poller [candidate] (3.426 ms) : 0, 3426
IAST [baseline] (27.377 ms) : 0, 27377
IAST [candidate] (27.1 ms) : 0, 27100
section profiling
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (703.575 ms) : 0, 703575
BytebuddyAgent [candidate] (706.956 ms) : 0, 706956
GlobalTracer [baseline] (221.49 ms) : 0, 221490
GlobalTracer [candidate] (222.308 ms) : 0, 222308
AppSec [baseline] (32.229 ms) : 0, 32229
AppSec [candidate] (32.495 ms) : 0, 32495
Debugger [baseline] (67.938 ms) : 0, 67938
Debugger [candidate] (68.36 ms) : 0, 68360
Remote Config [baseline] (623.218 µs) : 0, 623
Remote Config [candidate] (615.61 µs) : 0, 616
Telemetry [baseline] (8.978 ms) : 0, 8978
Telemetry [candidate] (9.059 ms) : 0, 9059
Flare Poller [baseline] (3.761 ms) : 0, 3761
Flare Poller [candidate] (3.808 ms) : 0, 3808
ProfilingAgent [baseline] (97.659 ms) : 0, 97659
ProfilingAgent [candidate] (97.847 ms) : 0, 97847
Profiling [baseline] (98.247 ms) : 0, 98247
Profiling [candidate] (98.422 ms) : 0, 98422
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090547
Total [baseline] (8.807 s) : 0, 8807091
Agent [candidate] (1.079 s) : 0, 1079119
Total [candidate] (8.784 s) : 0, 8784114
section iast
Agent [baseline] (1.222 s) : 0, 1221592
Total [baseline] (9.525 s) : 0, 9525344
Agent [candidate] (1.223 s) : 0, 1223295
Total [candidate] (9.495 s) : 0, 9495396
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent iast 1.222 s 131.045 ms (12.0%)
Total tracing 8.807 s -
Total iast 9.525 s 718.253 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.223 s 144.176 ms (13.4%)
Total tracing 8.784 s -
Total iast 9.495 s 711.282 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (654.362 ms) : 0, 654362
BytebuddyAgent [candidate] (647.693 ms) : 0, 647693
GlobalTracer [baseline] (284.626 ms) : 0, 284626
GlobalTracer [candidate] (282.308 ms) : 0, 282308
AppSec [baseline] (32.834 ms) : 0, 32834
AppSec [candidate] (32.4 ms) : 0, 32400
Debugger [baseline] (68.156 ms) : 0, 68156
Debugger [candidate] (66.56 ms) : 0, 66560
Remote Config [baseline] (665.095 µs) : 0, 665
Remote Config [candidate] (621.73 µs) : 0, 622
Telemetry [baseline] (9.136 ms) : 0, 9136
Telemetry [candidate] (8.967 ms) : 0, 8967
Flare Poller [baseline] (3.796 ms) : 0, 3796
Flare Poller [candidate] (3.774 ms) : 0, 3774
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (789.477 ms) : 0, 789477
BytebuddyAgent [candidate] (791.281 ms) : 0, 791281
GlobalTracer [baseline] (255.408 ms) : 0, 255408
GlobalTracer [candidate] (255.988 ms) : 0, 255988
AppSec [baseline] (35.675 ms) : 0, 35675
AppSec [candidate] (34.567 ms) : 0, 34567
Debugger [baseline] (64.952 ms) : 0, 64952
Debugger [candidate] (65.545 ms) : 0, 65545
Remote Config [baseline] (601.23 µs) : 0, 601
Remote Config [candidate] (551.12 µs) : 0, 551
Telemetry [baseline] (8.441 ms) : 0, 8441
Telemetry [candidate] (8.379 ms) : 0, 8379
Flare Poller [baseline] (3.492 ms) : 0, 3492
Flare Poller [candidate] (3.406 ms) : 0, 3406
IAST [baseline] (26.962 ms) : 0, 26962
IAST [candidate] (26.927 ms) : 0, 26927
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/virtual-threads
git_commit_date 1765270216 1765288506
git_commit_sha ea52d2d df052db
release_version 1.57.0-SNAPSHOT~ea52d2d1fb 1.57.0-SNAPSHOT~df052db0e6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765291013 1765291013
ci_job_id 1279530683 1279530683
ci_pipeline_id 85584037 85584037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-a18wdy7v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-a18wdy7v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load worse
[+234.311µs; +458.055µs] or [+4.781%; +9.346%]		 worse
[+388.421µs; +925.187µs] or [+3.305%; +7.871%]		 unstable
[-130.138op/s; +40.513op/s] or [-15.660%; +4.875%]		 5.247ms 12.411ms 786.188op/s 4.901ms 11.754ms 831.000op/s
scenario:load:petclinic:no_agent:high_load better
[-2.113ms; -0.511ms] or [-11.859%; -2.870%]		 unstable
[-3.512ms; -0.229ms] or [-11.719%; -0.763%]		 unstable
[-15.472op/s; +46.472op/s] or [-6.014%; +18.063%]		 16.506ms 28.103ms 272.781op/s 17.818ms 29.973ms 257.281op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.137 ms) : 17949, 18324
.   : milestone, 18137,
appsec (18.763 ms) : 18573, 18953
.   : milestone, 18763,
code_origins (17.593 ms) : 17419, 17766
.   : milestone, 17593,
iast (17.459 ms) : 17285, 17633
.   : milestone, 17459,
profiling (18.734 ms) : 18547, 18922
.   : milestone, 18734,
tracing (17.561 ms) : 17386, 17736
.   : milestone, 17561,
section candidate
no_agent (17.101 ms) : 16934, 17269
.   : milestone, 17101,
appsec (19.465 ms) : 19265, 19665
.   : milestone, 19465,
code_origins (17.666 ms) : 17489, 17844
.   : milestone, 17666,
iast (17.568 ms) : 17396, 17741
.   : milestone, 17568,
profiling (18.714 ms) : 18530, 18897
.   : milestone, 18714,
tracing (17.703 ms) : 17529, 17877
.   : milestone, 17703,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.137 ms [17.949 ms, 18.324 ms] -
appsec 18.763 ms [18.573 ms, 18.953 ms] 626.264 µs (3.5%)
code_origins 17.593 ms [17.419 ms, 17.766 ms] -544.007 µs (-3.0%)
iast 17.459 ms [17.285 ms, 17.633 ms] -677.419 µs (-3.7%)
profiling 18.734 ms [18.547 ms, 18.922 ms] 597.525 µs (3.3%)
tracing 17.561 ms [17.386 ms, 17.736 ms] -575.642 µs (-3.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.101 ms [16.934 ms, 17.269 ms] -
appsec 19.465 ms [19.265 ms, 19.665 ms] 2.363 ms (13.8%)
code_origins 17.666 ms [17.489 ms, 17.844 ms] 564.822 µs (3.3%)
iast 17.568 ms [17.396 ms, 17.741 ms] 466.949 µs (2.7%)
profiling 18.714 ms [18.53 ms, 18.897 ms] 1.613 ms (9.4%)
tracing 17.703 ms [17.529 ms, 17.877 ms] 601.551 µs (3.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.203 ms) : 1191, 1215
.   : milestone, 1203,
iast (3.219 ms) : 3182, 3256
.   : milestone, 3219,
iast_FULL (5.56 ms) : 5506, 5615
.   : milestone, 5560,
iast_GLOBAL (3.629 ms) : 3567, 3690
.   : milestone, 3629,
profiling (2.028 ms) : 2011, 2045
.   : milestone, 2028,
tracing (1.81 ms) : 1795, 1826
.   : milestone, 1810,
section candidate
no_agent (1.216 ms) : 1204, 1228
.   : milestone, 1216,
iast (3.243 ms) : 3199, 3287
.   : milestone, 3243,
iast_FULL (5.881 ms) : 5821, 5940
.   : milestone, 5881,
iast_GLOBAL (3.672 ms) : 3614, 3731
.   : milestone, 3672,
profiling (2.099 ms) : 2080, 2118
.   : milestone, 2099,
tracing (1.843 ms) : 1828, 1858
.   : milestone, 1843,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.203 ms [1.191 ms, 1.215 ms] -
iast 3.219 ms [3.182 ms, 3.256 ms] 2.016 ms (167.6%)
iast_FULL 5.56 ms [5.506 ms, 5.615 ms] 4.357 ms (362.2%)
iast_GLOBAL 3.629 ms [3.567 ms, 3.69 ms] 2.426 ms (201.7%)
profiling 2.028 ms [2.011 ms, 2.045 ms] 825.012 µs (68.6%)
tracing 1.81 ms [1.795 ms, 1.826 ms] 607.354 µs (50.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.216 ms [1.204 ms, 1.228 ms] -
iast 3.243 ms [3.199 ms, 3.287 ms] 2.027 ms (166.8%)
iast_FULL 5.881 ms [5.821 ms, 5.94 ms] 4.665 ms (383.8%)
iast_GLOBAL 3.672 ms [3.614 ms, 3.731 ms] 2.457 ms (202.1%)
profiling 2.099 ms [2.08 ms, 2.118 ms] 883.828 µs (72.7%)
tracing 1.843 ms [1.828 ms, 1.858 ms] 627.22 µs (51.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/virtual-threads
git_commit_date 1765270216 1765288506
git_commit_sha ea52d2d df052db
release_version 1.57.0-SNAPSHOT~ea52d2d1fb 1.57.0-SNAPSHOT~df052db0e6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765290857 1765290857
ci_job_id 1279530685 1279530685
ci_pipeline_id 85584037 85584037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7kephkwv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7kephkwv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.417ms; -1.073ms] or [-38.154%; -28.879%]		 2.469ms 3.714ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.781 s) : 14781000, 14781000
.   : milestone, 14781000,
appsec (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
iast (18.095 s) : 18095000, 18095000
.   : milestone, 18095000,
iast_GLOBAL (17.929 s) : 17929000, 17929000
.   : milestone, 17929000,
profiling (15.266 s) : 15266000, 15266000
.   : milestone, 15266000,
tracing (14.981 s) : 14981000, 14981000
.   : milestone, 14981000,
section candidate
no_agent (15.283 s) : 15283000, 15283000
.   : milestone, 15283000,
appsec (14.399 s) : 14399000, 14399000
.   : milestone, 14399000,
iast (18.308 s) : 18308000, 18308000
.   : milestone, 18308000,
iast_GLOBAL (17.765 s) : 17765000, 17765000
.   : milestone, 17765000,
profiling (14.737 s) : 14737000, 14737000
.   : milestone, 14737000,
tracing (14.636 s) : 14636000, 14636000
.   : milestone, 14636000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.781 s [14.781 s, 14.781 s] -
appsec 14.916 s [14.916 s, 14.916 s] 135.0 ms (0.9%)
iast 18.095 s [18.095 s, 18.095 s] 3.314 s (22.4%)
iast_GLOBAL 17.929 s [17.929 s, 17.929 s] 3.148 s (21.3%)
profiling 15.266 s [15.266 s, 15.266 s] 485.0 ms (3.3%)
tracing 14.981 s [14.981 s, 14.981 s] 200.0 ms (1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.283 s [15.283 s, 15.283 s] -
appsec 14.399 s [14.399 s, 14.399 s] -884.0 ms (-5.8%)
iast 18.308 s [18.308 s, 18.308 s] 3.025 s (19.8%)
iast_GLOBAL 17.765 s [17.765 s, 17.765 s] 2.482 s (16.2%)
profiling 14.737 s [14.737 s, 14.737 s] -546.0 ms (-3.6%)
tracing 14.636 s [14.636 s, 14.636 s] -647.0 ms (-4.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.714 ms) : 3494, 3934
.   : milestone, 3714,
iast (2.216 ms) : 2151, 2280
.   : milestone, 2216,
iast_GLOBAL (2.259 ms) : 2194, 2324
.   : milestone, 2259,
profiling (2.065 ms) : 2013, 2117
.   : milestone, 2065,
tracing (2.052 ms) : 2001, 2102
.   : milestone, 2052,
section candidate
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (2.469 ms) : 2417, 2521
.   : milestone, 2469,
iast (2.218 ms) : 2154, 2282
.   : milestone, 2218,
iast_GLOBAL (2.26 ms) : 2195, 2325
.   : milestone, 2260,
profiling (2.069 ms) : 2017, 2121
.   : milestone, 2069,
tracing (2.038 ms) : 1988, 2089
.   : milestone, 2038,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.714 ms [3.494 ms, 3.934 ms] 2.233 ms (150.7%)
iast 2.216 ms [2.151 ms, 2.28 ms] 734.006 µs (49.5%)
iast_GLOBAL 2.259 ms [2.194 ms, 2.324 ms] 777.515 µs (52.5%)
profiling 2.065 ms [2.013 ms, 2.117 ms] 583.131 µs (39.4%)
tracing 2.052 ms [2.001 ms, 2.102 ms] 570.359 µs (38.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.47 ms, 1.493 ms] -
appsec 2.469 ms [2.417 ms, 2.521 ms] 988.173 µs (66.7%)
iast 2.218 ms [2.154 ms, 2.282 ms] 736.588 µs (49.7%)
iast_GLOBAL 2.26 ms [2.195 ms, 2.325 ms] 778.839 µs (52.6%)
profiling 2.069 ms [2.017 ms, 2.121 ms] 587.93 µs (39.7%)
tracing 2.038 ms [1.988 ms, 2.089 ms] 557.346 µs (37.6%)

@PerfectSlayer PerfectSlayer merged commit f431e84 into master Dec 9, 2025
549 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/virtual-threads branch December 9, 2025 15:02
@github-actions github-actions bot added this to the 1.57.0 milestone Dec 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 approved these changes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

Assignees

No one assigned

Labels

inst: java Core Java language instrumentation tag: flaky test/disabled Disabled flaky tests tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.57.0

Development

Successfully merging this pull request may close these issues.

4 participants

@PerfectSlayer @bric3 @AlexeyKuznetsov-DD