Skip to content

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Jan 8, 2026

What Does This Do

add check against null from classes returned by
Instrumentation::getAllLoadedClasses

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-4904

add check against null from classes returned by
Instrumentation::getAllLoadedClasses
@jpbempel jpbempel requested a review from a team as a code owner January 8, 2026 15:39
@jpbempel jpbempel requested review from shatzi and removed request for a team January 8, 2026 15:39
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Jan 8, 2026
@jpbempel jpbempel added the type: bug Bug report and fix label Jan 8, 2026
@pr-commenter
Copy link

pr-commenter bot commented Jan 8, 2026

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1767887277 1767887623
end_time 2026-01-08T15:49:18 2026-01-08T15:55:04
git_branch master jpbempel/fix-npe-loaded-classes
git_commit_sha 08e1657 2a279df
start_time 2026-01-08T15:47:58 2026-01-08T15:53:44
See matching parameters
Baseline Candidate
ci_job_id 1336423583 1336423583
ci_pipeline_id 89692750 89692750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1767886743 1767886743

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-31.933µs; +17.811µs] or [-11.360%; +6.336%]
unstable
[-47.524µs; +23.610µs] or [-14.662%; +7.284%]
unstable
[-61.508µs; +33.181µs] or [-18.090%; +9.759%]
unstable
[-72.764µs; +161.034µs] or [-7.269%; +16.088%]
same
scenario:basic same same same unstable
[+22.534µs; +213.557µs] or [+3.103%; +29.405%]
unstable
[-63.217op/s; +205.464op/s] or [-2.402%; +7.808%]
scenario:loop same unsure
[+0.678µs; +10.635µs] or [+0.008%; +0.119%]
same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (324.135 µs) : 283, 366
.   : milestone, 324,
basic (279.655 µs) : 273, 287
.   : milestone, 280,
loop (8.949 ms) : 8945, 8954
.   : milestone, 8949,
section candidate
noprobe (312.177 µs) : 288, 336
.   : milestone, 312,
basic (278.43 µs) : 272, 285
.   : milestone, 278,
loop (8.955 ms) : 8951, 8960
.   : milestone, 8955,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 324.135 µs [282.713 µs, 365.557 µs]
basic 279.655 µs [272.741 µs, 286.569 µs]
loop 8.949 ms [8.945 ms, 8.954 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 312.177 µs [288.155 µs, 336.2 µs]
basic 278.43 µs [272.199 µs, 284.661 µs]
loop 8.955 ms [8.951 ms, 8.96 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jan 8, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-loaded-classes
git_commit_date 1767878426 1767886743
git_commit_sha 08e1657 2a279df
release_version 1.59.0-SNAPSHOT~08e165783b 1.59.0-SNAPSHOT~2a279dfc59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767888577 1767888577
ci_job_id 1336423572 1336423572
ci_pipeline_id 89692750 89692750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-d2dgclf2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-d2dgclf2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1091156
Total [baseline] (8.761 s) : 0, 8761281
Agent [candidate] (1.085 s) : 0, 1084984
Total [candidate] (8.769 s) : 0, 8768971
section iast
Agent [baseline] (1.231 s) : 0, 1230848
Total [baseline] (9.337 s) : 0, 9336825
Agent [candidate] (1.223 s) : 0, 1223488
Total [candidate] (9.292 s) : 0, 9291927
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent iast 1.231 s 139.692 ms (12.8%)
Total tracing 8.761 s -
Total iast 9.337 s 575.545 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.223 s 138.504 ms (12.8%)
Total tracing 8.769 s -
Total iast 9.292 s 522.956 ms (6.0%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (655.673 ms) : 0, 655673
BytebuddyAgent [candidate] (651.9 ms) : 0, 651900
GlobalTracer [baseline] (284.134 ms) : 0, 284134
GlobalTracer [candidate] (283.211 ms) : 0, 283211
AppSec [baseline] (32.812 ms) : 0, 32812
AppSec [candidate] (32.768 ms) : 0, 32768
Debugger [baseline] (68.156 ms) : 0, 68156
Debugger [candidate] (67.06 ms) : 0, 67060
Remote Config [baseline] (621.387 µs) : 0, 621
Remote Config [candidate] (641.024 µs) : 0, 641
Telemetry [baseline] (9.0 ms) : 0, 9000
Telemetry [candidate] (8.943 ms) : 0, 8943
Flare Poller [baseline] (3.729 ms) : 0, 3729
Flare Poller [candidate] (3.747 ms) : 0, 3747
section iast
crashtracking [baseline] (1.206 ms) : 0, 1206
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (796.667 ms) : 0, 796667
BytebuddyAgent [candidate] (791.72 ms) : 0, 791720
GlobalTracer [baseline] (257.36 ms) : 0, 257360
GlobalTracer [candidate] (256.018 ms) : 0, 256018
AppSec [baseline] (33.764 ms) : 0, 33764
AppSec [candidate] (34.418 ms) : 0, 34418
Debugger [baseline] (66.222 ms) : 0, 66222
Debugger [candidate] (65.093 ms) : 0, 65093
Remote Config [baseline] (593.048 µs) : 0, 593
Remote Config [candidate] (574.278 µs) : 0, 574
Telemetry [baseline] (8.596 ms) : 0, 8596
Telemetry [candidate] (8.503 ms) : 0, 8503
Flare Poller [baseline] (3.638 ms) : 0, 3638
Flare Poller [candidate] (3.548 ms) : 0, 3548
IAST [baseline] (27.231 ms) : 0, 27231
IAST [candidate] (26.904 ms) : 0, 26904
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.102 s) : 0, 1102403
Total [baseline] (10.963 s) : 0, 10963175
Agent [candidate] (1.085 s) : 0, 1085459
Total [candidate] (10.749 s) : 0, 10749179
section appsec
Agent [baseline] (1.265 s) : 0, 1265340
Total [baseline] (11.042 s) : 0, 11041733
Agent [candidate] (1.268 s) : 0, 1267535
Total [candidate] (10.976 s) : 0, 10976427
section iast
Agent [baseline] (1.233 s) : 0, 1232727
Total [baseline] (11.22 s) : 0, 11219891
Agent [candidate] (1.233 s) : 0, 1233084
Total [candidate] (11.216 s) : 0, 11215862
section profiling
Agent [baseline] (1.207 s) : 0, 1207078
Total [baseline] (11.039 s) : 0, 11038722
Agent [candidate] (1.206 s) : 0, 1205675
Total [candidate] (10.884 s) : 0, 10883925
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.102 s -
Agent appsec 1.265 s 162.937 ms (14.8%)
Agent iast 1.233 s 130.324 ms (11.8%)
Agent profiling 1.207 s 104.675 ms (9.5%)
Total tracing 10.963 s -
Total appsec 11.042 s 78.558 ms (0.7%)
Total iast 11.22 s 256.716 ms (2.3%)
Total profiling 11.039 s 75.547 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.268 s 182.076 ms (16.8%)
Agent iast 1.233 s 147.625 ms (13.6%)
Agent profiling 1.206 s 120.216 ms (11.1%)
Total tracing 10.749 s -
Total appsec 10.976 s 227.248 ms (2.1%)
Total iast 11.216 s 466.683 ms (4.3%)
Total profiling 10.884 s 134.746 ms (1.3%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (662.11 ms) : 0, 662110
BytebuddyAgent [candidate] (651.632 ms) : 0, 651632
GlobalTracer [baseline] (286.37 ms) : 0, 286370
GlobalTracer [candidate] (282.599 ms) : 0, 282599
AppSec [baseline] (33.277 ms) : 0, 33277
AppSec [candidate] (32.39 ms) : 0, 32390
Debugger [baseline] (69.747 ms) : 0, 69747
Debugger [candidate] (68.539 ms) : 0, 68539
Remote Config [baseline] (633.842 µs) : 0, 634
Remote Config [candidate] (639.587 µs) : 0, 640
Telemetry [baseline] (9.26 ms) : 0, 9260
Telemetry [candidate] (9.105 ms) : 0, 9105
Flare Poller [baseline] (3.89 ms) : 0, 3890
Flare Poller [candidate] (3.801 ms) : 0, 3801
section appsec
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (691.412 ms) : 0, 691412
BytebuddyAgent [candidate] (692.278 ms) : 0, 692278
GlobalTracer [baseline] (258.389 ms) : 0, 258389
GlobalTracer [candidate] (259.001 ms) : 0, 259001
AppSec [baseline] (174.43 ms) : 0, 174430
AppSec [candidate] (173.464 ms) : 0, 173464
Debugger [baseline] (66.308 ms) : 0, 66308
Debugger [candidate] (67.763 ms) : 0, 67763
Remote Config [baseline] (733.899 µs) : 0, 734
Remote Config [candidate] (755.188 µs) : 0, 755
Telemetry [baseline] (9.347 ms) : 0, 9347
Telemetry [candidate] (9.332 ms) : 0, 9332
Flare Poller [baseline] (3.73 ms) : 0, 3730
Flare Poller [candidate] (3.766 ms) : 0, 3766
IAST [baseline] (24.453 ms) : 0, 24453
IAST [candidate] (24.588 ms) : 0, 24588
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (796.864 ms) : 0, 796864
BytebuddyAgent [candidate] (798.143 ms) : 0, 798143
GlobalTracer [baseline] (257.97 ms) : 0, 257970
GlobalTracer [candidate] (257.724 ms) : 0, 257724
AppSec [baseline] (32.982 ms) : 0, 32982
AppSec [candidate] (33.667 ms) : 0, 33667
Debugger [baseline] (68.038 ms) : 0, 68038
Debugger [candidate] (66.742 ms) : 0, 66742
Remote Config [baseline] (578.005 µs) : 0, 578
Remote Config [candidate] (594.294 µs) : 0, 594
Telemetry [baseline] (8.548 ms) : 0, 8548
Telemetry [candidate] (8.531 ms) : 0, 8531
Flare Poller [baseline] (3.571 ms) : 0, 3571
Flare Poller [candidate] (3.556 ms) : 0, 3556
IAST [baseline] (27.351 ms) : 0, 27351
IAST [candidate] (27.293 ms) : 0, 27293
section profiling
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.213 ms) : 0, 1213
BytebuddyAgent [baseline] (703.84 ms) : 0, 703840
BytebuddyAgent [candidate] (703.275 ms) : 0, 703275
GlobalTracer [baseline] (220.705 ms) : 0, 220705
GlobalTracer [candidate] (220.767 ms) : 0, 220767
AppSec [baseline] (32.165 ms) : 0, 32165
AppSec [candidate] (32.201 ms) : 0, 32201
Debugger [baseline] (68.206 ms) : 0, 68206
Debugger [candidate] (68.219 ms) : 0, 68219
Remote Config [baseline] (646.028 µs) : 0, 646
Remote Config [candidate] (636.536 µs) : 0, 637
Telemetry [baseline] (8.821 ms) : 0, 8821
Telemetry [candidate] (8.783 ms) : 0, 8783
Flare Poller [baseline] (3.666 ms) : 0, 3666
Flare Poller [candidate] (3.65 ms) : 0, 3650
ProfilingAgent [baseline] (97.912 ms) : 0, 97912
ProfilingAgent [candidate] (97.03 ms) : 0, 97030
Profiling [baseline] (98.512 ms) : 0, 98512
Profiling [candidate] (97.608 ms) : 0, 97608
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-loaded-classes
git_commit_date 1767878426 1767886743
git_commit_sha 08e1657 2a279df
release_version 1.59.0-SNAPSHOT~08e165783b 1.59.0-SNAPSHOT~2a279dfc59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767889055 1767889055
ci_job_id 1336423574 1336423574
ci_pipeline_id 89692750 89692750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tgsum8dv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tgsum8dv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 4 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-638.482µs; -298.018µs] or [-11.954%; -5.580%]
better
[-1.717ms; -0.708ms] or [-13.497%; -5.563%]
unstable
[-23.880op/s; +158.317op/s] or [-3.098%; +20.541%]
4.873ms 11.512ms 837.938op/s 5.341ms 12.725ms 770.719op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.069ms; +1.847ms] or [+6.184%; +10.680%]
worse
[+0.832ms; +1.895ms] or [+2.915%; +6.640%]
unstable
[-42.396op/s; +10.771op/s] or [-16.097%; +4.090%]
18.748ms 29.904ms 247.562op/s 17.290ms 28.541ms 263.375op/s
scenario:load:petclinic:iast:high_load better
[-2.910ms; -2.492ms] or [-14.736%; -12.620%]
better
[-3.697ms; -2.607ms] or [-11.765%; -8.295%]
unstable
[+6.641op/s; +57.922op/s] or [+2.829%; +24.674%]
17.049ms 28.271ms 267.031op/s 19.750ms 31.422ms 234.750op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.519ms; +2.592ms] or [+9.085%; +15.502%]
worse
[+1.505ms; +4.294ms] or [+5.257%; +15.002%]
unstable
[-56.712op/s; -1.101op/s] or [-20.910%; -0.406%]
18.776ms 31.520ms 242.312op/s 16.720ms 28.621ms 271.219op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.189 ms) : 1178, 1201
.   : milestone, 1189,
iast (3.197 ms) : 3153, 3241
.   : milestone, 3197,
iast_FULL (6.001 ms) : 5940, 6062
.   : milestone, 6001,
iast_GLOBAL (3.578 ms) : 3526, 3630
.   : milestone, 3578,
profiling (2.091 ms) : 2072, 2110
.   : milestone, 2091,
tracing (1.841 ms) : 1825, 1857
.   : milestone, 1841,
section candidate
no_agent (1.29 ms) : 1275, 1304
.   : milestone, 1290,
iast (3.13 ms) : 3089, 3170
.   : milestone, 3130,
iast_FULL (5.512 ms) : 5458, 5566
.   : milestone, 5512,
iast_GLOBAL (3.587 ms) : 3531, 3643
.   : milestone, 3587,
profiling (1.933 ms) : 1917, 1950
.   : milestone, 1933,
tracing (1.817 ms) : 1802, 1833
.   : milestone, 1817,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.189 ms [1.178 ms, 1.201 ms] -
iast 3.197 ms [3.153 ms, 3.241 ms] 2.008 ms (168.8%)
iast_FULL 6.001 ms [5.94 ms, 6.062 ms] 4.812 ms (404.6%)
iast_GLOBAL 3.578 ms [3.526 ms, 3.63 ms] 2.389 ms (200.9%)
profiling 2.091 ms [2.072 ms, 2.11 ms] 901.683 µs (75.8%)
tracing 1.841 ms [1.825 ms, 1.857 ms] 651.77 µs (54.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.29 ms [1.275 ms, 1.304 ms] -
iast 3.13 ms [3.089 ms, 3.17 ms] 1.84 ms (142.7%)
iast_FULL 5.512 ms [5.458 ms, 5.566 ms] 4.222 ms (327.4%)
iast_GLOBAL 3.587 ms [3.531 ms, 3.643 ms] 2.297 ms (178.2%)
profiling 1.933 ms [1.917 ms, 1.95 ms] 643.794 µs (49.9%)
tracing 1.817 ms [1.802 ms, 1.833 ms] 527.663 µs (40.9%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.199 ms) : 17029, 17369
.   : milestone, 17199,
appsec (18.813 ms) : 18621, 19005
.   : milestone, 18813,
code_origins (17.712 ms) : 17537, 17888
.   : milestone, 17712,
iast (19.889 ms) : 19686, 20093
.   : milestone, 19889,
profiling (18.925 ms) : 18733, 19117
.   : milestone, 18925,
tracing (17.626 ms) : 17454, 17798
.   : milestone, 17626,
section candidate
no_agent (19.263 ms) : 19066, 19461
.   : milestone, 19263,
appsec (18.534 ms) : 18344, 18725
.   : milestone, 18534,
code_origins (18.857 ms) : 18669, 19045
.   : milestone, 18857,
iast (17.472 ms) : 17297, 17647
.   : milestone, 17472,
profiling (18.559 ms) : 18376, 18742
.   : milestone, 18559,
tracing (17.597 ms) : 17422, 17772
.   : milestone, 17597,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.199 ms [17.029 ms, 17.369 ms] -
appsec 18.813 ms [18.621 ms, 19.005 ms] 1.614 ms (9.4%)
code_origins 17.712 ms [17.537 ms, 17.888 ms] 513.39 µs (3.0%)
iast 19.889 ms [19.686 ms, 20.093 ms] 2.69 ms (15.6%)
profiling 18.925 ms [18.733 ms, 19.117 ms] 1.726 ms (10.0%)
tracing 17.626 ms [17.454 ms, 17.798 ms] 427.15 µs (2.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.263 ms [19.066 ms, 19.461 ms] -
appsec 18.534 ms [18.344 ms, 18.725 ms] -729.059 µs (-3.8%)
code_origins 18.857 ms [18.669 ms, 19.045 ms] -406.322 µs (-2.1%)
iast 17.472 ms [17.297 ms, 17.647 ms] -1.792 ms (-9.3%)
profiling 18.559 ms [18.376 ms, 18.742 ms] -704.782 µs (-3.7%)
tracing 17.597 ms [17.422 ms, 17.772 ms] -1.666 ms (-8.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-npe-loaded-classes
git_commit_date 1767878426 1767886743
git_commit_sha 08e1657 2a279df
release_version 1.59.0-SNAPSHOT~08e165783b 1.59.0-SNAPSHOT~2a279dfc59
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767888855 1767888855
ci_job_id 1336423576 1336423576
ci_pipeline_id 89692750 89692750
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-p5nbdqru 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-p5nbdqru 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.539 s) : 15539000, 15539000
.   : milestone, 15539000,
appsec (15.191 s) : 15191000, 15191000
.   : milestone, 15191000,
iast (18.468 s) : 18468000, 18468000
.   : milestone, 18468000,
iast_GLOBAL (18.083 s) : 18083000, 18083000
.   : milestone, 18083000,
profiling (14.696 s) : 14696000, 14696000
.   : milestone, 14696000,
tracing (14.59 s) : 14590000, 14590000
.   : milestone, 14590000,
section candidate
no_agent (14.963 s) : 14963000, 14963000
.   : milestone, 14963000,
appsec (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
iast (18.501 s) : 18501000, 18501000
.   : milestone, 18501000,
iast_GLOBAL (17.851 s) : 17851000, 17851000
.   : milestone, 17851000,
profiling (14.749 s) : 14749000, 14749000
.   : milestone, 14749000,
tracing (14.768 s) : 14768000, 14768000
.   : milestone, 14768000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.539 s [15.539 s, 15.539 s] -
appsec 15.191 s [15.191 s, 15.191 s] -348.0 ms (-2.2%)
iast 18.468 s [18.468 s, 18.468 s] 2.929 s (18.8%)
iast_GLOBAL 18.083 s [18.083 s, 18.083 s] 2.544 s (16.4%)
profiling 14.696 s [14.696 s, 14.696 s] -843.0 ms (-5.4%)
tracing 14.59 s [14.59 s, 14.59 s] -949.0 ms (-6.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.963 s [14.963 s, 14.963 s] -
appsec 14.768 s [14.768 s, 14.768 s] -195.0 ms (-1.3%)
iast 18.501 s [18.501 s, 18.501 s] 3.538 s (23.6%)
iast_GLOBAL 17.851 s [17.851 s, 17.851 s] 2.888 s (19.3%)
profiling 14.749 s [14.749 s, 14.749 s] -214.0 ms (-1.4%)
tracing 14.768 s [14.768 s, 14.768 s] -195.0 ms (-1.3%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~2a279dfc59, baseline=1.59.0-SNAPSHOT~08e165783b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.754 ms) : 3536, 3973
.   : milestone, 3754,
iast (2.229 ms) : 2164, 2294
.   : milestone, 2229,
iast_GLOBAL (2.262 ms) : 2197, 2327
.   : milestone, 2262,
profiling (2.112 ms) : 2057, 2166
.   : milestone, 2112,
tracing (2.052 ms) : 2002, 2103
.   : milestone, 2052,
section candidate
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (3.758 ms) : 3539, 3978
.   : milestone, 3758,
iast (2.22 ms) : 2155, 2285
.   : milestone, 2220,
iast_GLOBAL (2.274 ms) : 2208, 2340
.   : milestone, 2274,
profiling (2.104 ms) : 2049, 2158
.   : milestone, 2104,
tracing (2.054 ms) : 2003, 2105
.   : milestone, 2054,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.754 ms [3.536 ms, 3.973 ms] 2.275 ms (153.8%)
iast 2.229 ms [2.164 ms, 2.294 ms] 750.118 µs (50.7%)
iast_GLOBAL 2.262 ms [2.197 ms, 2.327 ms] 783.078 µs (52.9%)
profiling 2.112 ms [2.057 ms, 2.166 ms] 632.556 µs (42.8%)
tracing 2.052 ms [2.002 ms, 2.103 ms] 573.345 µs (38.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 3.758 ms [3.539 ms, 3.978 ms] 2.279 ms (154.1%)
iast 2.22 ms [2.155 ms, 2.285 ms] 741.169 µs (50.1%)
iast_GLOBAL 2.274 ms [2.208 ms, 2.34 ms] 794.733 µs (53.7%)
profiling 2.104 ms [2.049 ms, 2.158 ms] 624.329 µs (42.2%)
tracing 2.054 ms [2.003 ms, 2.105 ms] 574.752 µs (38.9%)

@jpbempel jpbempel merged commit 372ceb0 into master Jan 8, 2026
575 of 579 checks passed
@jpbempel jpbempel deleted the jpbempel/fix-npe-loaded-classes branch January 8, 2026 16:47
@github-actions github-actions bot added this to the 1.59.0 milestone Jan 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: debugger Dynamic Instrumentation type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants