Add instrumentation tests for JUnit #10257

PerfectSlayer · 2025-12-19T14:38:10Z

What Does This Do

DRAFT. Sharing early work about JUnit assert rules related to tracing and instrumented tests.
Those API are experimental only and AbstractInstrumentationTest might be reworked as an extension in a near feature.

Motivation

Sharing to prevent code publication and conflict.

Additional Notes

Work based on 2024Q4 R&D week results

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-12-19T15:22:09Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/virtual-threads
git_commit_date	1768229057	1768241223
git_commit_sha	`231ea1a`	`ed582d5`
release_version	1.59.0-SNAPSHOT~231ea1aad0	1.59.0-SNAPSHOT~ed582d580b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768243213	1768243213
ci_job_id	1344069920	1344069920
ci_pipeline_id	90264552	90264552
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-iwwfemu8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-iwwfemu8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.1 s) : 0, 1100064
Total [baseline] (10.807 s) : 0, 10807438
Agent [candidate] (1.085 s) : 0, 1085169
Total [candidate] (10.689 s) : 0, 10689346
section appsec
Agent [baseline] (1.268 s) : 0, 1268208
Total [baseline] (11.021 s) : 0, 11020994
Agent [candidate] (1.269 s) : 0, 1268552
Total [candidate] (10.882 s) : 0, 10882173
section iast
Agent [baseline] (1.242 s) : 0, 1242071
Total [baseline] (11.258 s) : 0, 11257816
Agent [candidate] (1.227 s) : 0, 1226597
Total [candidate] (11.244 s) : 0, 11243566
section profiling
Agent [baseline] (1.203 s) : 0, 1203331
Total [baseline] (10.887 s) : 0, 10887435
Agent [candidate] (1.204 s) : 0, 1204334
Total [candidate] (10.86 s) : 0, 10859713

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.1 s	-
Agent	appsec	1.268 s	168.144 ms (15.3%)
Agent	iast	1.242 s	142.007 ms (12.9%)
Agent	profiling	1.203 s	103.267 ms (9.4%)
Total	tracing	10.807 s	-
Total	appsec	11.021 s	213.556 ms (2.0%)
Total	iast	11.258 s	450.378 ms (4.2%)
Total	profiling	10.887 s	79.996 ms (0.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.085 s	-
Agent	appsec	1.269 s	183.383 ms (16.9%)
Agent	iast	1.227 s	141.428 ms (13.0%)
Agent	profiling	1.204 s	119.165 ms (11.0%)
Total	tracing	10.689 s	-
Total	appsec	10.882 s	192.827 ms (1.8%)
Total	iast	11.244 s	554.22 ms (5.2%)
Total	profiling	10.86 s	170.366 ms (1.6%)

gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (661.041 ms) : 0, 661041
BytebuddyAgent [candidate] (651.722 ms) : 0, 651722
GlobalTracer [baseline] (285.892 ms) : 0, 285892
GlobalTracer [candidate] (283.103 ms) : 0, 283103
AppSec [baseline] (33.261 ms) : 0, 33261
AppSec [candidate] (32.549 ms) : 0, 32549
Debugger [baseline] (69.076 ms) : 0, 69076
Debugger [candidate] (67.631 ms) : 0, 67631
Remote Config [baseline] (663.611 µs) : 0, 664
Remote Config [candidate] (667.178 µs) : 0, 667
Telemetry [baseline] (9.117 ms) : 0, 9117
Telemetry [candidate] (8.973 ms) : 0, 8973
Flare Poller [baseline] (3.87 ms) : 0, 3870
Flare Poller [candidate] (3.788 ms) : 0, 3788
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (691.982 ms) : 0, 691982
BytebuddyAgent [candidate] (692.557 ms) : 0, 692557
GlobalTracer [baseline] (259.361 ms) : 0, 259361
GlobalTracer [candidate] (259.713 ms) : 0, 259713
AppSec [baseline] (172.899 ms) : 0, 172899
AppSec [candidate] (173.294 ms) : 0, 173294
Debugger [baseline] (68.803 ms) : 0, 68803
Debugger [candidate] (67.975 ms) : 0, 67975
Remote Config [baseline] (779.591 µs) : 0, 780
Remote Config [candidate] (754.062 µs) : 0, 754
Telemetry [baseline] (9.407 ms) : 0, 9407
Telemetry [candidate] (9.251 ms) : 0, 9251
Flare Poller [baseline] (3.78 ms) : 0, 3780
Flare Poller [candidate] (3.746 ms) : 0, 3746
IAST [baseline] (24.522 ms) : 0, 24522
IAST [candidate] (24.589 ms) : 0, 24589
section iast
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (805.055 ms) : 0, 805055
BytebuddyAgent [candidate] (792.382 ms) : 0, 792382
GlobalTracer [baseline] (259.298 ms) : 0, 259298
GlobalTracer [candidate] (256.957 ms) : 0, 256957
AppSec [baseline] (34.635 ms) : 0, 34635
AppSec [candidate] (34.548 ms) : 0, 34548
Debugger [baseline] (65.922 ms) : 0, 65922
Debugger [candidate] (66.452 ms) : 0, 66452
Remote Config [baseline] (597.629 µs) : 0, 598
Remote Config [candidate] (552.94 µs) : 0, 553
Telemetry [baseline] (8.568 ms) : 0, 8568
Telemetry [candidate] (8.494 ms) : 0, 8494
Flare Poller [baseline] (3.589 ms) : 0, 3589
Flare Poller [candidate] (3.58 ms) : 0, 3580
IAST [baseline] (27.333 ms) : 0, 27333
IAST [candidate] (26.955 ms) : 0, 26955
section profiling
crashtracking [baseline] (1.224 ms) : 0, 1224
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (700.704 ms) : 0, 700704
BytebuddyAgent [candidate] (701.729 ms) : 0, 701729
GlobalTracer [baseline] (220.699 ms) : 0, 220699
GlobalTracer [candidate] (220.636 ms) : 0, 220636
AppSec [baseline] (32.137 ms) : 0, 32137
AppSec [candidate] (32.153 ms) : 0, 32153
Debugger [baseline] (68.019 ms) : 0, 68019
Debugger [candidate] (68.128 ms) : 0, 68128
Remote Config [baseline] (613.175 µs) : 0, 613
Remote Config [candidate] (631.056 µs) : 0, 631
Telemetry [baseline] (9.022 ms) : 0, 9022
Telemetry [candidate] (8.962 ms) : 0, 8962
Flare Poller [baseline] (3.711 ms) : 0, 3711
Flare Poller [candidate] (3.755 ms) : 0, 3755
ProfilingAgent [baseline] (97.277 ms) : 0, 97277
ProfilingAgent [candidate] (97.29 ms) : 0, 97290
Profiling [baseline] (97.848 ms) : 0, 97848
Profiling [candidate] (97.87 ms) : 0, 97870

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.084 s) : 0, 1084203
Total [baseline] (8.73 s) : 0, 8730385
Agent [candidate] (1.093 s) : 0, 1092648
Total [candidate] (8.719 s) : 0, 8718669
section iast
Agent [baseline] (1.224 s) : 0, 1224029
Total [baseline] (9.324 s) : 0, 9324123
Agent [candidate] (1.223 s) : 0, 1222968
Total [candidate] (9.286 s) : 0, 9286165

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.084 s	-
Agent	iast	1.224 s	139.827 ms (12.9%)
Total	tracing	8.73 s	-
Total	iast	9.324 s	593.738 ms (6.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.093 s	-
Agent	iast	1.223 s	130.32 ms (11.9%)
Total	tracing	8.719 s	-
Total	iast	9.286 s	567.496 ms (6.5%)

gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (651.277 ms) : 0, 651277
BytebuddyAgent [candidate] (657.118 ms) : 0, 657118
GlobalTracer [baseline] (282.72 ms) : 0, 282720
GlobalTracer [candidate] (284.745 ms) : 0, 284745
AppSec [baseline] (32.604 ms) : 0, 32604
AppSec [candidate] (32.97 ms) : 0, 32970
Debugger [baseline] (67.516 ms) : 0, 67516
Debugger [candidate] (67.267 ms) : 0, 67267
Remote Config [baseline] (685.139 µs) : 0, 685
Remote Config [candidate] (655.57 µs) : 0, 656
Telemetry [baseline] (8.944 ms) : 0, 8944
Telemetry [candidate] (8.965 ms) : 0, 8965
Flare Poller [baseline] (3.757 ms) : 0, 3757
Flare Poller [candidate] (3.83 ms) : 0, 3830
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (791.952 ms) : 0, 791952
BytebuddyAgent [candidate] (791.484 ms) : 0, 791484
GlobalTracer [baseline] (256.175 ms) : 0, 256175
GlobalTracer [candidate] (256.346 ms) : 0, 256346
AppSec [baseline] (34.253 ms) : 0, 34253
AppSec [candidate] (34.458 ms) : 0, 34458
Debugger [baseline] (65.245 ms) : 0, 65245
Debugger [candidate] (64.55 ms) : 0, 64550
Remote Config [baseline] (609.32 µs) : 0, 609
Remote Config [candidate] (572.615 µs) : 0, 573
Telemetry [baseline] (8.493 ms) : 0, 8493
Telemetry [candidate] (8.443 ms) : 0, 8443
Flare Poller [baseline] (3.612 ms) : 0, 3612
Flare Poller [candidate] (3.514 ms) : 0, 3514
IAST [baseline] (26.949 ms) : 0, 26949
IAST [candidate] (26.984 ms) : 0, 26984

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/virtual-threads
git_commit_date	1768229057	1768241223
git_commit_sha	`231ea1a`	`ed582d5`
release_version	1.59.0-SNAPSHOT~231ea1aad0	1.59.0-SNAPSHOT~ed582d580b

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1768243606	1768243606
ci_job_id	1344069921	1344069921
ci_pipeline_id	90264552	90264552
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ho9en8qq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ho9en8qq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 18 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.192 ms) : 1181, 1204
.   : milestone, 1192,
iast (3.224 ms) : 3178, 3269
.   : milestone, 3224,
iast_FULL (5.805 ms) : 5747, 5864
.   : milestone, 5805,
iast_GLOBAL (3.613 ms) : 3560, 3665
.   : milestone, 3613,
profiling (2.178 ms) : 2156, 2199
.   : milestone, 2178,
tracing (1.767 ms) : 1752, 1782
.   : milestone, 1767,
section candidate
no_agent (1.189 ms) : 1177, 1201
.   : milestone, 1189,
iast (3.216 ms) : 3172, 3259
.   : milestone, 3216,
iast_FULL (5.855 ms) : 5797, 5914
.   : milestone, 5855,
iast_GLOBAL (3.724 ms) : 3667, 3781
.   : milestone, 3724,
profiling (2.035 ms) : 2017, 2053
.   : milestone, 2035,
tracing (1.736 ms) : 1722, 1751
.   : milestone, 1736,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.192 ms [1.181 ms, 1.204 ms]	-
iast	3.224 ms [3.178 ms, 3.269 ms]	2.032 ms (170.4%)
iast_FULL	5.805 ms [5.747 ms, 5.864 ms]	4.613 ms (386.9%)
iast_GLOBAL	3.613 ms [3.56 ms, 3.665 ms]	2.42 ms (203.0%)
profiling	2.178 ms [2.156 ms, 2.199 ms]	985.568 µs (82.7%)
tracing	1.767 ms [1.752 ms, 1.782 ms]	574.643 µs (48.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.189 ms [1.177 ms, 1.201 ms]	-
iast	3.216 ms [3.172 ms, 3.259 ms]	2.026 ms (170.4%)
iast_FULL	5.855 ms [5.797 ms, 5.914 ms]	4.666 ms (392.3%)
iast_GLOBAL	3.724 ms [3.667 ms, 3.781 ms]	2.535 ms (213.1%)
profiling	2.035 ms [2.017 ms, 2.053 ms]	845.996 µs (71.1%)
tracing	1.736 ms [1.722 ms, 1.751 ms]	546.793 µs (46.0%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.128 ms) : 18933, 19323
.   : milestone, 19128,
appsec (18.572 ms) : 18385, 18758
.   : milestone, 18572,
code_origins (17.434 ms) : 17262, 17606
.   : milestone, 17434,
iast (17.744 ms) : 17566, 17921
.   : milestone, 17744,
profiling (19.128 ms) : 18937, 19319
.   : milestone, 19128,
tracing (17.541 ms) : 17371, 17712
.   : milestone, 17541,
section candidate
no_agent (19.865 ms) : 19667, 20062
.   : milestone, 19865,
appsec (18.483 ms) : 18297, 18669
.   : milestone, 18483,
code_origins (17.796 ms) : 17622, 17970
.   : milestone, 17796,
iast (17.66 ms) : 17482, 17838
.   : milestone, 17660,
profiling (19.444 ms) : 19240, 19647
.   : milestone, 19444,
tracing (17.667 ms) : 17494, 17840
.   : milestone, 17667,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.128 ms [18.933 ms, 19.323 ms]	-
appsec	18.572 ms [18.385 ms, 18.758 ms]	-555.854 µs (-2.9%)
code_origins	17.434 ms [17.262 ms, 17.606 ms]	-1.693 ms (-8.9%)
iast	17.744 ms [17.566 ms, 17.921 ms]	-1.384 ms (-7.2%)
profiling	19.128 ms [18.937 ms, 19.319 ms]	0.216 µs (0.0%)
tracing	17.541 ms [17.371 ms, 17.712 ms]	-1.586 ms (-8.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.865 ms [19.667 ms, 20.062 ms]	-
appsec	18.483 ms [18.297 ms, 18.669 ms]	-1.382 ms (-7.0%)
code_origins	17.796 ms [17.622 ms, 17.97 ms]	-2.069 ms (-10.4%)
iast	17.66 ms [17.482 ms, 17.838 ms]	-2.205 ms (-11.1%)
profiling	19.444 ms [19.24 ms, 19.647 ms]	-420.678 µs (-2.1%)
tracing	17.667 ms [17.494 ms, 17.84 ms]	-2.197 ms (-11.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/virtual-threads
git_commit_date	1768229057	1768241223
git_commit_sha	`231ea1a`	`ed582d5`
release_version	1.59.0-SNAPSHOT~231ea1aad0	1.59.0-SNAPSHOT~ed582d580b

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1768243403	1768243403
ci_job_id	1344069922	1344069922
ci_pipeline_id	90264552	90264552
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-3-un92bexi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-3-un92bexi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (3.727 ms) : 3507, 3947
.   : milestone, 3727,
iast (2.203 ms) : 2138, 2268
.   : milestone, 2203,
iast_GLOBAL (2.25 ms) : 2185, 2316
.   : milestone, 2250,
profiling (2.055 ms) : 2003, 2108
.   : milestone, 2055,
tracing (2.045 ms) : 1994, 2097
.   : milestone, 2045,
section candidate
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (3.715 ms) : 3495, 3936
.   : milestone, 3715,
iast (2.206 ms) : 2141, 2271
.   : milestone, 2206,
iast_GLOBAL (2.249 ms) : 2183, 2315
.   : milestone, 2249,
profiling (2.063 ms) : 2011, 2116
.   : milestone, 2063,
tracing (2.047 ms) : 1996, 2099
.   : milestone, 2047,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.468 ms [1.457 ms, 1.48 ms]	-
appsec	3.727 ms [3.507 ms, 3.947 ms]	2.259 ms (153.8%)
iast	2.203 ms [2.138 ms, 2.268 ms]	734.791 µs (50.0%)
iast_GLOBAL	2.25 ms [2.185 ms, 2.316 ms]	781.925 µs (53.3%)
profiling	2.055 ms [2.003 ms, 2.108 ms]	587.096 µs (40.0%)
tracing	2.045 ms [1.994 ms, 2.097 ms]	576.949 µs (39.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.456 ms, 1.479 ms]	-
appsec	3.715 ms [3.495 ms, 3.936 ms]	2.248 ms (153.2%)
iast	2.206 ms [2.141 ms, 2.271 ms]	738.311 µs (50.3%)
iast_GLOBAL	2.249 ms [2.183 ms, 2.315 ms]	781.623 µs (53.3%)
profiling	2.063 ms [2.011 ms, 2.116 ms]	596.125 µs (40.6%)
tracing	2.047 ms [1.996 ms, 2.099 ms]	580.06 µs (39.5%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~ed582d580b, baseline=1.59.0-SNAPSHOT~231ea1aad0
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.571 s) : 15571000, 15571000
.   : milestone, 15571000,
appsec (14.564 s) : 14564000, 14564000
.   : milestone, 14564000,
iast (18.181 s) : 18181000, 18181000
.   : milestone, 18181000,
iast_GLOBAL (17.837 s) : 17837000, 17837000
.   : milestone, 17837000,
profiling (15.339 s) : 15339000, 15339000
.   : milestone, 15339000,
tracing (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
section candidate
no_agent (15.575 s) : 15575000, 15575000
.   : milestone, 15575000,
appsec (14.665 s) : 14665000, 14665000
.   : milestone, 14665000,
iast (18.234 s) : 18234000, 18234000
.   : milestone, 18234000,
iast_GLOBAL (17.886 s) : 17886000, 17886000
.   : milestone, 17886000,
profiling (14.713 s) : 14713000, 14713000
.   : milestone, 14713000,
tracing (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.571 s [15.571 s, 15.571 s]	-
appsec	14.564 s [14.564 s, 14.564 s]	-1.007 s (-6.5%)
iast	18.181 s [18.181 s, 18.181 s]	2.61 s (16.8%)
iast_GLOBAL	17.837 s [17.837 s, 17.837 s]	2.266 s (14.6%)
profiling	15.339 s [15.339 s, 15.339 s]	-232.0 ms (-1.5%)
tracing	14.831 s [14.831 s, 14.831 s]	-740.0 ms (-4.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.575 s [15.575 s, 15.575 s]	-
appsec	14.665 s [14.665 s, 14.665 s]	-910.0 ms (-5.8%)
iast	18.234 s [18.234 s, 18.234 s]	2.659 s (17.1%)
iast_GLOBAL	17.886 s [17.886 s, 17.886 s]	2.311 s (14.8%)
profiling	14.713 s [14.713 s, 14.713 s]	-862.0 ms (-5.5%)
tracing	14.8 s [14.8 s, 14.8 s]	-775.0 ms (-5.0%)

PerfectSlayer added type: enhancement Enhancements and improvements comp: testing Testing labels Dec 19, 2025

PerfectSlayer temporarily deployed to ci-build December 19, 2025 14:38 — with GitHub Actions Inactive

PerfectSlayer temporarily deployed to ci-build December 22, 2025 13:39 — with GitHub Actions Inactive

PerfectSlayer temporarily deployed to ci-build December 23, 2025 14:44 — with GitHub Actions Inactive

PerfectSlayer added 4 commits January 12, 2026 19:07

feat(test): Add instrumentation test for JUnit

9b6a1e9

feat(test): Add instrumentation test for JUnit

7505a68

feat(test): Add instrumentation test for JUnit

3352904

feat(test): Add instrumentation test for JUnit

ed582d5

PerfectSlayer force-pushed the bbujon/virtual-threads branch from dccd70a to ed582d5 Compare January 12, 2026 18:09

PerfectSlayer temporarily deployed to ci-build January 12, 2026 18:09 — with GitHub Actions Inactive

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add instrumentation tests for JUnit #10257

Add instrumentation tests for JUnit #10257

PerfectSlayer commented Dec 19, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Dec 19, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Add instrumentation tests for JUnit #10257

Are you sure you want to change the base?

Add instrumentation tests for JUnit #10257

Conversation

PerfectSlayer commented Dec 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Dec 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

PerfectSlayer commented Dec 19, 2025 •

edited

Loading

pr-commenter bot commented Dec 19, 2025 •

edited

Loading