Wider exception check in AWS sdk v1 tests #9492

vandonr · 2025-09-08T12:58:13Z

added the error that caused the flake as an acceptable error for the test
also relaxed the check on the text of the SdkClientException on AI suggestion.

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

added the error that caused the flake as an acceptable error for the test also relaxed the check on the text of the SdkClientException on AI suggestion.

github-actions · 2025-09-08T12:58:24Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Remove the tag from the pull request title

If you need help, please check our contributing guidelines.

pr-commenter · 2025-09-08T13:30:17Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	vandonr/fix
git_commit_date	1757330499	1757336213
git_commit_sha	`3ff796a`	`d332072`
release_version	1.54.0-SNAPSHOT~3ff796af33	1.54.0-SNAPSHOT~d332072632

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1757337942	1757337942
ci_job_id	1118142583	1118142583
ci_pipeline_id	75817536	75817536
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-11mq1ote 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-11mq1ote 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 14 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057792
Total [baseline] (8.642 s) : 0, 8641654
Agent [candidate] (1.051 s) : 0, 1050881
Total [candidate] (8.628 s) : 0, 8627801
section iast
Agent [baseline] (1.176 s) : 0, 1175870
Total [baseline] (9.374 s) : 0, 9373862
Agent [candidate] (1.176 s) : 0, 1175797
Total [candidate] (9.362 s) : 0, 9362286

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.176 s	118.077 ms (11.2%)
Total	tracing	8.642 s	-
Total	iast	9.374 s	732.207 ms (8.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	iast	1.176 s	124.917 ms (11.9%)
Total	tracing	8.628 s	-
Total	iast	9.362 s	734.484 ms (8.5%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (740.931 ms) : 0, 740931
BytebuddyAgent [candidate] (736.592 ms) : 0, 736592
GlobalTracer [baseline] (243.258 ms) : 0, 243258
GlobalTracer [candidate] (243.363 ms) : 0, 243363
AppSec [baseline] (30.271 ms) : 0, 30271
AppSec [candidate] (30.118 ms) : 0, 30118
Debugger [baseline] (6.086 ms) : 0, 6086
Debugger [candidate] (6.073 ms) : 0, 6073
Remote Config [baseline] (704.758 µs) : 0, 705
Remote Config [candidate] (688.233 µs) : 0, 688
Telemetry [baseline] (13.887 ms) : 0, 13887
Telemetry [candidate] (11.469 ms) : 0, 11469
section iast
crashtracking [baseline] (1.44 ms) : 0, 1440
crashtracking [candidate] (1.44 ms) : 0, 1440
BytebuddyAgent [baseline] (848.691 ms) : 0, 848691
BytebuddyAgent [candidate] (848.775 ms) : 0, 848775
GlobalTracer [baseline] (231.959 ms) : 0, 231959
GlobalTracer [candidate] (231.936 ms) : 0, 231936
AppSec [baseline] (25.367 ms) : 0, 25367
AppSec [candidate] (25.204 ms) : 0, 25204
Debugger [baseline] (6.725 ms) : 0, 6725
Debugger [candidate] (7.499 ms) : 0, 7499
Remote Config [baseline] (613.564 µs) : 0, 614
Remote Config [candidate] (604.719 µs) : 0, 605
Telemetry [baseline] (8.183 ms) : 0, 8183
Telemetry [candidate] (8.185 ms) : 0, 8185
IAST [baseline] (31.862 ms) : 0, 31862
IAST [candidate] (31.181 ms) : 0, 31181

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051071
Total [baseline] (10.709 s) : 0, 10708858
Agent [candidate] (1.055 s) : 0, 1055413
Total [candidate] (10.691 s) : 0, 10691218
section appsec
Agent [baseline] (1.222 s) : 0, 1221750
Total [baseline] (10.76 s) : 0, 10759910
Agent [candidate] (1.223 s) : 0, 1223482
Total [candidate] (10.842 s) : 0, 10841609
section iast
Agent [baseline] (1.195 s) : 0, 1194966
Total [baseline] (10.954 s) : 0, 10954158
Agent [candidate] (1.182 s) : 0, 1181853
Total [candidate] (10.977 s) : 0, 10977237
section profiling
Agent [baseline] (1.2 s) : 0, 1199999
Total [baseline] (10.86 s) : 0, 10859529
Agent [candidate] (1.197 s) : 0, 1197161
Total [candidate] (10.819 s) : 0, 10818921

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	appsec	1.222 s	170.68 ms (16.2%)
Agent	iast	1.195 s	143.896 ms (13.7%)
Agent	profiling	1.2 s	148.928 ms (14.2%)
Total	tracing	10.709 s	-
Total	appsec	10.76 s	51.052 ms (0.5%)
Total	iast	10.954 s	245.3 ms (2.3%)
Total	profiling	10.86 s	150.671 ms (1.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	appsec	1.223 s	168.069 ms (15.9%)
Agent	iast	1.182 s	126.44 ms (12.0%)
Agent	profiling	1.197 s	141.748 ms (13.4%)
Total	tracing	10.691 s	-
Total	appsec	10.842 s	150.391 ms (1.4%)
Total	iast	10.977 s	286.019 ms (2.7%)
Total	profiling	10.819 s	127.703 ms (1.2%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (735.483 ms) : 0, 735483
BytebuddyAgent [candidate] (738.932 ms) : 0, 738932
GlobalTracer [baseline] (241.722 ms) : 0, 241722
GlobalTracer [candidate] (244.136 ms) : 0, 244136
AppSec [baseline] (30.156 ms) : 0, 30156
AppSec [candidate] (30.358 ms) : 0, 30358
Debugger [baseline] (6.021 ms) : 0, 6021
Debugger [candidate] (6.158 ms) : 0, 6158
Remote Config [baseline] (680.531 µs) : 0, 681
Remote Config [candidate] (723.338 µs) : 0, 723
Telemetry [baseline] (14.423 ms) : 0, 14423
Telemetry [candidate] (12.428 ms) : 0, 12428
section appsec
crashtracking [baseline] (1.434 ms) : 0, 1434
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (754.403 ms) : 0, 754403
BytebuddyAgent [candidate] (755.681 ms) : 0, 755681
GlobalTracer [baseline] (235.13 ms) : 0, 235130
GlobalTracer [candidate] (235.567 ms) : 0, 235567
AppSec [baseline] (168.183 ms) : 0, 168183
AppSec [candidate] (168.907 ms) : 0, 168907
Debugger [baseline] (6.492 ms) : 0, 6492
Debugger [candidate] (8.096 ms) : 0, 8096
Remote Config [baseline] (620.319 µs) : 0, 620
Remote Config [candidate] (613.436 µs) : 0, 613
Telemetry [baseline] (10.865 ms) : 0, 10865
Telemetry [candidate] (8.483 ms) : 0, 8483
IAST [baseline] (23.566 ms) : 0, 23566
IAST [candidate] (23.656 ms) : 0, 23656
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (863.698 ms) : 0, 863698
BytebuddyAgent [candidate] (852.978 ms) : 0, 852978
GlobalTracer [baseline] (234.805 ms) : 0, 234805
GlobalTracer [candidate] (233.558 ms) : 0, 233558
AppSec [baseline] (27.307 ms) : 0, 27307
AppSec [candidate] (27.583 ms) : 0, 27583
Debugger [baseline] (7.458 ms) : 0, 7458
Debugger [candidate] (5.78 ms) : 0, 5780
Remote Config [baseline] (621.743 µs) : 0, 622
Remote Config [candidate] (601.293 µs) : 0, 601
Telemetry [baseline] (8.472 ms) : 0, 8472
Telemetry [candidate] (8.254 ms) : 0, 8254
IAST [baseline] (29.856 ms) : 0, 29856
IAST [candidate] (30.528 ms) : 0, 30528
section profiling
crashtracking [baseline] (1.428 ms) : 0, 1428
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (763.237 ms) : 0, 763237
BytebuddyAgent [candidate] (760.337 ms) : 0, 760337
GlobalTracer [baseline] (222.625 ms) : 0, 222625
GlobalTracer [candidate] (222.521 ms) : 0, 222521
AppSec [baseline] (30.623 ms) : 0, 30623
AppSec [candidate] (30.513 ms) : 0, 30513
Debugger [baseline] (6.284 ms) : 0, 6284
Debugger [candidate] (6.23 ms) : 0, 6230
Remote Config [baseline] (717.998 µs) : 0, 718
Remote Config [candidate] (704.315 µs) : 0, 704
Telemetry [baseline] (15.784 ms) : 0, 15784
Telemetry [candidate] (16.598 ms) : 0, 16598
ProfilingAgent [baseline] (108.726 ms) : 0, 108726
ProfilingAgent [candidate] (108.392 ms) : 0, 108392
Profiling [baseline] (109.392 ms) : 0, 109392
Profiling [candidate] (109.062 ms) : 0, 109062

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	vandonr/fix
git_commit_date	1757330499	1757336213
git_commit_sha	`3ff796a`	`d332072`
release_version	1.54.0-SNAPSHOT~3ff796af33	1.54.0-SNAPSHOT~d332072632

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1757337621	1757337621
ci_job_id	1118142584	1118142584
ci_pipeline_id	75817536	75817536
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-3mk28jck 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-3mk28jck 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+550.162µs; +796.888µs] or [+7.390%; +10.705%]	unstable [-124.080op/s; +21.892op/s] or [-19.954%; +3.521%]	8.118ms	570.750op/s	7.444ms	621.844op/s
scenario:load:insecure-bank:no_agent:high_load	better [-267.567µs; -157.995µs] or [-5.789%; -3.418%]	unstable [-65.356op/s; +158.731op/s] or [-6.576%; +15.971%]	4.409ms	1040.531op/s	4.622ms	993.844op/s
scenario:load:petclinic:tracing:high_load	better [-2.248ms; -1.408ms] or [-4.887%; -3.061%]	unstable [-3.040op/s; +11.440op/s] or [-2.989%; +11.249%]	44.163ms	105.900op/s	45.991ms	101.700op/s
scenario:load:petclinic:code_origins:high_load	worse [+0.990ms; +1.833ms] or [+2.217%; +4.105%]	unstable [-10.382op/s; +3.907op/s] or [-9.907%; +3.728%]	46.075ms	101.550op/s	44.664ms	104.787op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.622 ms) : 4569, 4675
.   : milestone, 4622,
iast (9.346 ms) : 9185, 9508
.   : milestone, 9346,
iast_FULL (14.029 ms) : 13751, 14306
.   : milestone, 14029,
iast_GLOBAL (10.604 ms) : 10402, 10806
.   : milestone, 10604,
profiling (9.19 ms) : 9040, 9339
.   : milestone, 9190,
tracing (7.444 ms) : 7334, 7555
.   : milestone, 7444,
section candidate
no_agent (4.409 ms) : 4360, 4458
.   : milestone, 4409,
iast (9.55 ms) : 9380, 9720
.   : milestone, 9550,
iast_FULL (13.964 ms) : 13688, 14239
.   : milestone, 13964,
iast_GLOBAL (10.53 ms) : 10339, 10721
.   : milestone, 10530,
profiling (8.887 ms) : 8752, 9022
.   : milestone, 8887,
tracing (8.118 ms) : 7999, 8236
.   : milestone, 8118,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.622 ms [4.569 ms, 4.675 ms]	-
iast	9.346 ms [9.185 ms, 9.508 ms]	4.724 ms (102.2%)
iast_FULL	14.029 ms [13.751 ms, 14.306 ms]	9.407 ms (203.5%)
iast_GLOBAL	10.604 ms [10.402 ms, 10.806 ms]	5.982 ms (129.4%)
profiling	9.19 ms [9.04 ms, 9.339 ms]	4.567 ms (98.8%)
tracing	7.444 ms [7.334 ms, 7.555 ms]	2.822 ms (61.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.409 ms [4.36 ms, 4.458 ms]	-
iast	9.55 ms [9.38 ms, 9.72 ms]	5.141 ms (116.6%)
iast_FULL	13.964 ms [13.688 ms, 14.239 ms]	9.554 ms (216.7%)
iast_GLOBAL	10.53 ms [10.339 ms, 10.721 ms]	6.121 ms (138.8%)
profiling	8.887 ms [8.752 ms, 9.022 ms]	4.478 ms (101.6%)
tracing	8.118 ms [7.999 ms, 8.236 ms]	3.709 ms (84.1%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.051 ms) : 36752, 37349
.   : milestone, 37051,
appsec (47.752 ms) : 47331, 48172
.   : milestone, 47752,
code_origins (44.664 ms) : 44284, 45044
.   : milestone, 44664,
iast (44.595 ms) : 44208, 44982
.   : milestone, 44595,
profiling (49.587 ms) : 49146, 50028
.   : milestone, 49587,
tracing (45.991 ms) : 45589, 46393
.   : milestone, 45991,
section candidate
no_agent (37.021 ms) : 36716, 37327
.   : milestone, 37021,
appsec (46.999 ms) : 46588, 47409
.   : milestone, 46999,
code_origins (46.075 ms) : 45672, 46479
.   : milestone, 46075,
iast (44.658 ms) : 44264, 45053
.   : milestone, 44658,
profiling (48.367 ms) : 47917, 48817
.   : milestone, 48367,
tracing (44.163 ms) : 43786, 44541
.   : milestone, 44163,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.051 ms [36.752 ms, 37.349 ms]	-
appsec	47.752 ms [47.331 ms, 48.172 ms]	10.701 ms (28.9%)
code_origins	44.664 ms [44.284 ms, 45.044 ms]	7.613 ms (20.5%)
iast	44.595 ms [44.208 ms, 44.982 ms]	7.545 ms (20.4%)
profiling	49.587 ms [49.146 ms, 50.028 ms]	12.536 ms (33.8%)
tracing	45.991 ms [45.589 ms, 46.393 ms]	8.941 ms (24.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.021 ms [36.716 ms, 37.327 ms]	-
appsec	46.999 ms [46.588 ms, 47.409 ms]	9.977 ms (26.9%)
code_origins	46.075 ms [45.672 ms, 46.479 ms]	9.054 ms (24.5%)
iast	44.658 ms [44.264 ms, 45.053 ms]	7.637 ms (20.6%)
profiling	48.367 ms [47.917 ms, 48.817 ms]	11.346 ms (30.6%)
tracing	44.163 ms [43.786 ms, 44.541 ms]	7.142 ms (19.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	vandonr/fix
git_commit_date	1757330499	1757336213
git_commit_sha	`3ff796a`	`d332072`
release_version	1.54.0-SNAPSHOT~3ff796af33	1.54.0-SNAPSHOT~d332072632

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1757338136	1757338136
ci_job_id	1118142585	1118142585
ci_pipeline_id	75817536	75817536
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-gwft6yh6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-gwft6yh6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.967 s) : 14967000, 14967000
.   : milestone, 14967000,
appsec (14.748 s) : 14748000, 14748000
.   : milestone, 14748000,
iast (18.325 s) : 18325000, 18325000
.   : milestone, 18325000,
iast_GLOBAL (18.061 s) : 18061000, 18061000
.   : milestone, 18061000,
profiling (15.435 s) : 15435000, 15435000
.   : milestone, 15435000,
tracing (14.836 s) : 14836000, 14836000
.   : milestone, 14836000,
section candidate
no_agent (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
appsec (15.021 s) : 15021000, 15021000
.   : milestone, 15021000,
iast (18.933 s) : 18933000, 18933000
.   : milestone, 18933000,
iast_GLOBAL (18.235 s) : 18235000, 18235000
.   : milestone, 18235000,
profiling (15.29 s) : 15290000, 15290000
.   : milestone, 15290000,
tracing (15.15 s) : 15150000, 15150000
.   : milestone, 15150000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.967 s [14.967 s, 14.967 s]	-
appsec	14.748 s [14.748 s, 14.748 s]	-219.0 ms (-1.5%)
iast	18.325 s [18.325 s, 18.325 s]	3.358 s (22.4%)
iast_GLOBAL	18.061 s [18.061 s, 18.061 s]	3.094 s (20.7%)
profiling	15.435 s [15.435 s, 15.435 s]	468.0 ms (3.1%)
tracing	14.836 s [14.836 s, 14.836 s]	-131.0 ms (-0.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.004 s [15.004 s, 15.004 s]	-
appsec	15.021 s [15.021 s, 15.021 s]	17.0 ms (0.1%)
iast	18.933 s [18.933 s, 18.933 s]	3.929 s (26.2%)
iast_GLOBAL	18.235 s [18.235 s, 18.235 s]	3.231 s (21.5%)
profiling	15.29 s [15.29 s, 15.29 s]	286.0 ms (1.9%)
tracing	15.15 s [15.15 s, 15.15 s]	146.0 ms (1.0%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d332072632, baseline=1.54.0-SNAPSHOT~3ff796af33
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.665 ms) : 3449, 3880
.   : milestone, 3665,
iast (2.199 ms) : 2136, 2262
.   : milestone, 2199,
iast_GLOBAL (2.244 ms) : 2181, 2307
.   : milestone, 2244,
profiling (2.051 ms) : 2000, 2103
.   : milestone, 2051,
tracing (2.005 ms) : 1956, 2053
.   : milestone, 2005,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.657 ms) : 3443, 3871
.   : milestone, 3657,
iast (2.193 ms) : 2131, 2256
.   : milestone, 2193,
iast_GLOBAL (2.235 ms) : 2172, 2297
.   : milestone, 2235,
profiling (2.037 ms) : 1987, 2088
.   : milestone, 2037,
tracing (2.013 ms) : 1965, 2061
.   : milestone, 2013,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.463 ms, 1.486 ms]	-
appsec	3.665 ms [3.449 ms, 3.88 ms]	2.19 ms (148.5%)
iast	2.199 ms [2.136 ms, 2.262 ms]	724.105 µs (49.1%)
iast_GLOBAL	2.244 ms [2.181 ms, 2.307 ms]	769.318 µs (52.2%)
profiling	2.051 ms [2.0 ms, 2.103 ms]	576.667 µs (39.1%)
tracing	2.005 ms [1.956 ms, 2.053 ms]	530.003 µs (35.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	3.657 ms [3.443 ms, 3.871 ms]	2.18 ms (147.6%)
iast	2.193 ms [2.131 ms, 2.256 ms]	716.025 µs (48.5%)
iast_GLOBAL	2.235 ms [2.172 ms, 2.297 ms]	757.256 µs (51.3%)
profiling	2.037 ms [1.987 ms, 2.088 ms]	560.053 µs (37.9%)
tracing	2.013 ms [1.965 ms, 2.061 ms]	535.821 µs (36.3%)

Wider exception check in AWS sdk v1 tests

d332072

added the error that caused the flake as an acceptable error for the test also relaxed the check on the text of the SdkClientException on AI suggestion.

vandonr requested a review from a team as a code owner September 8, 2025 12:58

vandonr added comp: testing Testing tag: no release notes Changes to exclude from release notes type: refactoring inst: aws sdk AWS SDK instrumentation labels Sep 8, 2025

vandonr added comp: database Database Monitoring and removed comp: database Database Monitoring labels Sep 9, 2025

vandonr changed the title ~~[flake fix] Wider exception check in AWS sdk v1 tests~~ Wider exception check in AWS sdk v1 tests Sep 9, 2025

AlexeyKuznetsov-DD approved these changes Sep 9, 2025

View reviewed changes

vandonr merged commit 52c71a7 into master Sep 10, 2025
676 of 681 checks passed

vandonr deleted the vandonr/fix branch September 10, 2025 06:42

github-actions bot added this to the 1.54.0 milestone Sep 10, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Wider exception check in AWS sdk v1 tests #9492

Wider exception check in AWS sdk v1 tests #9492

Uh oh!

vandonr commented Sep 8, 2025

Uh oh!

github-actions bot commented Sep 8, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Sep 8, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Wider exception check in AWS sdk v1 tests #9492

Wider exception check in AWS sdk v1 tests #9492

Uh oh!

Conversation

vandonr commented Sep 8, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented Sep 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Sep 8, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

github-actions bot commented Sep 8, 2025 •

edited

Loading