Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Sep 1, 2024

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Sep 1, 2024
@github-actions github-actions bot requested review from a team as code owners September 1, 2024 04:16
@pr-commenter
Copy link

pr-commenter bot commented Sep 1, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240901
git_commit_date 1725046070 1725164156
git_commit_sha c279fa5 c793f8a
release_version 1.39.0-SNAPSHOT~c279fa5ed3 1.39.0-SNAPSHOT~c793f8ab63
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1725166859 1725166859
ci_job_id 623903813 623903813
ci_pipeline_id 43322702 43322702
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 16 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1049500
Total [baseline] (8.48 s) : 0, 8480054
Agent [candidate] (1.051 s) : 0, 1050876
Total [candidate] (8.495 s) : 0, 8495177
section iast
Agent [baseline] (1.174 s) : 0, 1173821
Total [baseline] (8.974 s) : 0, 8974194
Agent [candidate] (1.174 s) : 0, 1174201
Total [candidate] (9.008 s) : 0, 9007990
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.175 s) : 0, 1174877
Total [baseline] (8.943 s) : 0, 8942936
Agent [candidate] (1.171 s) : 0, 1171267
Total [candidate] (8.948 s) : 0, 8947854
section iast_TELEMETRY_OFF
Agent [baseline] (1.17 s) : 0, 1169802
Total [baseline] (8.978 s) : 0, 8977503
Agent [candidate] (1.174 s) : 0, 1173532
Total [candidate] (8.955 s) : 0, 8954712
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.174 s 124.32 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 125.377 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.17 s 120.302 ms (11.5%)
Total tracing 8.48 s -
Total iast 8.974 s 494.14 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.943 s 462.882 ms (5.5%)
Total iast_TELEMETRY_OFF 8.978 s 497.449 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.174 s 123.325 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 120.391 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.174 s 122.656 ms (11.7%)
Total tracing 8.495 s -
Total iast 9.008 s 512.814 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 8.948 s 452.677 ms (5.3%)
Total iast_TELEMETRY_OFF 8.955 s 459.535 ms (5.4%)
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.965 ms) : 0, 668965
BytebuddyAgent [candidate] (669.308 ms) : 0, 669308
GlobalTracer [baseline] (306.373 ms) : 0, 306373
GlobalTracer [candidate] (307.386 ms) : 0, 307386
AppSec [baseline] (52.428 ms) : 0, 52428
AppSec [candidate] (52.443 ms) : 0, 52443
Remote Config [baseline] (680.352 µs) : 0, 680
Remote Config [candidate] (672.074 µs) : 0, 672
Telemetry [baseline] (7.458 ms) : 0, 7458
Telemetry [candidate] (7.471 ms) : 0, 7471
section iast
BytebuddyAgent [baseline] (780.181 ms) : 0, 780181
BytebuddyAgent [candidate] (780.129 ms) : 0, 780129
GlobalTracer [baseline] (295.578 ms) : 0, 295578
GlobalTracer [candidate] (296.031 ms) : 0, 296031
AppSec [baseline] (53.228 ms) : 0, 53228
AppSec [candidate] (53.249 ms) : 0, 53249
Remote Config [baseline] (583.89 µs) : 0, 584
Remote Config [candidate] (582.689 µs) : 0, 583
Telemetry [baseline] (8.818 ms) : 0, 8818
Telemetry [candidate] (8.013 ms) : 0, 8013
IAST [baseline] (21.82 ms) : 0, 21820
IAST [candidate] (22.595 ms) : 0, 22595
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (780.376 ms) : 0, 780376
BytebuddyAgent [candidate] (778.072 ms) : 0, 778072
GlobalTracer [baseline] (296.614 ms) : 0, 296614
GlobalTracer [candidate] (295.529 ms) : 0, 295529
AppSec [baseline] (52.251 ms) : 0, 52251
AppSec [candidate] (52.162 ms) : 0, 52162
Remote Config [baseline] (586.35 µs) : 0, 586
Remote Config [candidate] (585.391 µs) : 0, 585
Telemetry [baseline] (7.304 ms) : 0, 7304
Telemetry [candidate] (8.013 ms) : 0, 8013
IAST [baseline] (24.083 ms) : 0, 24083
IAST [candidate] (23.274 ms) : 0, 23274
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (776.611 ms) : 0, 776611
BytebuddyAgent [candidate] (778.096 ms) : 0, 778096
GlobalTracer [baseline] (295.565 ms) : 0, 295565
GlobalTracer [candidate] (297.137 ms) : 0, 297137
AppSec [baseline] (52.939 ms) : 0, 52939
AppSec [candidate] (53.212 ms) : 0, 53212
Remote Config [baseline] (598.185 µs) : 0, 598
Remote Config [candidate] (603.243 µs) : 0, 603
Telemetry [baseline] (7.977 ms) : 0, 7977
Telemetry [candidate] (8.028 ms) : 0, 8028
IAST [baseline] (22.483 ms) : 0, 22483
IAST [candidate] (22.781 ms) : 0, 22781
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1051672
Total [baseline] (10.33 s) : 0, 10329568
Agent [candidate] (1.056 s) : 0, 1056452
Total [candidate] (10.296 s) : 0, 10295521
section appsec
Agent [baseline] (1.186 s) : 0, 1186088
Total [baseline] (10.625 s) : 0, 10625194
Agent [candidate] (1.188 s) : 0, 1187994
Total [candidate] (10.582 s) : 0, 10582236
section iast
Agent [baseline] (1.182 s) : 0, 1182109
Total [baseline] (10.868 s) : 0, 10868293
Agent [candidate] (1.174 s) : 0, 1173842
Total [candidate] (10.872 s) : 0, 10872415
section profiling
Agent [baseline] (1.249 s) : 0, 1248916
Total [baseline] (10.575 s) : 0, 10574766
Agent [candidate] (1.246 s) : 0, 1245901
Total [candidate] (10.629 s) : 0, 10628585
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.186 s 134.416 ms (12.8%)
Agent iast 1.182 s 130.437 ms (12.4%)
Agent profiling 1.249 s 197.244 ms (18.8%)
Total tracing 10.33 s -
Total appsec 10.625 s 295.626 ms (2.9%)
Total iast 10.868 s 538.725 ms (5.2%)
Total profiling 10.575 s 245.198 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.188 s 131.542 ms (12.5%)
Agent iast 1.174 s 117.39 ms (11.1%)
Agent profiling 1.246 s 189.449 ms (17.9%)
Total tracing 10.296 s -
Total appsec 10.582 s 286.715 ms (2.8%)
Total iast 10.872 s 576.894 ms (5.6%)
Total profiling 10.629 s 333.064 ms (3.2%)
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (669.851 ms) : 0, 669851
BytebuddyAgent [candidate] (673.812 ms) : 0, 673812
GlobalTracer [baseline] (307.552 ms) : 0, 307552
GlobalTracer [candidate] (308.72 ms) : 0, 308720
AppSec [baseline] (52.439 ms) : 0, 52439
AppSec [candidate] (52.119 ms) : 0, 52119
Remote Config [baseline] (691.834 µs) : 0, 692
Remote Config [candidate] (672.43 µs) : 0, 672
Telemetry [baseline] (7.512 ms) : 0, 7512
Telemetry [candidate] (7.431 ms) : 0, 7431
section appsec
BytebuddyAgent [baseline] (691.206 ms) : 0, 691206
BytebuddyAgent [candidate] (692.328 ms) : 0, 692328
GlobalTracer [baseline] (300.858 ms) : 0, 300858
GlobalTracer [candidate] (301.453 ms) : 0, 301453
AppSec [baseline] (161.881 ms) : 0, 161881
AppSec [candidate] (159.986 ms) : 0, 159986
Remote Config [baseline] (611.907 µs) : 0, 612
Remote Config [candidate] (614.083 µs) : 0, 614
Telemetry [baseline] (7.816 ms) : 0, 7816
Telemetry [candidate] (8.235 ms) : 0, 8235
IAST [baseline] (20.179 ms) : 0, 20179
IAST [candidate] (23.468 ms) : 0, 23468
section iast
BytebuddyAgent [baseline] (785.537 ms) : 0, 785537
BytebuddyAgent [candidate] (779.773 ms) : 0, 779773
GlobalTracer [baseline] (297.767 ms) : 0, 297767
GlobalTracer [candidate] (295.92 ms) : 0, 295920
AppSec [baseline] (52.601 ms) : 0, 52601
AppSec [candidate] (52.991 ms) : 0, 52991
Remote Config [baseline] (601.738 µs) : 0, 602
Remote Config [candidate] (602.987 µs) : 0, 603
Telemetry [baseline] (8.208 ms) : 0, 8208
Telemetry [candidate] (8.166 ms) : 0, 8166
IAST [baseline] (23.704 ms) : 0, 23704
IAST [candidate] (22.774 ms) : 0, 22774
section profiling
BytebuddyAgent [baseline] (663.832 ms) : 0, 663832
BytebuddyAgent [candidate] (662.906 ms) : 0, 662906
GlobalTracer [baseline] (389.342 ms) : 0, 389342
GlobalTracer [candidate] (388.171 ms) : 0, 388171
AppSec [baseline] (52.98 ms) : 0, 52980
AppSec [candidate] (52.875 ms) : 0, 52875
Remote Config [baseline] (684.344 µs) : 0, 684
Remote Config [candidate] (680.107 µs) : 0, 680
Telemetry [baseline] (7.376 ms) : 0, 7376
Telemetry [candidate] (7.379 ms) : 0, 7379
ProfilingAgent [baseline] (96.897 ms) : 0, 96897
ProfilingAgent [candidate] (96.165 ms) : 0, 96165
Profiling [baseline] (96.921 ms) : 0, 96921
Profiling [candidate] (96.189 ms) : 0, 96189
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-01T04:28:50 2024-09-01T04:35:35
git_branch master ci/update-gradle-dependencies-20240901
git_commit_date 1725046070 1725164156
git_commit_sha c279fa5 c793f8a
release_version 1.39.0-SNAPSHOT~c279fa5ed3 1.39.0-SNAPSHOT~c793f8ab63
start_time 2024-09-01T04:28:36 2024-09-01T04:35:22
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1725165678 1725165678
ci_job_id 623903814 623903814
ci_pipeline_id 43322702 43322702
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.318 ms) : 1299, 1337
.   : milestone, 1318,
appsec (1.694 ms) : 1671, 1717
.   : milestone, 1694,
appsec_no_iast (1.733 ms) : 1710, 1757
.   : milestone, 1733,
iast (1.463 ms) : 1440, 1485
.   : milestone, 1463,
profiling (1.48 ms) : 1457, 1503
.   : milestone, 1480,
tracing (1.453 ms) : 1427, 1479
.   : milestone, 1453,
section candidate
no_agent (1.332 ms) : 1313, 1351
.   : milestone, 1332,
appsec (1.717 ms) : 1693, 1741
.   : milestone, 1717,
appsec_no_iast (1.698 ms) : 1673, 1722
.   : milestone, 1698,
iast (1.461 ms) : 1439, 1483
.   : milestone, 1461,
profiling (1.47 ms) : 1445, 1494
.   : milestone, 1470,
tracing (1.458 ms) : 1433, 1483
.   : milestone, 1458,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.318 ms [1.299 ms, 1.337 ms] -
appsec 1.694 ms [1.671 ms, 1.717 ms] 376.02 µs (28.5%)
appsec_no_iast 1.733 ms [1.71 ms, 1.757 ms] 415.265 µs (31.5%)
iast 1.463 ms [1.44 ms, 1.485 ms] 144.798 µs (11.0%)
profiling 1.48 ms [1.457 ms, 1.503 ms] 161.97 µs (12.3%)
tracing 1.453 ms [1.427 ms, 1.479 ms] 134.749 µs (10.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.332 ms [1.313 ms, 1.351 ms] -
appsec 1.717 ms [1.693 ms, 1.741 ms] 385.026 µs (28.9%)
appsec_no_iast 1.698 ms [1.673 ms, 1.722 ms] 365.641 µs (27.5%)
iast 1.461 ms [1.439 ms, 1.483 ms] 129.483 µs (9.7%)
profiling 1.47 ms [1.445 ms, 1.494 ms] 137.659 µs (10.3%)
tracing 1.458 ms [1.433 ms, 1.483 ms] 126.193 µs (9.5%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3
    dateFormat X
    axisFormat %s
section baseline
no_agent (375.151 µs) : 355, 395
.   : milestone, 375,
iast (480.386 µs) : 459, 502
.   : milestone, 480,
iast_FULL (551.813 µs) : 531, 573
.   : milestone, 552,
iast_GLOBAL (493.877 µs) : 473, 515
.   : milestone, 494,
iast_HARDCODED_SECRET_DISABLED (481.669 µs) : 459, 504
.   : milestone, 482,
iast_INACTIVE (439.696 µs) : 419, 460
.   : milestone, 440,
iast_TELEMETRY_OFF (468.889 µs) : 447, 491
.   : milestone, 469,
tracing (435.931 µs) : 415, 457
.   : milestone, 436,
section candidate
no_agent (368.246 µs) : 348, 388
.   : milestone, 368,
iast (483.044 µs) : 461, 505
.   : milestone, 483,
iast_FULL (549.305 µs) : 528, 570
.   : milestone, 549,
iast_GLOBAL (502.233 µs) : 481, 524
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (490.276 µs) : 469, 512
.   : milestone, 490,
iast_INACTIVE (444.125 µs) : 423, 465
.   : milestone, 444,
iast_TELEMETRY_OFF (471.622 µs) : 449, 495
.   : milestone, 472,
tracing (434.628 µs) : 414, 455
.   : milestone, 435,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.151 µs [355.319 µs, 394.983 µs] -
iast 480.386 µs [458.782 µs, 501.99 µs] 105.235 µs (28.1%)
iast_FULL 551.813 µs [530.634 µs, 572.992 µs] 176.661 µs (47.1%)
iast_GLOBAL 493.877 µs [472.874 µs, 514.88 µs] 118.725 µs (31.6%)
iast_HARDCODED_SECRET_DISABLED 481.669 µs [459.051 µs, 504.287 µs] 106.518 µs (28.4%)
iast_INACTIVE 439.696 µs [418.959 µs, 460.433 µs] 64.545 µs (17.2%)
iast_TELEMETRY_OFF 468.889 µs [446.679 µs, 491.098 µs] 93.737 µs (25.0%)
tracing 435.931 µs [414.964 µs, 456.898 µs] 60.78 µs (16.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.246 µs [348.058 µs, 388.434 µs] -
iast 483.044 µs [461.108 µs, 504.98 µs] 114.798 µs (31.2%)
iast_FULL 549.305 µs [528.252 µs, 570.357 µs] 181.059 µs (49.2%)
iast_GLOBAL 502.233 µs [480.928 µs, 523.537 µs] 133.987 µs (36.4%)
iast_HARDCODED_SECRET_DISABLED 490.276 µs [469.034 µs, 511.517 µs] 122.03 µs (33.1%)
iast_INACTIVE 444.125 µs [423.222 µs, 465.028 µs] 75.879 µs (20.6%)
iast_TELEMETRY_OFF 471.622 µs [448.63 µs, 494.614 µs] 103.376 µs (28.1%)
tracing 434.628 µs [414.068 µs, 455.188 µs] 66.382 µs (18.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240901
git_commit_date 1725046070 1725164156
git_commit_sha c279fa5 c793f8a
release_version 1.39.0-SNAPSHOT~c279fa5ed3 1.39.0-SNAPSHOT~c793f8ab63
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1725166256 1725166256
ci_job_id 623903815 623903815
ci_pipeline_id 43322702 43322702
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.454 ms) : 1443, 1466
.   : milestone, 1454,
appsec (2.219 ms) : 2184, 2254
.   : milestone, 2219,
iast (1.961 ms) : 1918, 2004
.   : milestone, 1961,
iast_GLOBAL (2.005 ms) : 1962, 2048
.   : milestone, 2005,
profiling (1.853 ms) : 1818, 1888
.   : milestone, 1853,
tracing (1.833 ms) : 1800, 1866
.   : milestone, 1833,
section candidate
no_agent (1.453 ms) : 1441, 1464
.   : milestone, 1453,
appsec (2.213 ms) : 2178, 2248
.   : milestone, 2213,
iast (1.962 ms) : 1920, 2004
.   : milestone, 1962,
iast_GLOBAL (2.019 ms) : 1975, 2063
.   : milestone, 2019,
profiling (1.85 ms) : 1816, 1883
.   : milestone, 1850,
tracing (1.828 ms) : 1795, 1860
.   : milestone, 1828,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.454 ms [1.443 ms, 1.466 ms] -
appsec 2.219 ms [2.184 ms, 2.254 ms] 764.438 µs (52.6%)
iast 1.961 ms [1.918 ms, 2.004 ms] 506.507 µs (34.8%)
iast_GLOBAL 2.005 ms [1.962 ms, 2.048 ms] 550.702 µs (37.9%)
profiling 1.853 ms [1.818 ms, 1.888 ms] 398.911 µs (27.4%)
tracing 1.833 ms [1.8 ms, 1.866 ms] 378.909 µs (26.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.453 ms [1.441 ms, 1.464 ms] -
appsec 2.213 ms [2.178 ms, 2.248 ms] 759.848 µs (52.3%)
iast 1.962 ms [1.92 ms, 2.004 ms] 509.241 µs (35.1%)
iast_GLOBAL 2.019 ms [1.975 ms, 2.063 ms] 566.329 µs (39.0%)
profiling 1.85 ms [1.816 ms, 1.883 ms] 396.678 µs (27.3%)
tracing 1.828 ms [1.795 ms, 1.86 ms] 375.114 µs (25.8%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~c793f8ab63, baseline=1.39.0-SNAPSHOT~c279fa5ed3
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
appsec (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,
iast (18.827 s) : 18827000, 18827000
.   : milestone, 18827000,
iast_GLOBAL (17.988 s) : 17988000, 17988000
.   : milestone, 17988000,
profiling (15.431 s) : 15431000, 15431000
.   : milestone, 15431000,
tracing (15.236 s) : 15236000, 15236000
.   : milestone, 15236000,
section candidate
no_agent (15.431 s) : 15431000, 15431000
.   : milestone, 15431000,
appsec (15.426 s) : 15426000, 15426000
.   : milestone, 15426000,
iast (18.705 s) : 18705000, 18705000
.   : milestone, 18705000,
iast_GLOBAL (17.899 s) : 17899000, 17899000
.   : milestone, 17899000,
profiling (15.569 s) : 15569000, 15569000
.   : milestone, 15569000,
tracing (15.023 s) : 15023000, 15023000
.   : milestone, 15023000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.916 s [14.916 s, 14.916 s] -
appsec 15.023 s [15.023 s, 15.023 s] 107.0 ms (0.7%)
iast 18.827 s [18.827 s, 18.827 s] 3.911 s (26.2%)
iast_GLOBAL 17.988 s [17.988 s, 17.988 s] 3.072 s (20.6%)
profiling 15.431 s [15.431 s, 15.431 s] 515.0 ms (3.5%)
tracing 15.236 s [15.236 s, 15.236 s] 320.0 ms (2.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.431 s [15.431 s, 15.431 s] -
appsec 15.426 s [15.426 s, 15.426 s] -5.0 ms (-0.0%)
iast 18.705 s [18.705 s, 18.705 s] 3.274 s (21.2%)
iast_GLOBAL 17.899 s [17.899 s, 17.899 s] 2.468 s (16.0%)
profiling 15.569 s [15.569 s, 15.569 s] 138.0 ms (0.9%)
tracing 15.023 s [15.023 s, 15.023 s] -408.0 ms (-2.6%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 1, 2024

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240901
git_commit_date 1725046070 1725164174
git_commit_sha c279fa5 9f96a45
See matching parameters
Baseline Candidate
ci_job_date 1725165465 1725165465
ci_job_id 623904257 623904257
ci_pipeline_id 43322719 43322719
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 2 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce better
[+1962.807op/s; +5743.442op/s] or [+1.654%; +4.840%]
See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Sep 1, 2024

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20240901
git_commit_date 1725046070 1725164164
git_commit_sha c279fa5 903bbed
See matching parameters
Baseline Candidate
ci_job_date 1725165516 1725165516
ci_job_id 623903982 623903982
ci_pipeline_id 43322707 43322707
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.21 11.0.21
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.21+9-post-Ubuntu-0ubuntu122.04 11.0.21+9-post-Ubuntu-0ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@smola smola merged commit 9b13f14 into master Sep 2, 2024
@smola smola deleted the ci/update-gradle-dependencies-20240901 branch September 2, 2024 06:34
@PerfectSlayer PerfectSlayer added this to the 1.39.0 milestone Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants