Skip to content

Upload test logs to DataDog Test Visibility #7473

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
smola merged 2 commits into from
Aug 20, 2024
Merged

Upload test logs to DataDog Test Visibility #7473

smola merged 2 commits into from
Aug 20, 2024

Conversation

@smola
Copy link
Member

@smola smola commented Aug 19, 2024 •
edited
Loading

What Does This Do

See --logs at https://docs.datadoghq.com/tests/setup/junit_xml/

This uploads any logs found in the JUnit XML reports to our logs backend, tagged with dd-trace-java service and @test.suite.

Motivation

Additional Notes

Contributor Checklist

@smola smola added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Aug 19, 2024
@smola smola requested a review from a team as a code owner August 19, 2024 13:29
@smola smola requested review from dougqh and ygree August 19, 2024 13:29
@pr-commenter
Copy link

pr-commenter bot commented Aug 19, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/test-visibility-logs
git_commit_date 1724076268 1724084558
git_commit_sha b0e4869 9869d14
release_version 1.39.0-SNAPSHOT~b0e4869c0b 1.39.0-SNAPSHOT~9869d14357
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724087005 1724087005
ci_job_id 609202596 609202596
ci_pipeline_id 42146650 42146650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 17 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063772
Total [baseline] (8.549 s) : 0, 8548771
Agent [candidate] (1.054 s) : 0, 1053716
Total [candidate] (8.543 s) : 0, 8542533
section iast
Agent [baseline] (1.196 s) : 0, 1195984
Total [baseline] (9.039 s) : 0, 9039141
Agent [candidate] (1.185 s) : 0, 1184581
Total [candidate] (8.998 s) : 0, 8998403
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.182 s) : 0, 1181866
Total [baseline] (8.984 s) : 0, 8984157
Agent [candidate] (1.178 s) : 0, 1178113
Total [candidate] (8.963 s) : 0, 8962808
section iast_TELEMETRY_OFF
Agent [baseline] (1.174 s) : 0, 1174097
Total [baseline] (8.96 s) : 0, 8960410
Agent [candidate] (1.182 s) : 0, 1182147
Total [candidate] (9.011 s) : 0, 9010511
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.196 s 132.212 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 118.093 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.174 s 110.324 ms (10.4%)
Total tracing 8.549 s -
Total iast 9.039 s 490.37 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 8.984 s 435.387 ms (5.1%)
Total iast_TELEMETRY_OFF 8.96 s 411.639 ms (4.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.185 s 130.865 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 124.397 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.182 s 128.43 ms (12.2%)
Total tracing 8.543 s -
Total iast 8.998 s 455.87 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.963 s 420.275 ms (4.9%)
Total iast_TELEMETRY_OFF 9.011 s 467.978 ms (5.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (679.652 ms) : 0, 679652
BytebuddyAgent [candidate] (672.41 ms) : 0, 672410
GlobalTracer [baseline] (310.835 ms) : 0, 310835
GlobalTracer [candidate] (308.092 ms) : 0, 308092
AppSec [baseline] (51.41 ms) : 0, 51410
AppSec [candidate] (51.359 ms) : 0, 51359
Remote Config [baseline] (687.886 µs) : 0, 688
Remote Config [candidate] (689.918 µs) : 0, 690
Telemetry [baseline] (7.499 ms) : 0, 7499
Telemetry [candidate] (7.588 ms) : 0, 7588
section iast
BytebuddyAgent [baseline] (796.561 ms) : 0, 796561
BytebuddyAgent [candidate] (788.484 ms) : 0, 788484
GlobalTracer [baseline] (300.676 ms) : 0, 300676
GlobalTracer [candidate] (298.347 ms) : 0, 298347
AppSec [baseline] (53.022 ms) : 0, 53022
AppSec [candidate] (52.03 ms) : 0, 52030
IAST [baseline] (24.32 ms) : 0, 24320
IAST [candidate] (22.763 ms) : 0, 22763
Remote Config [baseline] (577.608 µs) : 0, 578
Remote Config [candidate] (611.489 µs) : 0, 611
Telemetry [baseline] (7.16 ms) : 0, 7160
Telemetry [candidate] (8.753 ms) : 0, 8753
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (786.101 ms) : 0, 786101
BytebuddyAgent [candidate] (783.206 ms) : 0, 783206
GlobalTracer [baseline] (298.173 ms) : 0, 298173
GlobalTracer [candidate] (297.437 ms) : 0, 297437
AppSec [baseline] (50.353 ms) : 0, 50353
AppSec [candidate] (49.507 ms) : 0, 49507
IAST [baseline] (24.425 ms) : 0, 24425
IAST [candidate] (25.832 ms) : 0, 25832
Remote Config [baseline] (575.502 µs) : 0, 576
Remote Config [candidate] (571.833 µs) : 0, 572
Telemetry [baseline] (8.661 ms) : 0, 8661
Telemetry [candidate] (8.004 ms) : 0, 8004
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (781.312 ms) : 0, 781312
BytebuddyAgent [candidate] (786.67 ms) : 0, 786670
GlobalTracer [baseline] (296.883 ms) : 0, 296883
GlobalTracer [candidate] (299.461 ms) : 0, 299461
AppSec [baseline] (51.544 ms) : 0, 51544
AppSec [candidate] (53.075 ms) : 0, 53075
IAST [baseline] (22.332 ms) : 0, 22332
IAST [candidate] (21.53 ms) : 0, 21530
Remote Config [baseline] (623.932 µs) : 0, 624
Remote Config [candidate] (613.803 µs) : 0, 614
Telemetry [baseline] (7.907 ms) : 0, 7907
Telemetry [candidate] (7.124 ms) : 0, 7124
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1063073
Total [baseline] (10.396 s) : 0, 10395553
Agent [candidate] (1.049 s) : 0, 1049295
Total [candidate] (10.393 s) : 0, 10393472
section appsec
Agent [baseline] (1.175 s) : 0, 1175212
Total [baseline] (10.452 s) : 0, 10452463
Agent [candidate] (1.176 s) : 0, 1176014
Total [candidate] (10.501 s) : 0, 10501425
section iast
Agent [baseline] (1.187 s) : 0, 1187296
Total [baseline] (10.888 s) : 0, 10887690
Agent [candidate] (1.174 s) : 0, 1174355
Total [candidate] (10.864 s) : 0, 10863627
section profiling
Agent [baseline] (1.244 s) : 0, 1244261
Total [baseline] (10.77 s) : 0, 10769597
Agent [candidate] (1.248 s) : 0, 1248376
Total [candidate] (10.619 s) : 0, 10618511
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.175 s 112.138 ms (10.5%)
Agent iast 1.187 s 124.223 ms (11.7%)
Agent profiling 1.244 s 181.188 ms (17.0%)
Total tracing 10.396 s -
Total appsec 10.452 s 56.91 ms (0.5%)
Total iast 10.888 s 492.137 ms (4.7%)
Total profiling 10.77 s 374.044 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.176 s 126.719 ms (12.1%)
Agent iast 1.174 s 125.06 ms (11.9%)
Agent profiling 1.248 s 199.081 ms (19.0%)
Total tracing 10.393 s -
Total appsec 10.501 s 107.952 ms (1.0%)
Total iast 10.864 s 470.155 ms (4.5%)
Total profiling 10.619 s 225.038 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (678.952 ms) : 0, 678952
BytebuddyAgent [candidate] (669.374 ms) : 0, 669374
GlobalTracer [baseline] (310.516 ms) : 0, 310516
GlobalTracer [candidate] (307.114 ms) : 0, 307114
AppSec [baseline] (51.624 ms) : 0, 51624
AppSec [candidate] (51.076 ms) : 0, 51076
Remote Config [baseline] (696.601 µs) : 0, 697
Remote Config [candidate] (699.41 µs) : 0, 699
Telemetry [baseline] (7.668 ms) : 0, 7668
Telemetry [candidate] (7.572 ms) : 0, 7572
section appsec
BytebuddyAgent [baseline] (681.759 ms) : 0, 681759
BytebuddyAgent [candidate] (681.956 ms) : 0, 681956
GlobalTracer [baseline] (301.506 ms) : 0, 301506
GlobalTracer [candidate] (301.922 ms) : 0, 301922
AppSec [baseline] (158.01 ms) : 0, 158010
AppSec [candidate] (158.185 ms) : 0, 158185
IAST [baseline] (19.679 ms) : 0, 19679
IAST [candidate] (22.074 ms) : 0, 22074
Remote Config [baseline] (606.221 µs) : 0, 606
Remote Config [candidate] (607.189 µs) : 0, 607
Telemetry [baseline] (9.953 ms) : 0, 9953
Telemetry [candidate] (8.739 ms) : 0, 8739
section iast
BytebuddyAgent [baseline] (789.995 ms) : 0, 789995
BytebuddyAgent [candidate] (780.803 ms) : 0, 780803
GlobalTracer [baseline] (298.642 ms) : 0, 298642
GlobalTracer [candidate] (295.874 ms) : 0, 295874
AppSec [baseline] (52.102 ms) : 0, 52102
AppSec [candidate] (51.444 ms) : 0, 51444
IAST [baseline] (23.476 ms) : 0, 23476
IAST [candidate] (22.564 ms) : 0, 22564
Remote Config [baseline] (644.436 µs) : 0, 644
Remote Config [candidate] (575.267 µs) : 0, 575
Telemetry [baseline] (8.809 ms) : 0, 8809
Telemetry [candidate] (9.619 ms) : 0, 9619
section profiling
BytebuddyAgent [baseline] (663.353 ms) : 0, 663353
BytebuddyAgent [candidate] (665.34 ms) : 0, 665340
GlobalTracer [baseline] (388.891 ms) : 0, 388891
GlobalTracer [candidate] (389.612 ms) : 0, 389612
AppSec [baseline] (51.87 ms) : 0, 51870
AppSec [candidate] (52.434 ms) : 0, 52434
Remote Config [baseline] (715.551 µs) : 0, 716
Remote Config [candidate] (687.309 µs) : 0, 687
Telemetry [baseline] (7.393 ms) : 0, 7393
Telemetry [candidate] (7.452 ms) : 0, 7452
ProfilingAgent [baseline] (94.846 ms) : 0, 94846
ProfilingAgent [candidate] (95.561 ms) : 0, 95561
Profiling [baseline] (94.87 ms) : 0, 94870
Profiling [candidate] (95.586 ms) : 0, 95586
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-19T16:34:06 2024-08-19T16:40:56
git_branch master smola/test-visibility-logs
git_commit_date 1724076268 1724084558
git_commit_sha b0e4869 9869d14
release_version 1.39.0-SNAPSHOT~b0e4869c0b 1.39.0-SNAPSHOT~9869d14357
start_time 2024-08-19T16:33:53 2024-08-19T16:40:43
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724086002 1724086002
ci_job_id 609202597 609202597
ci_pipeline_id 42146650 42146650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.331 ms) : 1312, 1350
.   : milestone, 1331,
appsec (1.717 ms) : 1694, 1741
.   : milestone, 1717,
appsec_no_iast (1.738 ms) : 1714, 1762
.   : milestone, 1738,
iast (1.489 ms) : 1467, 1511
.   : milestone, 1489,
profiling (1.524 ms) : 1498, 1549
.   : milestone, 1524,
tracing (1.473 ms) : 1449, 1497
.   : milestone, 1473,
section candidate
no_agent (1.342 ms) : 1322, 1361
.   : milestone, 1342,
appsec (1.728 ms) : 1704, 1752
.   : milestone, 1728,
appsec_no_iast (1.735 ms) : 1711, 1759
.   : milestone, 1735,
iast (1.474 ms) : 1451, 1497
.   : milestone, 1474,
profiling (1.535 ms) : 1509, 1561
.   : milestone, 1535,
tracing (1.467 ms) : 1444, 1491
.   : milestone, 1467,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.331 ms [1.312 ms, 1.35 ms] -
appsec 1.717 ms [1.694 ms, 1.741 ms] 386.332 µs (29.0%)
appsec_no_iast 1.738 ms [1.714 ms, 1.762 ms] 407.21 µs (30.6%)
iast 1.489 ms [1.467 ms, 1.511 ms] 157.709 µs (11.8%)
profiling 1.524 ms [1.498 ms, 1.549 ms] 192.573 µs (14.5%)
tracing 1.473 ms [1.449 ms, 1.497 ms] 141.857 µs (10.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.342 ms [1.322 ms, 1.361 ms] -
appsec 1.728 ms [1.704 ms, 1.752 ms] 386.574 µs (28.8%)
appsec_no_iast 1.735 ms [1.711 ms, 1.759 ms] 393.557 µs (29.3%)
iast 1.474 ms [1.451 ms, 1.497 ms] 132.62 µs (9.9%)
profiling 1.535 ms [1.509 ms, 1.561 ms] 193.557 µs (14.4%)
tracing 1.467 ms [1.444 ms, 1.491 ms] 125.773 µs (9.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b
    dateFormat X
    axisFormat %s
section baseline
no_agent (364.388 µs) : 345, 384
.   : milestone, 364,
iast (482.878 µs) : 462, 504
.   : milestone, 483,
iast_FULL (555.749 µs) : 533, 578
.   : milestone, 556,
iast_GLOBAL (504.942 µs) : 482, 528
.   : milestone, 505,
iast_HARDCODED_SECRET_DISABLED (476.112 µs) : 455, 497
.   : milestone, 476,
iast_INACTIVE (457.087 µs) : 435, 480
.   : milestone, 457,
iast_TELEMETRY_OFF (473.585 µs) : 452, 495
.   : milestone, 474,
tracing (438.595 µs) : 418, 459
.   : milestone, 439,
section candidate
no_agent (365.444 µs) : 346, 385
.   : milestone, 365,
iast (476.971 µs) : 456, 498
.   : milestone, 477,
iast_FULL (555.624 µs) : 533, 578
.   : milestone, 556,
iast_GLOBAL (516.954 µs) : 493, 541
.   : milestone, 517,
iast_HARDCODED_SECRET_DISABLED (485.55 µs) : 463, 508
.   : milestone, 486,
iast_INACTIVE (457.637 µs) : 435, 481
.   : milestone, 458,
iast_TELEMETRY_OFF (475.885 µs) : 454, 497
.   : milestone, 476,
tracing (444.962 µs) : 425, 465
.   : milestone, 445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 364.388 µs [345.178 µs, 383.597 µs] -
iast 482.878 µs [461.643 µs, 504.114 µs] 118.491 µs (32.5%)
iast_FULL 555.749 µs [533.291 µs, 578.208 µs] 191.362 µs (52.5%)
iast_GLOBAL 504.942 µs [482.327 µs, 527.557 µs] 140.554 µs (38.6%)
iast_HARDCODED_SECRET_DISABLED 476.112 µs [455.272 µs, 496.951 µs] 111.724 µs (30.7%)
iast_INACTIVE 457.087 µs [434.636 µs, 479.538 µs] 92.7 µs (25.4%)
iast_TELEMETRY_OFF 473.585 µs [451.981 µs, 495.188 µs] 109.197 µs (30.0%)
tracing 438.595 µs [418.334 µs, 458.857 µs] 74.208 µs (20.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 365.444 µs [345.662 µs, 385.227 µs] -
iast 476.971 µs [455.981 µs, 497.96 µs] 111.526 µs (30.5%)
iast_FULL 555.624 µs [533.454 µs, 577.794 µs] 190.179 µs (52.0%)
iast_GLOBAL 516.954 µs [492.876 µs, 541.032 µs] 151.509 µs (41.5%)
iast_HARDCODED_SECRET_DISABLED 485.55 µs [463.46 µs, 507.639 µs] 120.105 µs (32.9%)
iast_INACTIVE 457.637 µs [434.705 µs, 480.569 µs] 92.192 µs (25.2%)
iast_TELEMETRY_OFF 475.885 µs [454.376 µs, 497.394 µs] 110.441 µs (30.2%)
tracing 444.962 µs [424.706 µs, 465.218 µs] 79.518 µs (21.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/test-visibility-logs
git_commit_date 1724076268 1724084558
git_commit_sha b0e4869 9869d14
release_version 1.39.0-SNAPSHOT~b0e4869c0b 1.39.0-SNAPSHOT~9869d14357
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1724086546 1724086546
ci_job_id 609202599 609202599
ci_pipeline_id 42146650 42146650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1451, 1474
.   : milestone, 1462,
appsec (2.216 ms) : 2182, 2251
.   : milestone, 2216,
iast (1.956 ms) : 1915, 1997
.   : milestone, 1956,
iast_GLOBAL (2.022 ms) : 1978, 2065
.   : milestone, 2022,
profiling (1.863 ms) : 1828, 1898
.   : milestone, 1863,
tracing (1.84 ms) : 1807, 1873
.   : milestone, 1840,
section candidate
no_agent (1.463 ms) : 1451, 1474
.   : milestone, 1463,
appsec (2.212 ms) : 2177, 2247
.   : milestone, 2212,
iast (1.961 ms) : 1919, 2003
.   : milestone, 1961,
iast_GLOBAL (2.008 ms) : 1965, 2051
.   : milestone, 2008,
profiling (1.854 ms) : 1819, 1889
.   : milestone, 1854,
tracing (1.848 ms) : 1815, 1882
.   : milestone, 1848,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.451 ms, 1.474 ms] -
appsec 2.216 ms [2.182 ms, 2.251 ms] 753.953 µs (51.6%)
iast 1.956 ms [1.915 ms, 1.997 ms] 493.461 µs (33.7%)
iast_GLOBAL 2.022 ms [1.978 ms, 2.065 ms] 559.196 µs (38.2%)
profiling 1.863 ms [1.828 ms, 1.898 ms] 400.418 µs (27.4%)
tracing 1.84 ms [1.807 ms, 1.873 ms] 377.85 µs (25.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.463 ms [1.451 ms, 1.474 ms] -
appsec 2.212 ms [2.177 ms, 2.247 ms] 749.888 µs (51.3%)
iast 1.961 ms [1.919 ms, 2.003 ms] 498.14 µs (34.1%)
iast_GLOBAL 2.008 ms [1.965 ms, 2.051 ms] 545.603 µs (37.3%)
profiling 1.854 ms [1.819 ms, 1.889 ms] 391.661 µs (26.8%)
tracing 1.848 ms [1.815 ms, 1.882 ms] 385.644 µs (26.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~9869d14357, baseline=1.39.0-SNAPSHOT~b0e4869c0b
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.979 s) : 14979000, 14979000
.   : milestone, 14979000,
appsec (15.14 s) : 15140000, 15140000
.   : milestone, 15140000,
iast (18.834 s) : 18834000, 18834000
.   : milestone, 18834000,
iast_GLOBAL (17.819 s) : 17819000, 17819000
.   : milestone, 17819000,
profiling (15.312 s) : 15312000, 15312000
.   : milestone, 15312000,
tracing (15.278 s) : 15278000, 15278000
.   : milestone, 15278000,
section candidate
no_agent (14.989 s) : 14989000, 14989000
.   : milestone, 14989000,
appsec (14.844 s) : 14844000, 14844000
.   : milestone, 14844000,
iast (18.849 s) : 18849000, 18849000
.   : milestone, 18849000,
iast_GLOBAL (17.828 s) : 17828000, 17828000
.   : milestone, 17828000,
profiling (14.978 s) : 14978000, 14978000
.   : milestone, 14978000,
tracing (15.073 s) : 15073000, 15073000
.   : milestone, 15073000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.979 s [14.979 s, 14.979 s] -
appsec 15.14 s [15.14 s, 15.14 s] 161.0 ms (1.1%)
iast 18.834 s [18.834 s, 18.834 s] 3.855 s (25.7%)
iast_GLOBAL 17.819 s [17.819 s, 17.819 s] 2.84 s (19.0%)
profiling 15.312 s [15.312 s, 15.312 s] 333.0 ms (2.2%)
tracing 15.278 s [15.278 s, 15.278 s] 299.0 ms (2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.989 s [14.989 s, 14.989 s] -
appsec 14.844 s [14.844 s, 14.844 s] -145.0 ms (-1.0%)
iast 18.849 s [18.849 s, 18.849 s] 3.86 s (25.8%)
iast_GLOBAL 17.828 s [17.828 s, 17.828 s] 2.839 s (18.9%)
profiling 14.978 s [14.978 s, 14.978 s] -11.0 ms (-0.1%)
tracing 15.073 s [15.073 s, 15.073 s] 84.0 ms (0.6%)

@smola smola merged commit 8b4aae5 into master Aug 20, 2024
@smola smola deleted the smola/test-visibility-logs branch August 20, 2024 08:29
@github-actions github-actions bot added this to the 1.39.0 milestone Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh was automatically assigned from DataDog/apm-java

@ygree ygree Awaiting requested review from ygree ygree was automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.39.0

Development

Successfully merging this pull request may close these issues.

3 participants

@smola @PerfectSlayer