Skip to content

Update system-tests commit#8373

Merged
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/update-system-tests-commit
Feb 12, 2025
Merged

Update system-tests commit#8373
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/update-system-tests-commit

Conversation

@manuel-alvarez-alvarez
Copy link
Copy Markdown
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Feb 12, 2025

What Does This Do

Updates the pinned commit to fix the issue with a broken mssql-jdbc transitive dependency.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Feb 12, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested a review from a team as a code owner February 12, 2025 09:55
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Feb 12, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/update-system-tests-commit
git_commit_date 1739349672 1739354001
git_commit_sha e037162 7f39276
release_version 1.47.0-SNAPSHOT~e037162705 1.47.0-SNAPSHOT~7f3927613a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739356462 1739356462
ci_job_id 804478280 804478280
ci_pipeline_id 55637105 55637105
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-uzizv6n-project-304-concurrent-0-1dzy7f3h 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-uzizv6n-project-304-concurrent-0-1dzy7f3h 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1045181
Total [baseline] (10.475 s) : 0, 10474690
Agent [candidate] (1.045 s) : 0, 1044506
Total [candidate] (10.441 s) : 0, 10440628
section appsec
Agent [baseline] (1.191 s) : 0, 1190723
Total [baseline] (10.727 s) : 0, 10727333
Agent [candidate] (1.188 s) : 0, 1188186
Total [candidate] (10.794 s) : 0, 10794421
section iast
Agent [baseline] (1.174 s) : 0, 1174319
Total [baseline] (10.979 s) : 0, 10979131
Agent [candidate] (1.184 s) : 0, 1183988
Total [candidate] (10.968 s) : 0, 10968242
section profiling
Agent [baseline] (1.264 s) : 0, 1264339
Total [baseline] (10.876 s) : 0, 10876399
Agent [candidate] (1.271 s) : 0, 1271079
Total [candidate] (10.961 s) : 0, 10960699
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent appsec 1.191 s 145.542 ms (13.9%)
Agent iast 1.174 s 129.138 ms (12.4%)
Agent profiling 1.264 s 219.158 ms (21.0%)
Total tracing 10.475 s -
Total appsec 10.727 s 252.643 ms (2.4%)
Total iast 10.979 s 504.441 ms (4.8%)
Total profiling 10.876 s 401.709 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent appsec 1.188 s 143.681 ms (13.8%)
Agent iast 1.184 s 139.483 ms (13.4%)
Agent profiling 1.271 s 226.574 ms (21.7%)
Total tracing 10.441 s -
Total appsec 10.794 s 353.793 ms (3.4%)
Total iast 10.968 s 527.614 ms (5.1%)
Total profiling 10.961 s 520.071 ms (5.0%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.499 ms) : 0, 716499
BytebuddyAgent [candidate] (717.013 ms) : 0, 717013
GlobalTracer [baseline] (243.333 ms) : 0, 243333
GlobalTracer [candidate] (243.218 ms) : 0, 243218
AppSec [baseline] (55.187 ms) : 0, 55187
AppSec [candidate] (55.354 ms) : 0, 55354
Remote Config [baseline] (715.305 µs) : 0, 715
Remote Config [candidate] (721.912 µs) : 0, 722
Telemetry [baseline] (14.244 ms) : 0, 14244
Telemetry [candidate] (12.957 ms) : 0, 12957
section appsec
BytebuddyAgent [baseline] (738.422 ms) : 0, 738422
BytebuddyAgent [candidate] (735.489 ms) : 0, 735489
GlobalTracer [baseline] (241.155 ms) : 0, 241155
GlobalTracer [candidate] (241.051 ms) : 0, 241051
AppSec [baseline] (175.726 ms) : 0, 175726
AppSec [candidate] (176.592 ms) : 0, 176592
Remote Config [baseline] (653.899 µs) : 0, 654
Remote Config [candidate] (655.348 µs) : 0, 655
Telemetry [baseline] (8.642 ms) : 0, 8642
Telemetry [candidate] (8.231 ms) : 0, 8231
IAST [baseline] (21.511 ms) : 0, 21511
IAST [candidate] (21.727 ms) : 0, 21727
section iast
BytebuddyAgent [baseline] (836.441 ms) : 0, 836441
BytebuddyAgent [candidate] (843.353 ms) : 0, 843353
GlobalTracer [baseline] (234.164 ms) : 0, 234164
GlobalTracer [candidate] (235.574 ms) : 0, 235574
AppSec [baseline] (56.528 ms) : 0, 56528
AppSec [candidate] (57.32 ms) : 0, 57320
Remote Config [baseline] (611.318 µs) : 0, 611
Remote Config [candidate] (632.556 µs) : 0, 633
Telemetry [baseline] (8.678 ms) : 0, 8678
Telemetry [candidate] (8.8 ms) : 0, 8800
IAST [baseline] (22.598 ms) : 0, 22598
IAST [candidate] (23.032 ms) : 0, 23032
section profiling
BytebuddyAgent [baseline] (706.971 ms) : 0, 706971
BytebuddyAgent [candidate] (711.488 ms) : 0, 711488
GlobalTracer [baseline] (354.166 ms) : 0, 354166
GlobalTracer [candidate] (355.584 ms) : 0, 355584
AppSec [baseline] (55.423 ms) : 0, 55423
AppSec [candidate] (54.971 ms) : 0, 54971
Remote Config [baseline] (722.846 µs) : 0, 723
Remote Config [candidate] (726.955 µs) : 0, 727
Telemetry [baseline] (8.959 ms) : 0, 8959
Telemetry [candidate] (9.09 ms) : 0, 9090
ProfilingAgent [baseline] (95.797 ms) : 0, 95797
ProfilingAgent [candidate] (96.463 ms) : 0, 96463
Profiling [baseline] (95.821 ms) : 0, 95821
Profiling [candidate] (96.488 ms) : 0, 96488
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051214
Total [baseline] (8.647 s) : 0, 8647394
Agent [candidate] (1.051 s) : 0, 1051412
Total [candidate] (8.66 s) : 0, 8659527
section iast
Agent [baseline] (1.173 s) : 0, 1173198
Total [baseline] (9.205 s) : 0, 9204868
Agent [candidate] (1.178 s) : 0, 1178397
Total [candidate] (9.25 s) : 0, 9250102
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.183 s) : 0, 1182987
Total [baseline] (9.203 s) : 0, 9202704
Agent [candidate] (1.181 s) : 0, 1180886
Total [candidate] (9.227 s) : 0, 9226959
section iast_TELEMETRY_OFF
Agent [baseline] (1.178 s) : 0, 1177753
Total [baseline] (9.238 s) : 0, 9237727
Agent [candidate] (1.171 s) : 0, 1171189
Total [candidate] (9.23 s) : 0, 9229543
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.173 s 121.984 ms (11.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.183 s 131.773 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.178 s 126.539 ms (12.0%)
Total tracing 8.647 s -
Total iast 9.205 s 557.473 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.203 s 555.309 ms (6.4%)
Total iast_TELEMETRY_OFF 9.238 s 590.333 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.178 s 126.984 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.181 s 129.473 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.171 s 119.777 ms (11.4%)
Total tracing 8.66 s -
Total iast 9.25 s 590.574 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.227 s 567.432 ms (6.6%)
Total iast_TELEMETRY_OFF 9.23 s 570.016 ms (6.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.003 ms) : 0, 723003
BytebuddyAgent [candidate] (721.584 ms) : 0, 721584
GlobalTracer [baseline] (245.11 ms) : 0, 245110
GlobalTracer [candidate] (246.378 ms) : 0, 246378
AppSec [baseline] (55.567 ms) : 0, 55567
AppSec [candidate] (55.758 ms) : 0, 55758
Remote Config [baseline] (723.768 µs) : 0, 724
Remote Config [candidate] (742.169 µs) : 0, 742
Telemetry [baseline] (11.584 ms) : 0, 11584
Telemetry [candidate] (11.639 ms) : 0, 11639
section iast
BytebuddyAgent [baseline] (835.272 ms) : 0, 835272
BytebuddyAgent [candidate] (840.216 ms) : 0, 840216
GlobalTracer [baseline] (233.858 ms) : 0, 233858
GlobalTracer [candidate] (233.424 ms) : 0, 233424
IAST [baseline] (22.646 ms) : 0, 22646
IAST [candidate] (22.926 ms) : 0, 22926
AppSec [baseline] (56.892 ms) : 0, 56892
AppSec [candidate] (57.106 ms) : 0, 57106
Remote Config [baseline] (611.268 µs) : 0, 611
Remote Config [candidate] (626.048 µs) : 0, 626
Telemetry [baseline] (8.657 ms) : 0, 8657
Telemetry [candidate] (8.723 ms) : 0, 8723
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (841.946 ms) : 0, 841946
BytebuddyAgent [candidate] (840.132 ms) : 0, 840132
GlobalTracer [baseline] (235.39 ms) : 0, 235390
GlobalTracer [candidate] (235.476 ms) : 0, 235476
IAST [baseline] (23.203 ms) : 0, 23203
IAST [candidate] (23.145 ms) : 0, 23145
AppSec [baseline] (57.595 ms) : 0, 57595
AppSec [candidate] (57.095 ms) : 0, 57095
Remote Config [baseline] (625.991 µs) : 0, 626
Remote Config [candidate] (629.868 µs) : 0, 630
Telemetry [baseline] (8.836 ms) : 0, 8836
Telemetry [candidate] (8.86 ms) : 0, 8860
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (838.371 ms) : 0, 838371
BytebuddyAgent [candidate] (833.402 ms) : 0, 833402
GlobalTracer [baseline] (234.697 ms) : 0, 234697
GlobalTracer [candidate] (234.266 ms) : 0, 234266
IAST [baseline] (28.0 ms) : 0, 28000
IAST [candidate] (26.092 ms) : 0, 26092
AppSec [baseline] (51.9 ms) : 0, 51900
AppSec [candidate] (52.935 ms) : 0, 52935
Remote Config [baseline] (623.627 µs) : 0, 624
Remote Config [candidate] (604.424 µs) : 0, 604
Telemetry [baseline] (8.806 ms) : 0, 8806
Telemetry [candidate] (8.602 ms) : 0, 8602
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-12T10:04:17 2025-02-12T10:11:24
git_branch master malvarez/update-system-tests-commit
git_commit_date 1739349672 1739354001
git_commit_sha e037162 7f39276
release_version 1.47.0-SNAPSHOT~e037162705 1.47.0-SNAPSHOT~7f3927613a
start_time 2025-02-12T10:04:03 2025-02-12T10:11:10
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739355443 1739355443
ci_job_id 804478282 804478282
ci_pipeline_id 55637105 55637105
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-uzizv6n-project-304-concurrent-1-pi9efxiy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-uzizv6n-project-304-concurrent-1-pi9efxiy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705
    dateFormat X
    axisFormat %s
section baseline
no_agent (376.15 µs) : 356, 397
.   : milestone, 376,
iast (509.381 µs) : 488, 531
.   : milestone, 509,
iast_FULL (741.387 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (550.753 µs) : 529, 572
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (511.976 µs) : 490, 534
.   : milestone, 512,
iast_INACTIVE (463.804 µs) : 442, 485
.   : milestone, 464,
iast_TELEMETRY_OFF (501.522 µs) : 478, 525
.   : milestone, 502,
tracing (454.067 µs) : 433, 475
.   : milestone, 454,
section candidate
no_agent (380.911 µs) : 361, 401
.   : milestone, 381,
iast (518.641 µs) : 496, 541
.   : milestone, 519,
iast_FULL (745.987 µs) : 724, 768
.   : milestone, 746,
iast_GLOBAL (551.38 µs) : 530, 573
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (508.51 µs) : 485, 532
.   : milestone, 509,
iast_INACTIVE (463.411 µs) : 442, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (494.372 µs) : 472, 517
.   : milestone, 494,
tracing (459.383 µs) : 438, 481
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.15 µs [355.593 µs, 396.706 µs] -
iast 509.381 µs [487.835 µs, 530.928 µs] 133.232 µs (35.4%)
iast_FULL 741.387 µs [719.489 µs, 763.286 µs] 365.238 µs (97.1%)
iast_GLOBAL 550.753 µs [529.199 µs, 572.307 µs] 174.603 µs (46.4%)
iast_HARDCODED_SECRET_DISABLED 511.976 µs [490.391 µs, 533.561 µs] 135.826 µs (36.1%)
iast_INACTIVE 463.804 µs [442.289 µs, 485.32 µs] 87.655 µs (23.3%)
iast_TELEMETRY_OFF 501.522 µs [478.33 µs, 524.714 µs] 125.372 µs (33.3%)
tracing 454.067 µs [433.095 µs, 475.039 µs] 77.918 µs (20.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.911 µs [361.122 µs, 400.699 µs] -
iast 518.641 µs [496.178 µs, 541.103 µs] 137.73 µs (36.2%)
iast_FULL 745.987 µs [723.911 µs, 768.063 µs] 365.076 µs (95.8%)
iast_GLOBAL 551.38 µs [529.784 µs, 572.975 µs] 170.469 µs (44.8%)
iast_HARDCODED_SECRET_DISABLED 508.51 µs [484.882 µs, 532.139 µs] 127.6 µs (33.5%)
iast_INACTIVE 463.411 µs [442.063 µs, 484.759 µs] 82.5 µs (21.7%)
iast_TELEMETRY_OFF 494.372 µs [471.916 µs, 516.827 µs] 113.461 µs (29.8%)
tracing 459.383 µs [437.99 µs, 480.776 µs] 78.472 µs (20.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.365 ms) : 1346, 1385
.   : milestone, 1365,
appsec (1.745 ms) : 1721, 1768
.   : milestone, 1745,
appsec_no_iast (1.763 ms) : 1740, 1785
.   : milestone, 1763,
iast (1.516 ms) : 1491, 1541
.   : milestone, 1516,
profiling (1.574 ms) : 1549, 1599
.   : milestone, 1574,
tracing (1.51 ms) : 1486, 1534
.   : milestone, 1510,
section candidate
no_agent (1.357 ms) : 1337, 1376
.   : milestone, 1357,
appsec (1.75 ms) : 1726, 1773
.   : milestone, 1750,
appsec_no_iast (1.762 ms) : 1739, 1786
.   : milestone, 1762,
iast (1.494 ms) : 1470, 1519
.   : milestone, 1494,
profiling (1.555 ms) : 1530, 1579
.   : milestone, 1555,
tracing (1.483 ms) : 1459, 1508
.   : milestone, 1483,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.365 ms [1.346 ms, 1.385 ms] -
appsec 1.745 ms [1.721 ms, 1.768 ms] 379.484 µs (27.8%)
appsec_no_iast 1.763 ms [1.74 ms, 1.785 ms] 397.668 µs (29.1%)
iast 1.516 ms [1.491 ms, 1.541 ms] 151.041 µs (11.1%)
profiling 1.574 ms [1.549 ms, 1.599 ms] 209.023 µs (15.3%)
tracing 1.51 ms [1.486 ms, 1.534 ms] 145.058 µs (10.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.357 ms [1.337 ms, 1.376 ms] -
appsec 1.75 ms [1.726 ms, 1.773 ms] 392.923 µs (29.0%)
appsec_no_iast 1.762 ms [1.739 ms, 1.786 ms] 405.518 µs (29.9%)
iast 1.494 ms [1.47 ms, 1.519 ms] 137.48 µs (10.1%)
profiling 1.555 ms [1.53 ms, 1.579 ms] 197.792 µs (14.6%)
tracing 1.483 ms [1.459 ms, 1.508 ms] 126.534 µs (9.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/update-system-tests-commit
git_commit_date 1739349672 1739354001
git_commit_sha e037162 7f39276
release_version 1.47.0-SNAPSHOT~e037162705 1.47.0-SNAPSHOT~7f3927613a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1739356123 1739356123
ci_job_id 804478284 804478284
ci_pipeline_id 55637105 55637105
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-e-diiak--project-304-concurrent-0-dkx1u4wh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-e-diiak--project-304-concurrent-0-dkx1u4wh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.447 s) : 15447000, 15447000
.   : milestone, 15447000,
appsec (15.198 s) : 15198000, 15198000
.   : milestone, 15198000,
iast (18.307 s) : 18307000, 18307000
.   : milestone, 18307000,
iast_GLOBAL (18.001 s) : 18001000, 18001000
.   : milestone, 18001000,
profiling (15.033 s) : 15033000, 15033000
.   : milestone, 15033000,
tracing (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
section candidate
no_agent (15.368 s) : 15368000, 15368000
.   : milestone, 15368000,
appsec (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
iast (18.717 s) : 18717000, 18717000
.   : milestone, 18717000,
iast_GLOBAL (18.297 s) : 18297000, 18297000
.   : milestone, 18297000,
profiling (14.919 s) : 14919000, 14919000
.   : milestone, 14919000,
tracing (14.793 s) : 14793000, 14793000
.   : milestone, 14793000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.447 s [15.447 s, 15.447 s] -
appsec 15.198 s [15.198 s, 15.198 s] -249.0 ms (-1.6%)
iast 18.307 s [18.307 s, 18.307 s] 2.86 s (18.5%)
iast_GLOBAL 18.001 s [18.001 s, 18.001 s] 2.554 s (16.5%)
profiling 15.033 s [15.033 s, 15.033 s] -414.0 ms (-2.7%)
tracing 15.011 s [15.011 s, 15.011 s] -436.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.368 s [15.368 s, 15.368 s] -
appsec 14.998 s [14.998 s, 14.998 s] -370.0 ms (-2.4%)
iast 18.717 s [18.717 s, 18.717 s] 3.349 s (21.8%)
iast_GLOBAL 18.297 s [18.297 s, 18.297 s] 2.929 s (19.1%)
profiling 14.919 s [14.919 s, 14.919 s] -449.0 ms (-2.9%)
tracing 14.793 s [14.793 s, 14.793 s] -575.0 ms (-3.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~7f3927613a, baseline=1.47.0-SNAPSHOT~e037162705
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.377 ms) : 2334, 2421
.   : milestone, 2377,
iast (2.115 ms) : 2060, 2170
.   : milestone, 2115,
iast_GLOBAL (2.17 ms) : 2114, 2226
.   : milestone, 2170,
profiling (1.961 ms) : 1918, 2004
.   : milestone, 1961,
tracing (1.953 ms) : 1911, 1995
.   : milestone, 1953,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.369 ms) : 2326, 2412
.   : milestone, 2369,
iast (2.123 ms) : 2068, 2179
.   : milestone, 2123,
iast_GLOBAL (2.162 ms) : 2106, 2217
.   : milestone, 2162,
profiling (1.979 ms) : 1934, 2024
.   : milestone, 1979,
tracing (1.957 ms) : 1914, 1999
.   : milestone, 1957,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.377 ms [2.334 ms, 2.421 ms] 905.296 µs (61.5%)
iast 2.115 ms [2.06 ms, 2.17 ms] 643.031 µs (43.7%)
iast_GLOBAL 2.17 ms [2.114 ms, 2.226 ms] 698.028 µs (47.4%)
profiling 1.961 ms [1.918 ms, 2.004 ms] 488.824 µs (33.2%)
tracing 1.953 ms [1.911 ms, 1.995 ms] 480.517 µs (32.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.369 ms [2.326 ms, 2.412 ms] 895.459 µs (60.8%)
iast 2.123 ms [2.068 ms, 2.179 ms] 649.716 µs (44.1%)
iast_GLOBAL 2.162 ms [2.106 ms, 2.217 ms] 688.169 µs (46.7%)
profiling 1.979 ms [1.934 ms, 2.024 ms] 505.551 µs (34.3%)
tracing 1.957 ms [1.914 ms, 1.999 ms] 483.065 µs (32.8%)

@manuel-alvarez-alvarez manuel-alvarez-alvarez added the type: enhancement Enhancements and improvements label Feb 12, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez merged commit 429031c into master Feb 12, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez deleted the malvarez/update-system-tests-commit branch February 12, 2025 10:54
@github-actions github-actions Bot added this to the 1.47.0 milestone Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@smola smola smola approved these changes

@mcculls mcculls mcculls approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.47.0

Development

Successfully merging this pull request may close these issues.

3 participants

@manuel-alvarez-alvarez @smola @mcculls