Skip to content

Update system-tests commit#8389

Merged
jandro996 merged 3 commits intomasterfrom
alejandro.gonzalez/Update-system-tests-commit
Feb 14, 2025
Merged

Update system-tests commit#8389
jandro996 merged 3 commits intomasterfrom
alejandro.gonzalez/Update-system-tests-commit

Conversation

@jandro996
Copy link
Copy Markdown
Member

@jandro996 jandro996 commented Feb 14, 2025

What Does This Do

Update system-tests commit

Motivation

It is necessary to update to a version that has the IAST stacktrace vulnerability tests disabled, as they have been modified to comply with the specifications in the RFC

Additional Notes

related with APPSEC-56772

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jandro996 jandro996 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Feb 14, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Feb 14, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alejandro.gonzalez/Update-system-tests-commit
git_commit_date 1739537145 1739552655
git_commit_sha acf173a 10b8457
release_version 1.47.0-SNAPSHOT~acf173a318 1.47.0-SNAPSHOT~10b8457a0b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739555205 1739555205
ci_job_id 809293223 809293223
ci_pipeline_id 55963584 55963584
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-yrr1pra-project-304-concurrent-0-idme72c6 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-yrr1pra-project-304-concurrent-0-idme72c6 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039942
Total [baseline] (10.481 s) : 0, 10480893
Agent [candidate] (1.04 s) : 0, 1040263
Total [candidate] (10.455 s) : 0, 10454664
section appsec
Agent [baseline] (1.186 s) : 0, 1185536
Total [baseline] (10.796 s) : 0, 10796128
Agent [candidate] (1.18 s) : 0, 1179693
Total [candidate] (10.818 s) : 0, 10817912
section iast
Agent [baseline] (1.17 s) : 0, 1170171
Total [baseline] (10.984 s) : 0, 10983515
Agent [candidate] (1.172 s) : 0, 1171739
Total [candidate] (11.022 s) : 0, 11021823
section profiling
Agent [baseline] (1.261 s) : 0, 1261278
Total [baseline] (10.858 s) : 0, 10857970
Agent [candidate] (1.268 s) : 0, 1267826
Total [candidate] (10.976 s) : 0, 10975649
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.186 s 145.594 ms (14.0%)
Agent iast 1.17 s 130.228 ms (12.5%)
Agent profiling 1.261 s 221.336 ms (21.3%)
Total tracing 10.481 s -
Total appsec 10.796 s 315.235 ms (3.0%)
Total iast 10.984 s 502.621 ms (4.8%)
Total profiling 10.858 s 377.077 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.18 s 139.43 ms (13.4%)
Agent iast 1.172 s 131.476 ms (12.6%)
Agent profiling 1.268 s 227.563 ms (21.9%)
Total tracing 10.455 s -
Total appsec 10.818 s 363.247 ms (3.5%)
Total iast 11.022 s 567.159 ms (5.4%)
Total profiling 10.976 s 520.984 ms (5.0%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.726 ms) : 0, 716726
BytebuddyAgent [candidate] (717.199 ms) : 0, 717199
GlobalTracer [baseline] (239.769 ms) : 0, 239769
GlobalTracer [candidate] (239.891 ms) : 0, 239891
AppSec [baseline] (56.035 ms) : 0, 56035
AppSec [candidate] (55.068 ms) : 0, 55068
Remote Config [baseline] (713.656 µs) : 0, 714
Remote Config [candidate] (694.811 µs) : 0, 695
Telemetry [baseline] (11.531 ms) : 0, 11531
Telemetry [candidate] (12.171 ms) : 0, 12171
section appsec
BytebuddyAgent [baseline] (736.493 ms) : 0, 736493
BytebuddyAgent [candidate] (731.764 ms) : 0, 731764
GlobalTracer [baseline] (237.406 ms) : 0, 237406
GlobalTracer [candidate] (236.313 ms) : 0, 236313
IAST [baseline] (21.308 ms) : 0, 21308
IAST [candidate] (21.408 ms) : 0, 21408
AppSec [baseline] (176.777 ms) : 0, 176777
AppSec [candidate] (176.775 ms) : 0, 176775
Remote Config [baseline] (668.207 µs) : 0, 668
Remote Config [candidate] (670.567 µs) : 0, 671
Telemetry [baseline] (8.284 ms) : 0, 8284
Telemetry [candidate] (8.262 ms) : 0, 8262
section iast
BytebuddyAgent [baseline] (835.285 ms) : 0, 835285
BytebuddyAgent [candidate] (836.192 ms) : 0, 836192
GlobalTracer [baseline] (230.653 ms) : 0, 230653
GlobalTracer [candidate] (230.727 ms) : 0, 230727
IAST [baseline] (22.821 ms) : 0, 22821
IAST [candidate] (22.608 ms) : 0, 22608
AppSec [baseline] (56.942 ms) : 0, 56942
AppSec [candidate] (57.498 ms) : 0, 57498
Remote Config [baseline] (634.165 µs) : 0, 634
Remote Config [candidate] (628.647 µs) : 0, 629
Telemetry [baseline] (8.627 ms) : 0, 8627
Telemetry [candidate] (8.794 ms) : 0, 8794
section profiling
BytebuddyAgent [baseline] (707.398 ms) : 0, 707398
BytebuddyAgent [candidate] (711.106 ms) : 0, 711106
GlobalTracer [baseline] (350.174 ms) : 0, 350174
GlobalTracer [candidate] (351.834 ms) : 0, 351834
AppSec [baseline] (55.498 ms) : 0, 55498
AppSec [candidate] (55.05 ms) : 0, 55050
Remote Config [baseline] (678.633 µs) : 0, 679
Remote Config [candidate] (687.856 µs) : 0, 688
Telemetry [baseline] (8.849 ms) : 0, 8849
Telemetry [candidate] (9.078 ms) : 0, 9078
ProfilingAgent [baseline] (96.322 ms) : 0, 96322
ProfilingAgent [candidate] (97.358 ms) : 0, 97358
Profiling [baseline] (96.346 ms) : 0, 96346
Profiling [candidate] (97.383 ms) : 0, 97383
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1040905
Total [baseline] (8.674 s) : 0, 8674346
Agent [candidate] (1.042 s) : 0, 1042003
Total [candidate] (8.701 s) : 0, 8701085
section iast
Agent [baseline] (1.17 s) : 0, 1170041
Total [baseline] (9.257 s) : 0, 9257347
Agent [candidate] (1.169 s) : 0, 1169199
Total [candidate] (9.313 s) : 0, 9313207
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.172 s) : 0, 1172247
Total [baseline] (9.268 s) : 0, 9267532
Agent [candidate] (1.18 s) : 0, 1180210
Total [candidate] (9.238 s) : 0, 9237778
section iast_TELEMETRY_OFF
Agent [baseline] (1.175 s) : 0, 1174865
Total [baseline] (9.221 s) : 0, 9221096
Agent [candidate] (1.166 s) : 0, 1166497
Total [candidate] (9.264 s) : 0, 9263957
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.17 s 129.136 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 131.342 ms (12.6%)
Agent iast_TELEMETRY_OFF 1.175 s 133.96 ms (12.9%)
Total tracing 8.674 s -
Total iast 9.257 s 583.001 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.268 s 593.186 ms (6.8%)
Total iast_TELEMETRY_OFF 9.221 s 546.75 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.169 s 127.196 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 138.207 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.166 s 124.494 ms (11.9%)
Total tracing 8.701 s -
Total iast 9.313 s 612.122 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.238 s 536.693 ms (6.2%)
Total iast_TELEMETRY_OFF 9.264 s 562.872 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.875 ms) : 0, 717875
BytebuddyAgent [candidate] (716.724 ms) : 0, 716724
GlobalTracer [baseline] (240.175 ms) : 0, 240175
GlobalTracer [candidate] (240.33 ms) : 0, 240330
AppSec [baseline] (55.407 ms) : 0, 55407
AppSec [candidate] (55.44 ms) : 0, 55440
Remote Config [baseline] (692.416 µs) : 0, 692
Remote Config [candidate] (691.205 µs) : 0, 691
Telemetry [baseline] (11.478 ms) : 0, 11478
Telemetry [candidate] (13.562 ms) : 0, 13562
section iast
BytebuddyAgent [baseline] (835.128 ms) : 0, 835128
BytebuddyAgent [candidate] (834.142 ms) : 0, 834142
GlobalTracer [baseline] (230.23 ms) : 0, 230230
GlobalTracer [candidate] (230.388 ms) : 0, 230388
IAST [baseline] (22.876 ms) : 0, 22876
IAST [candidate] (22.906 ms) : 0, 22906
AppSec [baseline] (57.433 ms) : 0, 57433
AppSec [candidate] (57.289 ms) : 0, 57289
Remote Config [baseline] (616.304 µs) : 0, 616
Remote Config [candidate] (624.488 µs) : 0, 624
Telemetry [baseline] (8.539 ms) : 0, 8539
Telemetry [candidate] (8.569 ms) : 0, 8569
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.571 ms) : 0, 836571
BytebuddyAgent [candidate] (841.965 ms) : 0, 841965
GlobalTracer [baseline] (230.573 ms) : 0, 230573
GlobalTracer [candidate] (232.291 ms) : 0, 232291
IAST [baseline] (22.885 ms) : 0, 22885
IAST [candidate] (23.21 ms) : 0, 23210
AppSec [baseline] (57.537 ms) : 0, 57537
AppSec [candidate] (57.726 ms) : 0, 57726
Remote Config [baseline] (644.429 µs) : 0, 644
Remote Config [candidate] (636.516 µs) : 0, 637
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.804 ms) : 0, 8804
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (838.383 ms) : 0, 838383
BytebuddyAgent [candidate] (832.247 ms) : 0, 832247
GlobalTracer [baseline] (231.806 ms) : 0, 231806
GlobalTracer [candidate] (230.765 ms) : 0, 230765
IAST [baseline] (24.019 ms) : 0, 24019
IAST [candidate] (24.41 ms) : 0, 24410
AppSec [baseline] (55.885 ms) : 0, 55885
AppSec [candidate] (54.753 ms) : 0, 54753
Remote Config [baseline] (610.88 µs) : 0, 611
Remote Config [candidate] (606.156 µs) : 0, 606
Telemetry [baseline] (8.68 ms) : 0, 8680
Telemetry [candidate] (8.52 ms) : 0, 8520
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-14T17:16:35 2025-02-14T17:23:39
git_branch master alejandro.gonzalez/Update-system-tests-commit
git_commit_date 1739537145 1739552655
git_commit_sha acf173a 10b8457
release_version 1.47.0-SNAPSHOT~acf173a318 1.47.0-SNAPSHOT~10b8457a0b
start_time 2025-02-14T17:16:21 2025-02-14T17:23:25
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739554176 1739554176
ci_job_id 809293224 809293224
ci_pipeline_id 55963584 55963584
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-inwry3gs-project-304-concurrent-0-10hdeecy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-inwry3gs-project-304-concurrent-0-10hdeecy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318
    dateFormat X
    axisFormat %s
section baseline
no_agent (381.828 µs) : 361, 402
.   : milestone, 382,
iast (515.451 µs) : 493, 538
.   : milestone, 515,
iast_FULL (749.515 µs) : 728, 771
.   : milestone, 750,
iast_GLOBAL (561.784 µs) : 539, 585
.   : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (512.081 µs) : 489, 535
.   : milestone, 512,
iast_INACTIVE (464.709 µs) : 443, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (494.838 µs) : 473, 517
.   : milestone, 495,
tracing (454.421 µs) : 434, 475
.   : milestone, 454,
section candidate
no_agent (379.56 µs) : 359, 400
.   : milestone, 380,
iast (506.386 µs) : 484, 529
.   : milestone, 506,
iast_FULL (745.098 µs) : 723, 767
.   : milestone, 745,
iast_GLOBAL (554.965 µs) : 533, 577
.   : milestone, 555,
iast_HARDCODED_SECRET_DISABLED (513.39 µs) : 491, 536
.   : milestone, 513,
iast_INACTIVE (462.135 µs) : 441, 483
.   : milestone, 462,
iast_TELEMETRY_OFF (496.281 µs) : 474, 518
.   : milestone, 496,
tracing (451.046 µs) : 431, 471
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.828 µs [361.436 µs, 402.22 µs] -
iast 515.451 µs [492.892 µs, 538.01 µs] 133.623 µs (35.0%)
iast_FULL 749.515 µs [727.568 µs, 771.461 µs] 367.686 µs (96.3%)
iast_GLOBAL 561.784 µs [538.925 µs, 584.642 µs] 179.955 µs (47.1%)
iast_HARDCODED_SECRET_DISABLED 512.081 µs [488.784 µs, 535.378 µs] 130.253 µs (34.1%)
iast_INACTIVE 464.709 µs [443.409 µs, 486.009 µs] 82.881 µs (21.7%)
iast_TELEMETRY_OFF 494.838 µs [472.994 µs, 516.682 µs] 113.01 µs (29.6%)
tracing 454.421 µs [433.578 µs, 475.265 µs] 72.593 µs (19.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.56 µs [358.758 µs, 400.362 µs] -
iast 506.386 µs [484.108 µs, 528.663 µs] 126.826 µs (33.4%)
iast_FULL 745.098 µs [723.06 µs, 767.136 µs] 365.538 µs (96.3%)
iast_GLOBAL 554.965 µs [533.007 µs, 576.923 µs] 175.405 µs (46.2%)
iast_HARDCODED_SECRET_DISABLED 513.39 µs [490.911 µs, 535.868 µs] 133.829 µs (35.3%)
iast_INACTIVE 462.135 µs [440.792 µs, 483.477 µs] 82.574 µs (21.8%)
iast_TELEMETRY_OFF 496.281 µs [474.457 µs, 518.105 µs] 116.721 µs (30.8%)
tracing 451.046 µs [430.615 µs, 471.477 µs] 71.486 µs (18.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.351 ms) : 1331, 1370
.   : milestone, 1351,
appsec (1.737 ms) : 1713, 1761
.   : milestone, 1737,
appsec_no_iast (1.742 ms) : 1717, 1767
.   : milestone, 1742,
iast (1.501 ms) : 1476, 1526
.   : milestone, 1501,
profiling (1.525 ms) : 1501, 1548
.   : milestone, 1525,
tracing (1.474 ms) : 1449, 1499
.   : milestone, 1474,
section candidate
no_agent (1.356 ms) : 1336, 1376
.   : milestone, 1356,
appsec (1.745 ms) : 1721, 1769
.   : milestone, 1745,
appsec_no_iast (1.752 ms) : 1729, 1776
.   : milestone, 1752,
iast (1.501 ms) : 1476, 1526
.   : milestone, 1501,
profiling (1.497 ms) : 1474, 1520
.   : milestone, 1497,
tracing (1.513 ms) : 1488, 1538
.   : milestone, 1513,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.331 ms, 1.37 ms] -
appsec 1.737 ms [1.713 ms, 1.761 ms] 386.281 µs (28.6%)
appsec_no_iast 1.742 ms [1.717 ms, 1.767 ms] 391.163 µs (29.0%)
iast 1.501 ms [1.476 ms, 1.526 ms] 150.166 µs (11.1%)
profiling 1.525 ms [1.501 ms, 1.548 ms] 173.893 µs (12.9%)
tracing 1.474 ms [1.449 ms, 1.499 ms] 123.048 µs (9.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.336 ms, 1.376 ms] -
appsec 1.745 ms [1.721 ms, 1.769 ms] 389.298 µs (28.7%)
appsec_no_iast 1.752 ms [1.729 ms, 1.776 ms] 396.379 µs (29.2%)
iast 1.501 ms [1.476 ms, 1.526 ms] 144.956 µs (10.7%)
profiling 1.497 ms [1.474 ms, 1.52 ms] 141.095 µs (10.4%)
tracing 1.513 ms [1.488 ms, 1.538 ms] 156.814 µs (11.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alejandro.gonzalez/Update-system-tests-commit
git_commit_date 1739537145 1739552655
git_commit_sha acf173a 10b8457
release_version 1.47.0-SNAPSHOT~acf173a318 1.47.0-SNAPSHOT~10b8457a0b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1739554718 1739554718
ci_job_id 809293227 809293227
ci_pipeline_id 55963584 55963584
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-hs3k8bk-project-304-concurrent-0-u4fyp54y 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-hs3k8bk-project-304-concurrent-0-u4fyp54y 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.376 ms) : 2333, 2420
.   : milestone, 2376,
iast (2.121 ms) : 2066, 2176
.   : milestone, 2121,
iast_GLOBAL (2.169 ms) : 2114, 2225
.   : milestone, 2169,
profiling (2.473 ms) : 2290, 2656
.   : milestone, 2473,
tracing (1.96 ms) : 1918, 2003
.   : milestone, 1960,
section candidate
no_agent (1.476 ms) : 1465, 1487
.   : milestone, 1476,
appsec (2.383 ms) : 2340, 2426
.   : milestone, 2383,
iast (2.126 ms) : 2070, 2181
.   : milestone, 2126,
iast_GLOBAL (2.163 ms) : 2107, 2218
.   : milestone, 2163,
profiling (1.981 ms) : 1937, 2024
.   : milestone, 1981,
tracing (1.963 ms) : 1920, 2006
.   : milestone, 1963,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.376 ms [2.333 ms, 2.42 ms] 897.191 µs (60.7%)
iast 2.121 ms [2.066 ms, 2.176 ms] 641.759 µs (43.4%)
iast_GLOBAL 2.169 ms [2.114 ms, 2.225 ms] 690.021 µs (46.6%)
profiling 2.473 ms [2.29 ms, 2.656 ms] 994.004 µs (67.2%)
tracing 1.96 ms [1.918 ms, 2.003 ms] 481.14 µs (32.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.487 ms] -
appsec 2.383 ms [2.34 ms, 2.426 ms] 907.01 µs (61.5%)
iast 2.126 ms [2.07 ms, 2.181 ms] 649.905 µs (44.0%)
iast_GLOBAL 2.163 ms [2.107 ms, 2.218 ms] 686.567 µs (46.5%)
profiling 1.981 ms [1.937 ms, 2.024 ms] 504.618 µs (34.2%)
tracing 1.963 ms [1.92 ms, 2.006 ms] 486.92 µs (33.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~10b8457a0b, baseline=1.47.0-SNAPSHOT~acf173a318
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.959 s) : 14959000, 14959000
.   : milestone, 14959000,
appsec (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
iast (18.902 s) : 18902000, 18902000
.   : milestone, 18902000,
iast_GLOBAL (18.056 s) : 18056000, 18056000
.   : milestone, 18056000,
profiling (15.674 s) : 15674000, 15674000
.   : milestone, 15674000,
tracing (14.844 s) : 14844000, 14844000
.   : milestone, 14844000,
section candidate
no_agent (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
appsec (14.99 s) : 14990000, 14990000
.   : milestone, 14990000,
iast (19.007 s) : 19007000, 19007000
.   : milestone, 19007000,
iast_GLOBAL (18.191 s) : 18191000, 18191000
.   : milestone, 18191000,
profiling (15.163 s) : 15163000, 15163000
.   : milestone, 15163000,
tracing (14.726 s) : 14726000, 14726000
.   : milestone, 14726000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.959 s [14.959 s, 14.959 s] -
appsec 14.916 s [14.916 s, 14.916 s] -43.0 ms (-0.3%)
iast 18.902 s [18.902 s, 18.902 s] 3.943 s (26.4%)
iast_GLOBAL 18.056 s [18.056 s, 18.056 s] 3.097 s (20.7%)
profiling 15.674 s [15.674 s, 15.674 s] 715.0 ms (4.8%)
tracing 14.844 s [14.844 s, 14.844 s] -115.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.945 s [14.945 s, 14.945 s] -
appsec 14.99 s [14.99 s, 14.99 s] 45.0 ms (0.3%)
iast 19.007 s [19.007 s, 19.007 s] 4.062 s (27.2%)
iast_GLOBAL 18.191 s [18.191 s, 18.191 s] 3.246 s (21.7%)
profiling 15.163 s [15.163 s, 15.163 s] 218.0 ms (1.5%)
tracing 14.726 s [14.726 s, 14.726 s] -219.0 ms (-1.5%)

@jandro996 jandro996 marked this pull request as ready for review February 14, 2025 16:41
@jandro996 jandro996 requested a review from a team as a code owner February 14, 2025 16:41
manuel-alvarez-alvarez
manuel-alvarez-alvarez reviewed Feb 14, 2025
View reviewed changes
Comment thread .circleci/config.continue.yml.j2 Outdated
@jandro996 @manuel-alvarez-alvarez
Update .circleci/config.continue.yml.j2
10b8457 
Co-authored-by: Manuel Álvarez Álvarez <[email protected]>
@jandro996 jandro996 enabled auto-merge (squash) February 14, 2025 17:19
@jandro996 jandro996 merged commit bab17ef into master Feb 14, 2025
@jandro996 jandro996 deleted the alejandro.gonzalez/Update-system-tests-commit branch February 14, 2025 18:08
@github-actions github-actions Bot added this to the 1.47.0 milestone Feb 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@manuel-alvarez-alvarez manuel-alvarez-alvarez manuel-alvarez-alvarez approved these changes

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.47.0

Development

Successfully merging this pull request may close these issues.

2 participants

@jandro996 @manuel-alvarez-alvarez