Skip to content

Update system-tests to c208feb5b40cca543670870b9601509d6a69c65e#8550

Merged
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/system-tests
Mar 13, 2025
Merged

Update system-tests to c208feb5b40cca543670870b9601509d6a69c65e#8550
manuel-alvarez-alvarez merged 1 commit intomasterfrom
malvarez/system-tests

Conversation

@manuel-alvarez-alvarez
Copy link
Copy Markdown
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Mar 13, 2025

What Does This Do

Updates the system-tests pinned commit

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Mar 13, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez requested a review from a team as a code owner March 13, 2025 13:59
@manuel-alvarez-alvarez manuel-alvarez-alvarez changed the title Prevent before callsites targeting constructors Update system tests commit to c208feb5b40cca543670870b9601509d6a69c65e Mar 13, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez changed the title Update system tests commit to c208feb5b40cca543670870b9601509d6a69c65e Update system-tests to c208feb5b40cca543670870b9601509d6a69c65e Mar 13, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 13, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/system-tests
git_commit_date 1741874133 1741874384
git_commit_sha 7e831d5 9b947d0
release_version 1.48.0-SNAPSHOT~7e831d561e 1.48.0-SNAPSHOT~9b947d0a85
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741877192 1741877192
ci_job_id 846485261 846485261
ci_pipeline_id 58707285 58707285
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dgzduy7c-project-304-concurrent-2-nebaagb6 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dgzduy7c-project-304-concurrent-2-nebaagb6 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1050111
Total [baseline] (8.701 s) : 0, 8700593
Agent [candidate] (1.05 s) : 0, 1050203
Total [candidate] (8.688 s) : 0, 8688137
section iast
Agent [baseline] (1.177 s) : 0, 1177273
Total [baseline] (9.264 s) : 0, 9264196
Agent [candidate] (1.176 s) : 0, 1176275
Total [candidate] (9.272 s) : 0, 9271990
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.178 s) : 0, 1177508
Total [baseline] (9.197 s) : 0, 9196618
Agent [candidate] (1.179 s) : 0, 1178957
Total [candidate] (9.219 s) : 0, 9218630
section iast_TELEMETRY_OFF
Agent [baseline] (1.165 s) : 0, 1165375
Total [baseline] (9.243 s) : 0, 9242816
Agent [candidate] (1.169 s) : 0, 1168830
Total [candidate] (9.236 s) : 0, 9236451
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.177 s 127.162 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 127.397 ms (12.1%)
Agent iast_TELEMETRY_OFF 1.165 s 115.264 ms (11.0%)
Total tracing 8.701 s -
Total iast 9.264 s 563.603 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.197 s 496.025 ms (5.7%)
Total iast_TELEMETRY_OFF 9.243 s 542.223 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.176 s 126.072 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.179 s 128.754 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.169 s 118.627 ms (11.3%)
Total tracing 8.688 s -
Total iast 9.272 s 583.853 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.219 s 530.493 ms (6.1%)
Total iast_TELEMETRY_OFF 9.236 s 548.313 ms (6.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.74 ms) : 0, 723740
BytebuddyAgent [candidate] (723.424 ms) : 0, 723424
GlobalTracer [baseline] (241.943 ms) : 0, 241943
GlobalTracer [candidate] (241.326 ms) : 0, 241326
AppSec [baseline] (54.902 ms) : 0, 54902
AppSec [candidate] (54.967 ms) : 0, 54967
Remote Config [baseline] (692.33 µs) : 0, 692
Remote Config [candidate] (692.813 µs) : 0, 693
Telemetry [baseline] (13.543 ms) : 0, 13543
Telemetry [candidate] (14.466 ms) : 0, 14466
section iast
BytebuddyAgent [baseline] (842.309 ms) : 0, 842309
BytebuddyAgent [candidate] (842.697 ms) : 0, 842697
GlobalTracer [baseline] (231.361 ms) : 0, 231361
GlobalTracer [candidate] (230.318 ms) : 0, 230318
AppSec [baseline] (56.135 ms) : 0, 56135
AppSec [candidate] (56.053 ms) : 0, 56053
Remote Config [baseline] (618.156 µs) : 0, 618
Remote Config [candidate] (593.273 µs) : 0, 593
Telemetry [baseline] (8.672 ms) : 0, 8672
Telemetry [candidate] (8.66 ms) : 0, 8660
IAST [baseline] (22.927 ms) : 0, 22927
IAST [candidate] (22.609 ms) : 0, 22609
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (841.319 ms) : 0, 841319
BytebuddyAgent [candidate] (842.921 ms) : 0, 842921
GlobalTracer [baseline] (231.694 ms) : 0, 231694
GlobalTracer [candidate] (231.82 ms) : 0, 231820
AppSec [baseline] (56.695 ms) : 0, 56695
AppSec [candidate] (56.388 ms) : 0, 56388
Remote Config [baseline] (610.63 µs) : 0, 611
Remote Config [candidate] (602.901 µs) : 0, 603
Telemetry [baseline] (8.843 ms) : 0, 8843
Telemetry [candidate] (8.75 ms) : 0, 8750
IAST [baseline] (23.091 ms) : 0, 23091
IAST [candidate] (23.082 ms) : 0, 23082
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.424 ms) : 0, 833424
BytebuddyAgent [candidate] (835.751 ms) : 0, 835751
GlobalTracer [baseline] (229.532 ms) : 0, 229532
GlobalTracer [candidate] (230.398 ms) : 0, 230398
AppSec [baseline] (55.867 ms) : 0, 55867
AppSec [candidate] (56.112 ms) : 0, 56112
Remote Config [baseline] (600.916 µs) : 0, 601
Remote Config [candidate] (592.44 µs) : 0, 592
Telemetry [baseline] (8.465 ms) : 0, 8465
Telemetry [candidate] (8.511 ms) : 0, 8511
IAST [baseline] (22.204 ms) : 0, 22204
IAST [candidate] (22.168 ms) : 0, 22168
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1042520
Total [baseline] (10.465 s) : 0, 10464926
Agent [candidate] (1.042 s) : 0, 1042366
Total [candidate] (10.468 s) : 0, 10468255
section appsec
Agent [baseline] (1.187 s) : 0, 1187374
Total [baseline] (10.752 s) : 0, 10751750
Agent [candidate] (1.186 s) : 0, 1186306
Total [candidate] (10.789 s) : 0, 10788642
section iast
Agent [baseline] (1.178 s) : 0, 1178231
Total [baseline] (11.03 s) : 0, 11030466
Agent [candidate] (1.173 s) : 0, 1173376
Total [candidate] (11.091 s) : 0, 11091496
section profiling
Agent [baseline] (1.265 s) : 0, 1265072
Total [baseline] (10.866 s) : 0, 10866157
Agent [candidate] (1.259 s) : 0, 1259484
Total [candidate] (10.813 s) : 0, 10812727
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent appsec 1.187 s 144.853 ms (13.9%)
Agent iast 1.178 s 135.71 ms (13.0%)
Agent profiling 1.265 s 222.551 ms (21.3%)
Total tracing 10.465 s -
Total appsec 10.752 s 286.823 ms (2.7%)
Total iast 11.03 s 565.54 ms (5.4%)
Total profiling 10.866 s 401.23 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent appsec 1.186 s 143.94 ms (13.8%)
Agent iast 1.173 s 131.01 ms (12.6%)
Agent profiling 1.259 s 217.118 ms (20.8%)
Total tracing 10.468 s -
Total appsec 10.789 s 320.387 ms (3.1%)
Total iast 11.091 s 623.241 ms (6.0%)
Total profiling 10.813 s 344.472 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.201 ms) : 0, 718201
BytebuddyAgent [candidate] (719.686 ms) : 0, 719686
GlobalTracer [baseline] (240.23 ms) : 0, 240230
GlobalTracer [candidate] (239.978 ms) : 0, 239978
AppSec [baseline] (54.652 ms) : 0, 54652
AppSec [candidate] (54.715 ms) : 0, 54715
Remote Config [baseline] (677.975 µs) : 0, 678
Remote Config [candidate] (686.406 µs) : 0, 686
Telemetry [baseline] (13.541 ms) : 0, 13541
Telemetry [candidate] (12.106 ms) : 0, 12106
section appsec
BytebuddyAgent [baseline] (739.135 ms) : 0, 739135
BytebuddyAgent [candidate] (738.644 ms) : 0, 738644
GlobalTracer [baseline] (237.416 ms) : 0, 237416
GlobalTracer [candidate] (236.791 ms) : 0, 236791
AppSec [baseline] (175.798 ms) : 0, 175798
AppSec [candidate] (175.925 ms) : 0, 175925
Remote Config [baseline] (661.742 µs) : 0, 662
Remote Config [candidate] (669.532 µs) : 0, 670
Telemetry [baseline] (8.293 ms) : 0, 8293
Telemetry [candidate] (8.308 ms) : 0, 8308
IAST [baseline] (21.655 ms) : 0, 21655
IAST [candidate] (21.44 ms) : 0, 21440
section iast
BytebuddyAgent [baseline] (842.53 ms) : 0, 842530
BytebuddyAgent [candidate] (840.168 ms) : 0, 840168
GlobalTracer [baseline] (231.871 ms) : 0, 231871
GlobalTracer [candidate] (229.789 ms) : 0, 229789
AppSec [baseline] (56.34 ms) : 0, 56340
AppSec [candidate] (55.422 ms) : 0, 55422
Remote Config [baseline] (618.315 µs) : 0, 618
Remote Config [candidate] (610.712 µs) : 0, 611
Telemetry [baseline] (8.643 ms) : 0, 8643
Telemetry [candidate] (8.603 ms) : 0, 8603
IAST [baseline] (22.869 ms) : 0, 22869
IAST [candidate] (23.445 ms) : 0, 23445
section profiling
ProfilingAgent [baseline] (96.713 ms) : 0, 96713
ProfilingAgent [candidate] (96.742 ms) : 0, 96742
BytebuddyAgent [baseline] (713.116 ms) : 0, 713116
BytebuddyAgent [candidate] (708.831 ms) : 0, 708831
GlobalTracer [baseline] (350.137 ms) : 0, 350137
GlobalTracer [candidate] (350.393 ms) : 0, 350393
AppSec [baseline] (54.586 ms) : 0, 54586
AppSec [candidate] (53.389 ms) : 0, 53389
Remote Config [baseline] (669.05 µs) : 0, 669
Remote Config [candidate] (655.132 µs) : 0, 655
Telemetry [baseline] (8.959 ms) : 0, 8959
Telemetry [candidate] (8.867 ms) : 0, 8867
Profiling [baseline] (96.74 ms) : 0, 96740
Profiling [candidate] (96.767 ms) : 0, 96767
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-13T14:13:09 2025-03-13T14:20:53
git_branch master malvarez/system-tests
git_commit_date 1741874133 1741874384
git_commit_sha 7e831d5 9b947d0
release_version 1.48.0-SNAPSHOT~7e831d561e 1.48.0-SNAPSHOT~9b947d0a85
start_time 2025-03-13T14:12:55 2025-03-13T14:20:39
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741876051 1741876051
ci_job_id 846485263 846485263
ci_pipeline_id 58707285 58707285
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-gzhmqs6t-project-304-concurrent-2-ju469lno 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-gzhmqs6t-project-304-concurrent-2-ju469lno 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.361 ms) : 1341, 1381
.   : milestone, 1361,
appsec (1.726 ms) : 1702, 1750
.   : milestone, 1726,
appsec_no_iast (1.75 ms) : 1726, 1775
.   : milestone, 1750,
code_origins (1.682 ms) : 1655, 1709
.   : milestone, 1682,
iast (1.512 ms) : 1488, 1535
.   : milestone, 1512,
profiling (1.559 ms) : 1535, 1583
.   : milestone, 1559,
tracing (1.479 ms) : 1455, 1503
.   : milestone, 1479,
section candidate
no_agent (1.362 ms) : 1343, 1381
.   : milestone, 1362,
appsec (1.727 ms) : 1702, 1751
.   : milestone, 1727,
appsec_no_iast (1.734 ms) : 1709, 1759
.   : milestone, 1734,
code_origins (1.676 ms) : 1649, 1703
.   : milestone, 1676,
iast (1.523 ms) : 1499, 1548
.   : milestone, 1523,
profiling (1.548 ms) : 1523, 1572
.   : milestone, 1548,
tracing (1.482 ms) : 1457, 1507
.   : milestone, 1482,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.361 ms [1.341 ms, 1.381 ms] -
appsec 1.726 ms [1.702 ms, 1.75 ms] 364.691 µs (26.8%)
appsec_no_iast 1.75 ms [1.726 ms, 1.775 ms] 389.112 µs (28.6%)
code_origins 1.682 ms [1.655 ms, 1.709 ms] 321.276 µs (23.6%)
iast 1.512 ms [1.488 ms, 1.535 ms] 150.649 µs (11.1%)
profiling 1.559 ms [1.535 ms, 1.583 ms] 198.268 µs (14.6%)
tracing 1.479 ms [1.455 ms, 1.503 ms] 117.995 µs (8.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.362 ms [1.343 ms, 1.381 ms] -
appsec 1.727 ms [1.702 ms, 1.751 ms] 365.042 µs (26.8%)
appsec_no_iast 1.734 ms [1.709 ms, 1.759 ms] 372.565 µs (27.4%)
code_origins 1.676 ms [1.649 ms, 1.703 ms] 314.395 µs (23.1%)
iast 1.523 ms [1.499 ms, 1.548 ms] 161.704 µs (11.9%)
profiling 1.548 ms [1.523 ms, 1.572 ms] 185.932 µs (13.7%)
tracing 1.482 ms [1.457 ms, 1.507 ms] 120.355 µs (8.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.898 µs) : 366, 406
.   : milestone, 386,
iast (508.72 µs) : 487, 530
.   : milestone, 509,
iast_FULL (730.068 µs) : 708, 752
.   : milestone, 730,
iast_GLOBAL (556.577 µs) : 535, 579
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (514.637 µs) : 493, 536
.   : milestone, 515,
iast_INACTIVE (463.369 µs) : 442, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (500.806 µs) : 479, 523
.   : milestone, 501,
tracing (457.546 µs) : 436, 479
.   : milestone, 458,
section candidate
no_agent (380.169 µs) : 360, 401
.   : milestone, 380,
iast (511.24 µs) : 490, 533
.   : milestone, 511,
iast_FULL (726.776 µs) : 705, 749
.   : milestone, 727,
iast_GLOBAL (565.095 µs) : 542, 588
.   : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (510.547 µs) : 488, 533
.   : milestone, 511,
iast_INACTIVE (465.031 µs) : 444, 487
.   : milestone, 465,
iast_TELEMETRY_OFF (506.926 µs) : 485, 529
.   : milestone, 507,
tracing (454.523 µs) : 434, 475
.   : milestone, 455,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.898 µs [366.056 µs, 405.74 µs] -
iast 508.72 µs [487.099 µs, 530.34 µs] 122.822 µs (31.8%)
iast_FULL 730.068 µs [708.012 µs, 752.123 µs] 344.17 µs (89.2%)
iast_GLOBAL 556.577 µs [534.511 µs, 578.642 µs] 170.679 µs (44.2%)
iast_HARDCODED_SECRET_DISABLED 514.637 µs [492.914 µs, 536.359 µs] 128.739 µs (33.4%)
iast_INACTIVE 463.369 µs [441.813 µs, 484.924 µs] 77.471 µs (20.1%)
iast_TELEMETRY_OFF 500.806 µs [478.74 µs, 522.873 µs] 114.909 µs (29.8%)
tracing 457.546 µs [436.375 µs, 478.717 µs] 71.648 µs (18.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.169 µs [359.731 µs, 400.607 µs] -
iast 511.24 µs [489.515 µs, 532.964 µs] 131.071 µs (34.5%)
iast_FULL 726.776 µs [704.993 µs, 748.558 µs] 346.606 µs (91.2%)
iast_GLOBAL 565.095 µs [542.343 µs, 587.846 µs] 184.926 µs (48.6%)
iast_HARDCODED_SECRET_DISABLED 510.547 µs [488.379 µs, 532.715 µs] 130.378 µs (34.3%)
iast_INACTIVE 465.031 µs [443.526 µs, 486.535 µs] 84.862 µs (22.3%)
iast_TELEMETRY_OFF 506.926 µs [484.503 µs, 529.349 µs] 126.757 µs (33.3%)
tracing 454.523 µs [433.668 µs, 475.378 µs] 74.354 µs (19.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/system-tests
git_commit_date 1741874133 1741874384
git_commit_sha 7e831d5 9b947d0
release_version 1.48.0-SNAPSHOT~7e831d561e 1.48.0-SNAPSHOT~9b947d0a85
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741876493 1741876493
ci_job_id 846485265 846485265
ci_pipeline_id 58707285 58707285
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-88rxttzv-project-304-concurrent-1-b5skv4gg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-88rxttzv-project-304-concurrent-1-b5skv4gg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (2.329 ms) : 2286, 2373
.   : milestone, 2329,
iast (2.117 ms) : 2061, 2172
.   : milestone, 2117,
iast_GLOBAL (2.154 ms) : 2098, 2210
.   : milestone, 2154,
profiling (1.963 ms) : 1919, 2007
.   : milestone, 1963,
tracing (1.94 ms) : 1898, 1982
.   : milestone, 1940,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.34 ms) : 2296, 2384
.   : milestone, 2340,
iast (2.114 ms) : 2058, 2170
.   : milestone, 2114,
iast_GLOBAL (2.155 ms) : 2099, 2211
.   : milestone, 2155,
profiling (2.445 ms) : 2265, 2624
.   : milestone, 2445,
tracing (1.961 ms) : 1918, 2005
.   : milestone, 1961,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.329 ms [2.286 ms, 2.373 ms] 859.67 µs (58.5%)
iast 2.117 ms [2.061 ms, 2.172 ms] 647.011 µs (44.0%)
iast_GLOBAL 2.154 ms [2.098 ms, 2.21 ms] 684.055 µs (46.5%)
profiling 1.963 ms [1.919 ms, 2.007 ms] 493.501 µs (33.6%)
tracing 1.94 ms [1.898 ms, 1.982 ms] 470.287 µs (32.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.34 ms [2.296 ms, 2.384 ms] 870.06 µs (59.2%)
iast 2.114 ms [2.058 ms, 2.17 ms] 644.086 µs (43.8%)
iast_GLOBAL 2.155 ms [2.099 ms, 2.211 ms] 684.564 µs (46.6%)
profiling 2.445 ms [2.265 ms, 2.624 ms] 974.377 µs (66.3%)
tracing 1.961 ms [1.918 ms, 2.005 ms] 490.927 µs (33.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9b947d0a85, baseline=1.48.0-SNAPSHOT~7e831d561e
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.908 s) : 14908000, 14908000
.   : milestone, 14908000,
appsec (14.921 s) : 14921000, 14921000
.   : milestone, 14921000,
iast (18.328 s) : 18328000, 18328000
.   : milestone, 18328000,
iast_GLOBAL (17.825 s) : 17825000, 17825000
.   : milestone, 17825000,
profiling (15.535 s) : 15535000, 15535000
.   : milestone, 15535000,
tracing (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,
section candidate
no_agent (15.418 s) : 15418000, 15418000
.   : milestone, 15418000,
appsec (15.186 s) : 15186000, 15186000
.   : milestone, 15186000,
iast (18.834 s) : 18834000, 18834000
.   : milestone, 18834000,
iast_GLOBAL (18.2 s) : 18200000, 18200000
.   : milestone, 18200000,
profiling (15.056 s) : 15056000, 15056000
.   : milestone, 15056000,
tracing (14.973 s) : 14973000, 14973000
.   : milestone, 14973000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.908 s [14.908 s, 14.908 s] -
appsec 14.921 s [14.921 s, 14.921 s] 13.0 ms (0.1%)
iast 18.328 s [18.328 s, 18.328 s] 3.42 s (22.9%)
iast_GLOBAL 17.825 s [17.825 s, 17.825 s] 2.917 s (19.6%)
profiling 15.535 s [15.535 s, 15.535 s] 627.0 ms (4.2%)
tracing 14.869 s [14.869 s, 14.869 s] -39.0 ms (-0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.418 s [15.418 s, 15.418 s] -
appsec 15.186 s [15.186 s, 15.186 s] -232.0 ms (-1.5%)
iast 18.834 s [18.834 s, 18.834 s] 3.416 s (22.2%)
iast_GLOBAL 18.2 s [18.2 s, 18.2 s] 2.782 s (18.0%)
profiling 15.056 s [15.056 s, 15.056 s] -362.0 ms (-2.3%)
tracing 14.973 s [14.973 s, 14.973 s] -445.0 ms (-2.9%)

@manuel-alvarez-alvarez manuel-alvarez-alvarez merged commit 47c4eb3 into master Mar 13, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez deleted the malvarez/system-tests branch March 13, 2025 14:58
@github-actions github-actions Bot added this to the 1.48.0 milestone Mar 13, 2025
mtoffl01 pushed a commit that referenced this pull request Mar 24, 2025
@manuel-alvarez-alvarez @mtoffl01
Update system-tests to c208feb5b40cca543670870b9601509d6a69c65e (#8550)
b7656bd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@amarziali amarziali amarziali approved these changes

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.48.0

Development

Successfully merging this pull request may close these issues.

3 participants

@manuel-alvarez-alvarez @PerfectSlayer @amarziali