Skip to content

Update system-tests to ab6cf66b9c744f4fc273907423e93598440cd211#8866

Merged
mcculls merged 1 commit intomasterfrom
mhlidd/update_system_tests_hash
May 22, 2025
Merged

Update system-tests to ab6cf66b9c744f4fc273907423e93598440cd211#8866
mcculls merged 1 commit intomasterfrom
mhlidd/update_system_tests_hash

Conversation

@mhlidd
Copy link
Copy Markdown
Contributor

@mhlidd mhlidd commented May 22, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@mhlidd mhlidd requested a review from a team as a code owner May 22, 2025 08:31
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 22, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mcculls mcculls added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels May 22, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented May 22, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1747901310 1747902630
git_commit_sha 8e7b515 c07d353
release_version 1.50.0-SNAPSHOT~8e7b515c37 1.50.0-SNAPSHOT~c07d353482
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747905002 1747905002
ci_job_id 949602062 949602062
ci_pipeline_id 65824672 65824672
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qzhj-cns-project-304-concurrent-0-6ohkieax 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qzhj-cns-project-304-concurrent-0-6ohkieax 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 15 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.025 s) : 0, 1025026
Total [baseline] (10.537 s) : 0, 10536770
Agent [candidate] (1.019 s) : 0, 1019146
Total [candidate] (10.514 s) : 0, 10514034
section appsec
Agent [baseline] (1.164 s) : 0, 1163791
Total [baseline] (10.665 s) : 0, 10664954
Agent [candidate] (1.163 s) : 0, 1163340
Total [candidate] (10.728 s) : 0, 10728054
section iast
Agent [baseline] (1.15 s) : 0, 1149751
Total [baseline] (10.921 s) : 0, 10921265
Agent [candidate] (1.16 s) : 0, 1160272
Total [candidate] (10.906 s) : 0, 10906306
section profiling
Agent [baseline] (1.266 s) : 0, 1265844
Total [baseline] (10.781 s) : 0, 10780742
Agent [candidate] (1.265 s) : 0, 1264811
Total [candidate] (10.803 s) : 0, 10803220
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.164 s 138.765 ms (13.5%)
Agent iast 1.15 s 124.725 ms (12.2%)
Agent profiling 1.266 s 240.818 ms (23.5%)
Total tracing 10.537 s -
Total appsec 10.665 s 128.184 ms (1.2%)
Total iast 10.921 s 384.495 ms (3.6%)
Total profiling 10.781 s 243.972 ms (2.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.163 s 144.195 ms (14.1%)
Agent iast 1.16 s 141.126 ms (13.8%)
Agent profiling 1.265 s 245.666 ms (24.1%)
Total tracing 10.514 s -
Total appsec 10.728 s 214.02 ms (2.0%)
Total iast 10.906 s 392.272 ms (3.7%)
Total profiling 10.803 s 289.187 ms (2.8%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.951 ms) : 0, 686951
BytebuddyAgent [candidate] (682.974 ms) : 0, 682974
GlobalTracer [baseline] (240.452 ms) : 0, 240452
GlobalTracer [candidate] (240.425 ms) : 0, 240425
AppSec [baseline] (54.468 ms) : 0, 54468
AppSec [candidate] (55.412 ms) : 0, 55412
Debugger [baseline] (9.116 ms) : 0, 9116
Debugger [candidate] (6.922 ms) : 0, 6922
Remote Config [baseline] (695.473 µs) : 0, 695
Remote Config [candidate] (721.843 µs) : 0, 722
Telemetry [baseline] (9.656 ms) : 0, 9656
Telemetry [candidate] (9.12 ms) : 0, 9120
section appsec
BytebuddyAgent [baseline] (702.532 ms) : 0, 702532
BytebuddyAgent [candidate] (701.451 ms) : 0, 701451
GlobalTracer [baseline] (237.006 ms) : 0, 237006
GlobalTracer [candidate] (237.271 ms) : 0, 237271
AppSec [baseline] (175.86 ms) : 0, 175860
AppSec [candidate] (175.648 ms) : 0, 175648
Debugger [baseline] (5.954 ms) : 0, 5954
Debugger [candidate] (5.928 ms) : 0, 5928
Remote Config [baseline] (627.425 µs) : 0, 627
Remote Config [candidate] (619.327 µs) : 0, 619
Telemetry [baseline] (7.392 ms) : 0, 7392
Telemetry [candidate] (8.081 ms) : 0, 8081
IAST [baseline] (21.669 ms) : 0, 21669
IAST [candidate] (21.629 ms) : 0, 21629
section iast
BytebuddyAgent [baseline] (802.563 ms) : 0, 802563
BytebuddyAgent [candidate] (810.596 ms) : 0, 810596
GlobalTracer [baseline] (230.717 ms) : 0, 230717
GlobalTracer [candidate] (232.853 ms) : 0, 232853
AppSec [baseline] (50.306 ms) : 0, 50306
AppSec [candidate] (49.583 ms) : 0, 49583
Debugger [baseline] (5.95 ms) : 0, 5950
Debugger [candidate] (5.926 ms) : 0, 5926
Remote Config [baseline] (611.258 µs) : 0, 611
Remote Config [candidate] (592.101 µs) : 0, 592
Telemetry [baseline] (7.877 ms) : 0, 7877
Telemetry [candidate] (7.842 ms) : 0, 7842
IAST [baseline] (27.427 ms) : 0, 27427
IAST [candidate] (29.248 ms) : 0, 29248
section profiling
BytebuddyAgent [baseline] (675.176 ms) : 0, 675176
BytebuddyAgent [candidate] (675.229 ms) : 0, 675229
GlobalTracer [baseline] (360.123 ms) : 0, 360123
GlobalTracer [candidate] (359.714 ms) : 0, 359714
AppSec [baseline] (61.698 ms) : 0, 61698
AppSec [candidate] (61.556 ms) : 0, 61556
Debugger [baseline] (6.24 ms) : 0, 6240
Debugger [candidate] (6.333 ms) : 0, 6333
Remote Config [baseline] (654.446 µs) : 0, 654
Remote Config [candidate] (670.239 µs) : 0, 670
Telemetry [baseline] (8.177 ms) : 0, 8177
Telemetry [candidate] (8.237 ms) : 0, 8237
ProfilingAgent [baseline] (102.892 ms) : 0, 102892
ProfilingAgent [candidate] (102.326 ms) : 0, 102326
Profiling [baseline] (102.915 ms) : 0, 102915
Profiling [candidate] (102.35 ms) : 0, 102350
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.032 s) : 0, 1032091
Total [baseline] (8.672 s) : 0, 8671823
Agent [candidate] (1.023 s) : 0, 1023217
Total [candidate] (8.662 s) : 0, 8661800
section iast
Agent [baseline] (1.149 s) : 0, 1149249
Total [baseline] (9.242 s) : 0, 9241710
Agent [candidate] (1.153 s) : 0, 1152663
Total [candidate] (9.281 s) : 0, 9280928
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1148140
Total [baseline] (9.186 s) : 0, 9186208
Agent [candidate] (1.151 s) : 0, 1150883
Total [candidate] (9.218 s) : 0, 9217723
section iast_TELEMETRY_OFF
Agent [baseline] (1.15 s) : 0, 1149928
Total [baseline] (9.214 s) : 0, 9213983
Agent [candidate] (1.153 s) : 0, 1152779
Total [candidate] (9.215 s) : 0, 9214548
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.032 s -
Agent iast 1.149 s 117.158 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.148 s 116.048 ms (11.2%)
Agent iast_TELEMETRY_OFF 1.15 s 117.837 ms (11.4%)
Total tracing 8.672 s -
Total iast 9.242 s 569.886 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.186 s 514.384 ms (5.9%)
Total iast_TELEMETRY_OFF 9.214 s 542.16 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.153 s 129.446 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.151 s 127.666 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.153 s 129.561 ms (12.7%)
Total tracing 8.662 s -
Total iast 9.281 s 619.129 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.218 s 555.923 ms (6.4%)
Total iast_TELEMETRY_OFF 9.215 s 552.749 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.807 ms) : 0, 690807
BytebuddyAgent [candidate] (682.689 ms) : 0, 682689
GlobalTracer [baseline] (242.008 ms) : 0, 242008
GlobalTracer [candidate] (240.218 ms) : 0, 240218
AppSec [baseline] (55.742 ms) : 0, 55742
AppSec [candidate] (54.773 ms) : 0, 54773
Debugger [baseline] (8.357 ms) : 0, 8357
Debugger [candidate] (9.892 ms) : 0, 9892
Remote Config [baseline] (714.958 µs) : 0, 715
Remote Config [candidate] (690.96 µs) : 0, 691
Telemetry [baseline] (10.75 ms) : 0, 10750
Telemetry [candidate] (11.289 ms) : 0, 11289
section iast
BytebuddyAgent [baseline] (801.957 ms) : 0, 801957
BytebuddyAgent [candidate] (805.325 ms) : 0, 805325
GlobalTracer [baseline] (230.513 ms) : 0, 230513
GlobalTracer [candidate] (230.807 ms) : 0, 230807
IAST [baseline] (27.481 ms) : 0, 27481
IAST [candidate] (27.709 ms) : 0, 27709
AppSec [baseline] (51.428 ms) : 0, 51428
AppSec [candidate] (49.465 ms) : 0, 49465
Debugger [baseline] (5.938 ms) : 0, 5938
Debugger [candidate] (5.887 ms) : 0, 5887
Remote Config [baseline] (586.996 µs) : 0, 587
Remote Config [candidate] (587.869 µs) : 0, 588
Telemetry [baseline] (7.837 ms) : 0, 7837
Telemetry [candidate] (7.815 ms) : 0, 7815
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.893 ms) : 0, 800893
BytebuddyAgent [candidate] (803.107 ms) : 0, 803107
GlobalTracer [baseline] (230.431 ms) : 0, 230431
GlobalTracer [candidate] (231.141 ms) : 0, 231141
IAST [baseline] (25.071 ms) : 0, 25071
IAST [candidate] (30.772 ms) : 0, 30772
AppSec [baseline] (53.823 ms) : 0, 53823
AppSec [candidate] (47.833 ms) : 0, 47833
Debugger [baseline] (5.899 ms) : 0, 5899
Debugger [candidate] (5.93 ms) : 0, 5930
Remote Config [baseline] (619.34 µs) : 0, 619
Remote Config [candidate] (590.179 µs) : 0, 590
Telemetry [baseline] (7.856 ms) : 0, 7856
Telemetry [candidate] (7.947 ms) : 0, 7947
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.614 ms) : 0, 801614
BytebuddyAgent [candidate] (804.147 ms) : 0, 804147
GlobalTracer [baseline] (231.332 ms) : 0, 231332
GlobalTracer [candidate] (231.79 ms) : 0, 231790
IAST [baseline] (22.419 ms) : 0, 22419
IAST [candidate] (22.523 ms) : 0, 22523
AppSec [baseline] (56.647 ms) : 0, 56647
AppSec [candidate] (56.186 ms) : 0, 56186
Debugger [baseline] (5.993 ms) : 0, 5993
Debugger [candidate] (5.997 ms) : 0, 5997
Remote Config [baseline] (620.464 µs) : 0, 620
Remote Config [candidate] (604.231 µs) : 0, 604
Telemetry [baseline] (7.778 ms) : 0, 7778
Telemetry [candidate] (7.81 ms) : 0, 7810
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-22T08:40:21 2025-05-22T08:48:09
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1747901310 1747902630
git_commit_sha 8e7b515 c07d353
release_version 1.50.0-SNAPSHOT~8e7b515c37 1.50.0-SNAPSHOT~c07d353482
start_time 2025-05-22T08:40:07 2025-05-22T08:47:55
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747904088 1747904088
ci_job_id 949602063 949602063
ci_pipeline_id 65824672 65824672
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vhwr7gmc-project-304-concurrent-0-c6epaaqi 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vhwr7gmc-project-304-concurrent-0-c6epaaqi 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (387.072 µs) : 367, 407
.   : milestone, 387,
iast (529.327 µs) : 507, 551
.   : milestone, 529,
iast_FULL (742.227 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (582.147 µs) : 559, 605
.   : milestone, 582,
iast_HARDCODED_SECRET_DISABLED (529.103 µs) : 506, 552
.   : milestone, 529,
iast_INACTIVE (473.86 µs) : 452, 496
.   : milestone, 474,
iast_TELEMETRY_OFF (518.956 µs) : 496, 542
.   : milestone, 519,
tracing (461.947 µs) : 440, 484
.   : milestone, 462,
section candidate
no_agent (386.911 µs) : 366, 408
.   : milestone, 387,
iast (518.169 µs) : 496, 540
.   : milestone, 518,
iast_FULL (740.127 µs) : 718, 762
.   : milestone, 740,
iast_GLOBAL (578.556 µs) : 556, 601
.   : milestone, 579,
iast_HARDCODED_SECRET_DISABLED (532.303 µs) : 509, 556
.   : milestone, 532,
iast_INACTIVE (466.089 µs) : 444, 488
.   : milestone, 466,
iast_TELEMETRY_OFF (507.888 µs) : 485, 531
.   : milestone, 508,
tracing (467.987 µs) : 445, 491
.   : milestone, 468,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 387.072 µs [367.405 µs, 406.738 µs] -
iast 529.327 µs [507.375 µs, 551.279 µs] 142.255 µs (36.8%)
iast_FULL 742.227 µs [720.141 µs, 764.314 µs] 355.156 µs (91.8%)
iast_GLOBAL 582.147 µs [559.347 µs, 604.948 µs] 195.076 µs (50.4%)
iast_HARDCODED_SECRET_DISABLED 529.103 µs [505.74 µs, 552.465 µs] 142.031 µs (36.7%)
iast_INACTIVE 473.86 µs [451.606 µs, 496.115 µs] 86.789 µs (22.4%)
iast_TELEMETRY_OFF 518.956 µs [496.085 µs, 541.827 µs] 131.884 µs (34.1%)
tracing 461.947 µs [440.01 µs, 483.885 µs] 74.876 µs (19.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 386.911 µs [365.64 µs, 408.182 µs] -
iast 518.169 µs [496.381 µs, 539.956 µs] 131.258 µs (33.9%)
iast_FULL 740.127 µs [718.036 µs, 762.218 µs] 353.216 µs (91.3%)
iast_GLOBAL 578.556 µs [556.183 µs, 600.93 µs] 191.646 µs (49.5%)
iast_HARDCODED_SECRET_DISABLED 532.303 µs [508.728 µs, 555.877 µs] 145.392 µs (37.6%)
iast_INACTIVE 466.089 µs [444.205 µs, 487.974 µs] 79.179 µs (20.5%)
iast_TELEMETRY_OFF 507.888 µs [484.503 µs, 531.274 µs] 120.978 µs (31.3%)
tracing 467.987 µs [445.351 µs, 490.623 µs] 81.076 µs (21.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.357 ms) : 1337, 1376
.   : milestone, 1357,
appsec (1.747 ms) : 1722, 1771
.   : milestone, 1747,
appsec_no_iast (1.738 ms) : 1715, 1762
.   : milestone, 1738,
code_origins (1.667 ms) : 1640, 1693
.   : milestone, 1667,
iast (1.517 ms) : 1492, 1542
.   : milestone, 1517,
profiling (1.515 ms) : 1491, 1539
.   : milestone, 1515,
tracing (1.513 ms) : 1490, 1535
.   : milestone, 1513,
section candidate
no_agent (1.378 ms) : 1357, 1399
.   : milestone, 1378,
appsec (1.73 ms) : 1706, 1754
.   : milestone, 1730,
appsec_no_iast (1.741 ms) : 1718, 1765
.   : milestone, 1741,
code_origins (1.672 ms) : 1646, 1699
.   : milestone, 1672,
iast (1.517 ms) : 1492, 1541
.   : milestone, 1517,
profiling (1.526 ms) : 1501, 1551
.   : milestone, 1526,
tracing (1.507 ms) : 1483, 1532
.   : milestone, 1507,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.357 ms [1.337 ms, 1.376 ms] -
appsec 1.747 ms [1.722 ms, 1.771 ms] 389.662 µs (28.7%)
appsec_no_iast 1.738 ms [1.715 ms, 1.762 ms] 381.388 µs (28.1%)
code_origins 1.667 ms [1.64 ms, 1.693 ms] 310.019 µs (22.8%)
iast 1.517 ms [1.492 ms, 1.542 ms] 160.206 µs (11.8%)
profiling 1.515 ms [1.491 ms, 1.539 ms] 158.306 µs (11.7%)
tracing 1.513 ms [1.49 ms, 1.535 ms] 155.996 µs (11.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.378 ms [1.357 ms, 1.399 ms] -
appsec 1.73 ms [1.706 ms, 1.754 ms] 351.776 µs (25.5%)
appsec_no_iast 1.741 ms [1.718 ms, 1.765 ms] 363.361 µs (26.4%)
code_origins 1.672 ms [1.646 ms, 1.699 ms] 294.472 µs (21.4%)
iast 1.517 ms [1.492 ms, 1.541 ms] 138.872 µs (10.1%)
profiling 1.526 ms [1.501 ms, 1.551 ms] 148.076 µs (10.7%)
tracing 1.507 ms [1.483 ms, 1.532 ms] 129.164 µs (9.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/update_system_tests_hash
git_commit_date 1747901310 1747902630
git_commit_sha 8e7b515 c07d353
release_version 1.50.0-SNAPSHOT~8e7b515c37 1.50.0-SNAPSHOT~c07d353482
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747904563 1747904563
ci_job_id 949602064 949602064
ci_pipeline_id 65824672 65824672
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qzhj-cns-project-304-concurrent-1-0292hspe 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qzhj-cns-project-304-concurrent-1-0292hspe 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.41 ms) : 2361, 2459
.   : milestone, 2410,
iast (2.184 ms) : 2122, 2246
.   : milestone, 2184,
iast_GLOBAL (2.22 ms) : 2157, 2282
.   : milestone, 2220,
profiling (2.038 ms) : 1988, 2087
.   : milestone, 2038,
tracing (2.003 ms) : 1955, 2050
.   : milestone, 2003,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.397 ms) : 2348, 2446
.   : milestone, 2397,
iast (2.178 ms) : 2117, 2239
.   : milestone, 2178,
iast_GLOBAL (2.217 ms) : 2156, 2279
.   : milestone, 2217,
profiling (2.027 ms) : 1977, 2076
.   : milestone, 2027,
tracing (1.991 ms) : 1943, 2039
.   : milestone, 1991,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.41 ms [2.361 ms, 2.459 ms] 939.531 µs (63.9%)
iast 2.184 ms [2.122 ms, 2.246 ms] 713.315 µs (48.5%)
iast_GLOBAL 2.22 ms [2.157 ms, 2.282 ms] 749.063 µs (50.9%)
profiling 2.038 ms [1.988 ms, 2.087 ms] 567.1 µs (38.6%)
tracing 2.003 ms [1.955 ms, 2.05 ms] 532.178 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 2.397 ms [2.348 ms, 2.446 ms] 925.749 µs (62.9%)
iast 2.178 ms [2.117 ms, 2.239 ms] 706.634 µs (48.0%)
iast_GLOBAL 2.217 ms [2.156 ms, 2.279 ms] 746.097 µs (50.7%)
profiling 2.027 ms [1.977 ms, 2.076 ms] 555.401 µs (37.7%)
tracing 1.991 ms [1.943 ms, 2.039 ms] 519.718 µs (35.3%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~c07d353482, baseline=1.50.0-SNAPSHOT~8e7b515c37
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.506 s) : 15506000, 15506000
.   : milestone, 15506000,
appsec (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
iast (19.12 s) : 19120000, 19120000
.   : milestone, 19120000,
iast_GLOBAL (18.111 s) : 18111000, 18111000
.   : milestone, 18111000,
profiling (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,
tracing (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,
section candidate
no_agent (15.398 s) : 15398000, 15398000
.   : milestone, 15398000,
appsec (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
iast (18.983 s) : 18983000, 18983000
.   : milestone, 18983000,
iast_GLOBAL (18.196 s) : 18196000, 18196000
.   : milestone, 18196000,
profiling (15.851 s) : 15851000, 15851000
.   : milestone, 15851000,
tracing (14.997 s) : 14997000, 14997000
.   : milestone, 14997000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.506 s [15.506 s, 15.506 s] -
appsec 15.001 s [15.001 s, 15.001 s] -505.0 ms (-3.3%)
iast 19.12 s [19.12 s, 19.12 s] 3.614 s (23.3%)
iast_GLOBAL 18.111 s [18.111 s, 18.111 s] 2.605 s (16.8%)
profiling 15.094 s [15.094 s, 15.094 s] -412.0 ms (-2.7%)
tracing 15.053 s [15.053 s, 15.053 s] -453.0 ms (-2.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.398 s [15.398 s, 15.398 s] -
appsec 14.94 s [14.94 s, 14.94 s] -458.0 ms (-3.0%)
iast 18.983 s [18.983 s, 18.983 s] 3.585 s (23.3%)
iast_GLOBAL 18.196 s [18.196 s, 18.196 s] 2.798 s (18.2%)
profiling 15.851 s [15.851 s, 15.851 s] 453.0 ms (2.9%)
tracing 14.997 s [14.997 s, 14.997 s] -401.0 ms (-2.6%)

@mcculls mcculls merged commit 4ca8a41 into master May 22, 2025
589 of 593 checks passed
@mcculls mcculls deleted the mhlidd/update_system_tests_hash branch May 22, 2025 09:38
@github-actions github-actions Bot added this to the 1.50.0 milestone May 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@smola smola smola approved these changes

@mcculls mcculls mcculls approved these changes

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.50.0

Development

Successfully merging this pull request may close these issues.

3 participants

@mhlidd @smola @mcculls