Skip to content

Increase parallelism of check_inst, rather than bump heap max#8630

Merged
mcculls merged 1 commit intomasterfrom
mcculls/fix_check_inst
Mar 27, 2025
Merged

Increase parallelism of check_inst, rather than bump heap max#8630
mcculls merged 1 commit intomasterfrom
mcculls/fix_check_inst

Conversation

@mcculls
Copy link
Copy Markdown
Contributor

@mcculls mcculls commented Mar 27, 2025

Motivation

Stablize CI

@mcculls mcculls added tag: no release notes Changes to exclude from release notes type: refactoring comp: tooling Build & Tooling labels Mar 27, 2025
@mcculls mcculls requested a review from a team as a code owner March 27, 2025 20:17
@mcculls mcculls requested a review from ygree March 27, 2025 20:17
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 27, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix_check_inst
git_commit_date 1743085833 1743106499
git_commit_sha 60f8046 3e5dbd5
release_version 1.48.0-SNAPSHOT~60f8046e47 1.48.0-SNAPSHOT~3e5dbd5a1a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743109437 1743109437
ci_job_id 868922732 868922732
ci_pipeline_id 60250427 60250427
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vapngg-f-project-304-concurrent-0-6y5734pn 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vapngg-f-project-304-concurrent-0-6y5734pn 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057483
Total [baseline] (8.681 s) : 0, 8681297
Agent [candidate] (1.055 s) : 0, 1054830
Total [candidate] (8.709 s) : 0, 8708841
section iast
Agent [baseline] (1.176 s) : 0, 1176045
Total [baseline] (9.227 s) : 0, 9227324
Agent [candidate] (1.178 s) : 0, 1178218
Total [candidate] (9.229 s) : 0, 9228842
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.187 s) : 0, 1187279
Total [baseline] (9.204 s) : 0, 9203534
Agent [candidate] (1.18 s) : 0, 1179957
Total [candidate] (9.19 s) : 0, 9190126
section iast_TELEMETRY_OFF
Agent [baseline] (1.172 s) : 0, 1172417
Total [baseline] (9.212 s) : 0, 9212489
Agent [candidate] (1.176 s) : 0, 1175769
Total [candidate] (9.291 s) : 0, 9290646
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.176 s 118.561 ms (11.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.187 s 129.796 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.172 s 114.934 ms (10.9%)
Total tracing 8.681 s -
Total iast 9.227 s 546.027 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.204 s 522.237 ms (6.0%)
Total iast_TELEMETRY_OFF 9.212 s 531.192 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.178 s 123.389 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 125.128 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.176 s 120.939 ms (11.5%)
Total tracing 8.709 s -
Total iast 9.229 s 520.0 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.19 s 481.285 ms (5.5%)
Total iast_TELEMETRY_OFF 9.291 s 581.805 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (724.996 ms) : 0, 724996
BytebuddyAgent [candidate] (721.595 ms) : 0, 721595
GlobalTracer [baseline] (241.239 ms) : 0, 241239
GlobalTracer [candidate] (241.614 ms) : 0, 241614
AppSec [baseline] (54.998 ms) : 0, 54998
AppSec [candidate] (55.208 ms) : 0, 55208
Debugger [baseline] (5.169 ms) : 0, 5169
Debugger [candidate] (5.322 ms) : 0, 5322
Remote Config [baseline] (715.716 µs) : 0, 716
Remote Config [candidate] (723.108 µs) : 0, 723
Telemetry [baseline] (14.26 ms) : 0, 14260
Telemetry [candidate] (14.359 ms) : 0, 14359
section iast
BytebuddyAgent [baseline] (837.616 ms) : 0, 837616
BytebuddyAgent [candidate] (838.823 ms) : 0, 838823
GlobalTracer [baseline] (229.823 ms) : 0, 229823
GlobalTracer [candidate] (230.37 ms) : 0, 230370
IAST [baseline] (22.893 ms) : 0, 22893
IAST [candidate] (23.277 ms) : 0, 23277
AppSec [baseline] (56.347 ms) : 0, 56347
AppSec [candidate] (56.203 ms) : 0, 56203
Debugger [baseline] (4.153 ms) : 0, 4153
Debugger [candidate] (4.181 ms) : 0, 4181
Remote Config [baseline] (589.555 µs) : 0, 590
Remote Config [candidate] (612.609 µs) : 0, 613
Telemetry [baseline] (8.669 ms) : 0, 8669
Telemetry [candidate] (8.713 ms) : 0, 8713
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (846.073 ms) : 0, 846073
BytebuddyAgent [candidate] (840.8 ms) : 0, 840800
GlobalTracer [baseline] (231.859 ms) : 0, 231859
GlobalTracer [candidate] (230.553 ms) : 0, 230553
IAST [baseline] (23.146 ms) : 0, 23146
IAST [candidate] (23.732 ms) : 0, 23732
AppSec [baseline] (56.465 ms) : 0, 56465
AppSec [candidate] (55.308 ms) : 0, 55308
Debugger [baseline] (4.159 ms) : 0, 4159
Debugger [candidate] (4.187 ms) : 0, 4187
Remote Config [baseline] (601.999 µs) : 0, 602
Remote Config [candidate] (608.141 µs) : 0, 608
Telemetry [baseline] (8.866 ms) : 0, 8866
Telemetry [candidate] (8.792 ms) : 0, 8792
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (835.128 ms) : 0, 835128
BytebuddyAgent [candidate] (836.644 ms) : 0, 836644
GlobalTracer [baseline] (230.001 ms) : 0, 230001
GlobalTracer [candidate] (230.737 ms) : 0, 230737
IAST [baseline] (22.205 ms) : 0, 22205
IAST [candidate] (22.464 ms) : 0, 22464
AppSec [baseline] (55.914 ms) : 0, 55914
AppSec [candidate] (56.439 ms) : 0, 56439
Debugger [baseline] (4.126 ms) : 0, 4126
Debugger [candidate] (4.168 ms) : 0, 4168
Remote Config [baseline] (592.922 µs) : 0, 593
Remote Config [candidate] (604.994 µs) : 0, 605
Telemetry [baseline] (8.52 ms) : 0, 8520
Telemetry [candidate] (8.693 ms) : 0, 8693
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047447
Total [baseline] (10.487 s) : 0, 10487192
Agent [candidate] (1.047 s) : 0, 1047242
Total [candidate] (10.509 s) : 0, 10509284
section appsec
Agent [baseline] (1.189 s) : 0, 1189018
Total [baseline] (10.755 s) : 0, 10754854
Agent [candidate] (1.19 s) : 0, 1189553
Total [candidate] (10.725 s) : 0, 10725221
section iast
Agent [baseline] (1.176 s) : 0, 1176145
Total [baseline] (10.955 s) : 0, 10954625
Agent [candidate] (1.178 s) : 0, 1178332
Total [candidate] (11.017 s) : 0, 11016703
section profiling
Agent [baseline] (1.284 s) : 0, 1283518
Total [baseline] (10.853 s) : 0, 10853168
Agent [candidate] (1.273 s) : 0, 1273109
Total [candidate] (10.86 s) : 0, 10860218
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.189 s 141.571 ms (13.5%)
Agent iast 1.176 s 128.698 ms (12.3%)
Agent profiling 1.284 s 236.071 ms (22.5%)
Total tracing 10.487 s -
Total appsec 10.755 s 267.662 ms (2.6%)
Total iast 10.955 s 467.433 ms (4.5%)
Total profiling 10.853 s 365.976 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.19 s 142.311 ms (13.6%)
Agent iast 1.178 s 131.09 ms (12.5%)
Agent profiling 1.273 s 225.867 ms (21.6%)
Total tracing 10.509 s -
Total appsec 10.725 s 215.937 ms (2.1%)
Total iast 11.017 s 507.418 ms (4.8%)
Total profiling 10.86 s 350.934 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.915 ms) : 0, 718915
BytebuddyAgent [candidate] (718.463 ms) : 0, 718463
GlobalTracer [baseline] (239.838 ms) : 0, 239838
GlobalTracer [candidate] (240.114 ms) : 0, 240114
AppSec [baseline] (55.092 ms) : 0, 55092
AppSec [candidate] (55.277 ms) : 0, 55277
Debugger [baseline] (5.251 ms) : 0, 5251
Debugger [candidate] (4.417 ms) : 0, 4417
Remote Config [baseline] (727.731 µs) : 0, 728
Remote Config [candidate] (720.793 µs) : 0, 721
Telemetry [baseline] (11.639 ms) : 0, 11639
Telemetry [candidate] (12.231 ms) : 0, 12231
section appsec
BytebuddyAgent [baseline] (736.244 ms) : 0, 736244
BytebuddyAgent [candidate] (737.091 ms) : 0, 737091
GlobalTracer [baseline] (236.456 ms) : 0, 236456
GlobalTracer [candidate] (236.315 ms) : 0, 236315
AppSec [baseline] (176.086 ms) : 0, 176086
AppSec [candidate] (175.506 ms) : 0, 175506
Debugger [baseline] (4.292 ms) : 0, 4292
Debugger [candidate] (4.277 ms) : 0, 4277
Remote Config [baseline] (650.105 µs) : 0, 650
Remote Config [candidate] (643.656 µs) : 0, 644
Telemetry [baseline] (8.516 ms) : 0, 8516
Telemetry [candidate] (8.918 ms) : 0, 8918
IAST [baseline] (21.575 ms) : 0, 21575
IAST [candidate] (21.614 ms) : 0, 21614
section iast
BytebuddyAgent [baseline] (837.361 ms) : 0, 837361
BytebuddyAgent [candidate] (839.282 ms) : 0, 839282
GlobalTracer [baseline] (230.224 ms) : 0, 230224
GlobalTracer [candidate] (230.754 ms) : 0, 230754
AppSec [baseline] (56.294 ms) : 0, 56294
AppSec [candidate] (55.917 ms) : 0, 55917
Debugger [baseline] (4.179 ms) : 0, 4179
Debugger [candidate] (4.159 ms) : 0, 4159
Remote Config [baseline] (602.428 µs) : 0, 602
Remote Config [candidate] (607.277 µs) : 0, 607
Telemetry [baseline] (8.761 ms) : 0, 8761
Telemetry [candidate] (8.77 ms) : 0, 8770
IAST [baseline] (22.807 ms) : 0, 22807
IAST [candidate] (22.873 ms) : 0, 22873
section profiling
ProfilingAgent [baseline] (102.749 ms) : 0, 102749
ProfilingAgent [candidate] (101.731 ms) : 0, 101731
BytebuddyAgent [baseline] (716.313 ms) : 0, 716313
BytebuddyAgent [candidate] (711.514 ms) : 0, 711514
GlobalTracer [baseline] (353.282 ms) : 0, 353282
GlobalTracer [candidate] (350.829 ms) : 0, 350829
AppSec [baseline] (55.153 ms) : 0, 55153
AppSec [candidate] (53.463 ms) : 0, 53463
Debugger [baseline] (4.316 ms) : 0, 4316
Debugger [candidate] (4.266 ms) : 0, 4266
Remote Config [baseline] (706.222 µs) : 0, 706
Remote Config [candidate] (696.524 µs) : 0, 697
Telemetry [baseline] (9.081 ms) : 0, 9081
Telemetry [candidate] (8.88 ms) : 0, 8880
Profiling [baseline] (102.776 ms) : 0, 102776
Profiling [candidate] (101.757 ms) : 0, 101757
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-27T20:34:14 2025-03-27T20:41:56
git_branch master mcculls/fix_check_inst
git_commit_date 1743085833 1743106499
git_commit_sha 60f8046 3e5dbd5
release_version 1.48.0-SNAPSHOT~60f8046e47 1.48.0-SNAPSHOT~3e5dbd5a1a
start_time 2025-03-27T20:33:59 2025-03-27T20:41:42
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743108515 1743108515
ci_job_id 868922733 868922733
ci_pipeline_id 60250427 60250427
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vapngg-f-project-304-concurrent-1-skt6vqk5 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vapngg-f-project-304-concurrent-1-skt6vqk5 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 12 metrics, 17 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+67.724µs; +120.535µs] or [+4.506%; +8.020%]		 unstable
[-668.557op/s; +440.637op/s] or [-21.728%; +14.321%]		 1.597ms 2962.963op/s 1.503ms 3076.923op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.251 µs) : 358, 400
.   : milestone, 379,
iast (518.622 µs) : 497, 541
.   : milestone, 519,
iast_FULL (727.308 µs) : 705, 749
.   : milestone, 727,
iast_GLOBAL (561.124 µs) : 539, 583
.   : milestone, 561,
iast_HARDCODED_SECRET_DISABLED (510.695 µs) : 489, 533
.   : milestone, 511,
iast_INACTIVE (462.679 µs) : 441, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (498.821 µs) : 477, 521
.   : milestone, 499,
tracing (457.067 µs) : 436, 478
.   : milestone, 457,
section candidate
no_agent (380.457 µs) : 361, 400
.   : milestone, 380,
iast (509.908 µs) : 488, 532
.   : milestone, 510,
iast_FULL (736.135 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (552.553 µs) : 531, 574
.   : milestone, 553,
iast_HARDCODED_SECRET_DISABLED (505.753 µs) : 484, 527
.   : milestone, 506,
iast_INACTIVE (467.694 µs) : 446, 489
.   : milestone, 468,
iast_TELEMETRY_OFF (498.08 µs) : 476, 520
.   : milestone, 498,
tracing (456.924 µs) : 436, 478
.   : milestone, 457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.251 µs [358.258 µs, 400.244 µs] -
iast 518.622 µs [496.596 µs, 540.648 µs] 139.37 µs (36.7%)
iast_FULL 727.308 µs [705.382 µs, 749.234 µs] 348.057 µs (91.8%)
iast_GLOBAL 561.124 µs [538.988 µs, 583.259 µs] 181.872 µs (48.0%)
iast_HARDCODED_SECRET_DISABLED 510.695 µs [488.774 µs, 532.616 µs] 131.444 µs (34.7%)
iast_INACTIVE 462.679 µs [440.806 µs, 484.551 µs] 83.428 µs (22.0%)
iast_TELEMETRY_OFF 498.821 µs [476.927 µs, 520.715 µs] 119.57 µs (31.5%)
tracing 457.067 µs [435.873 µs, 478.26 µs] 77.815 µs (20.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.457 µs [360.828 µs, 400.087 µs] -
iast 509.908 µs [488.269 µs, 531.547 µs] 129.451 µs (34.0%)
iast_FULL 736.135 µs [714.304 µs, 757.967 µs] 355.678 µs (93.5%)
iast_GLOBAL 552.553 µs [530.957 µs, 574.149 µs] 172.095 µs (45.2%)
iast_HARDCODED_SECRET_DISABLED 505.753 µs [484.185 µs, 527.321 µs] 125.296 µs (32.9%)
iast_INACTIVE 467.694 µs [445.988 µs, 489.401 µs] 87.237 µs (22.9%)
iast_TELEMETRY_OFF 498.08 µs [476.368 µs, 519.793 µs] 117.623 µs (30.9%)
tracing 456.924 µs [435.897 µs, 477.951 µs] 76.467 µs (20.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.362 ms) : 1342, 1382
.   : milestone, 1362,
appsec (1.72 ms) : 1697, 1744
.   : milestone, 1720,
appsec_no_iast (1.745 ms) : 1722, 1768
.   : milestone, 1745,
code_origins (1.687 ms) : 1660, 1714
.   : milestone, 1687,
iast (1.519 ms) : 1495, 1543
.   : milestone, 1519,
profiling (1.503 ms) : 1479, 1527
.   : milestone, 1503,
tracing (1.481 ms) : 1455, 1506
.   : milestone, 1481,
section candidate
no_agent (1.356 ms) : 1336, 1375
.   : milestone, 1356,
appsec (1.713 ms) : 1689, 1737
.   : milestone, 1713,
appsec_no_iast (1.743 ms) : 1720, 1766
.   : milestone, 1743,
code_origins (1.696 ms) : 1670, 1723
.   : milestone, 1696,
iast (1.517 ms) : 1493, 1542
.   : milestone, 1517,
profiling (1.597 ms) : 1572, 1622
.   : milestone, 1597,
tracing (1.51 ms) : 1485, 1535
.   : milestone, 1510,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.362 ms [1.342 ms, 1.382 ms] -
appsec 1.72 ms [1.697 ms, 1.744 ms] 357.739 µs (26.3%)
appsec_no_iast 1.745 ms [1.722 ms, 1.768 ms] 382.532 µs (28.1%)
code_origins 1.687 ms [1.66 ms, 1.714 ms] 324.66 µs (23.8%)
iast 1.519 ms [1.495 ms, 1.543 ms] 156.761 µs (11.5%)
profiling 1.503 ms [1.479 ms, 1.527 ms] 140.597 µs (10.3%)
tracing 1.481 ms [1.455 ms, 1.506 ms] 118.149 µs (8.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.336 ms, 1.375 ms] -
appsec 1.713 ms [1.689 ms, 1.737 ms] 357.391 µs (26.4%)
appsec_no_iast 1.743 ms [1.72 ms, 1.766 ms] 386.983 µs (28.5%)
code_origins 1.696 ms [1.67 ms, 1.723 ms] 340.848 µs (25.1%)
iast 1.517 ms [1.493 ms, 1.542 ms] 161.705 µs (11.9%)
profiling 1.597 ms [1.572 ms, 1.622 ms] 241.535 µs (17.8%)
tracing 1.51 ms [1.485 ms, 1.535 ms] 154.417 µs (11.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/fix_check_inst
git_commit_date 1743085833 1743106499
git_commit_sha 60f8046 3e5dbd5
release_version 1.48.0-SNAPSHOT~60f8046e47 1.48.0-SNAPSHOT~3e5dbd5a1a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1743109129 1743109129
ci_job_id 868922734 868922734
ci_pipeline_id 60250427 60250427
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-232sggg1-project-304-concurrent-0-xkpdekth 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-232sggg1-project-304-concurrent-0-xkpdekth 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.351 ms) : 2307, 2395
.   : milestone, 2351,
iast (2.13 ms) : 2074, 2185
.   : milestone, 2130,
iast_GLOBAL (2.177 ms) : 2121, 2233
.   : milestone, 2177,
profiling (1.989 ms) : 1946, 2033
.   : milestone, 1989,
tracing (1.979 ms) : 1936, 2022
.   : milestone, 1979,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.363 ms) : 2319, 2407
.   : milestone, 2363,
iast (2.137 ms) : 2082, 2193
.   : milestone, 2137,
iast_GLOBAL (2.177 ms) : 2120, 2233
.   : milestone, 2177,
profiling (2.465 ms) : 2286, 2645
.   : milestone, 2465,
tracing (1.967 ms) : 1924, 2009
.   : milestone, 1967,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.351 ms [2.307 ms, 2.395 ms] 873.18 µs (59.1%)
iast 2.13 ms [2.074 ms, 2.185 ms] 651.989 µs (44.1%)
iast_GLOBAL 2.177 ms [2.121 ms, 2.233 ms] 698.968 µs (47.3%)
profiling 1.989 ms [1.946 ms, 2.033 ms] 511.68 µs (34.6%)
tracing 1.979 ms [1.936 ms, 2.022 ms] 500.961 µs (33.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.363 ms [2.319 ms, 2.407 ms] 885.007 µs (59.9%)
iast 2.137 ms [2.082 ms, 2.193 ms] 659.365 µs (44.6%)
iast_GLOBAL 2.177 ms [2.12 ms, 2.233 ms] 698.854 µs (47.3%)
profiling 2.465 ms [2.286 ms, 2.645 ms] 987.514 µs (66.8%)
tracing 1.967 ms [1.924 ms, 2.009 ms] 488.964 µs (33.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~3e5dbd5a1a, baseline=1.48.0-SNAPSHOT~60f8046e47
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
appsec (14.974 s) : 14974000, 14974000
.   : milestone, 14974000,
iast (18.719 s) : 18719000, 18719000
.   : milestone, 18719000,
iast_GLOBAL (17.872 s) : 17872000, 17872000
.   : milestone, 17872000,
profiling (14.956 s) : 14956000, 14956000
.   : milestone, 14956000,
tracing (15.258 s) : 15258000, 15258000
.   : milestone, 15258000,
section candidate
no_agent (14.938 s) : 14938000, 14938000
.   : milestone, 14938000,
appsec (15.003 s) : 15003000, 15003000
.   : milestone, 15003000,
iast (19.095 s) : 19095000, 19095000
.   : milestone, 19095000,
iast_GLOBAL (17.665 s) : 17665000, 17665000
.   : milestone, 17665000,
profiling (15.035 s) : 15035000, 15035000
.   : milestone, 15035000,
tracing (15.106 s) : 15106000, 15106000
.   : milestone, 15106000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.87 s [14.87 s, 14.87 s] -
appsec 14.974 s [14.974 s, 14.974 s] 104.0 ms (0.7%)
iast 18.719 s [18.719 s, 18.719 s] 3.849 s (25.9%)
iast_GLOBAL 17.872 s [17.872 s, 17.872 s] 3.002 s (20.2%)
profiling 14.956 s [14.956 s, 14.956 s] 86.0 ms (0.6%)
tracing 15.258 s [15.258 s, 15.258 s] 388.0 ms (2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.938 s [14.938 s, 14.938 s] -
appsec 15.003 s [15.003 s, 15.003 s] 65.0 ms (0.4%)
iast 19.095 s [19.095 s, 19.095 s] 4.157 s (27.8%)
iast_GLOBAL 17.665 s [17.665 s, 17.665 s] 2.727 s (18.3%)
profiling 15.035 s [15.035 s, 15.035 s] 97.0 ms (0.6%)
tracing 15.106 s [15.106 s, 15.106 s] 168.0 ms (1.1%)

@mcculls mcculls added tag: no release notes Changes to exclude from release notes and removed tag: no release notes Changes to exclude from release notes labels Mar 27, 2025
@mcculls mcculls enabled auto-merge (squash) March 27, 2025 22:11
@mcculls mcculls merged commit 473081b into master Mar 27, 2025
272 of 273 checks passed
@mcculls mcculls deleted the mcculls/fix_check_inst branch March 27, 2025 22:46
@github-actions github-actions Bot added this to the 1.48.0 milestone Mar 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ygree ygree ygree approved these changes

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: refactoring

Projects

None yet

Milestone

1.48.0

Development

Successfully merging this pull request may close these issues.

2 participants

@mcculls @ygree