Skip to content

Minor test changes to avoid deprecated API#8574

Merged
mcculls merged 1 commit intomasterfrom
mcculls/misc-test-changes
Mar 18, 2025
Merged

Minor test changes to avoid deprecated API#8574
mcculls merged 1 commit intomasterfrom
mcculls/misc-test-changes

Conversation

@mcculls
Copy link
Copy Markdown
Contributor

@mcculls mcculls commented Mar 17, 2025 •
edited
Loading

.

@mcculls mcculls added comp: testing Testing tag: no release notes Changes to exclude from release notes type: refactoring labels Mar 17, 2025
@mcculls mcculls marked this pull request as ready for review March 17, 2025 16:54
@mcculls mcculls requested review from a team as code owners March 17, 2025 16:54
@mcculls mcculls requested a review from amarziali March 17, 2025 16:54
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 17, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/misc-test-changes
git_commit_date 1742234721 1742238822
git_commit_sha 1c3133b 3de10b6
release_version 1.48.0-SNAPSHOT~1c3133b647 1.48.0-SNAPSHOT~3de10b6a5f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1742241265 1742241265
ci_job_id 851522728 851522728
ci_pipeline_id 59086121 59086121
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vwsmj6et-project-304-concurrent-0-7plgyxie 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vwsmj6et-project-304-concurrent-0-7plgyxie 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040138
Total [baseline] (8.644 s) : 0, 8643598
Agent [candidate] (1.036 s) : 0, 1035907
Total [candidate] (8.643 s) : 0, 8642956
section iast
Agent [baseline] (1.176 s) : 0, 1176273
Total [baseline] (9.245 s) : 0, 9244565
Agent [candidate] (1.177 s) : 0, 1176559
Total [candidate] (9.188 s) : 0, 9188159
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.168 s) : 0, 1167622
Total [baseline] (9.188 s) : 0, 9188410
Agent [candidate] (1.167 s) : 0, 1167418
Total [candidate] (9.151 s) : 0, 9150815
section iast_TELEMETRY_OFF
Agent [baseline] (1.176 s) : 0, 1175807
Total [baseline] (9.255 s) : 0, 9254653
Agent [candidate] (1.174 s) : 0, 1173701
Total [candidate] (9.216 s) : 0, 9216174
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent iast 1.176 s 136.135 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.168 s 127.484 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.176 s 135.669 ms (13.0%)
Total tracing 8.644 s -
Total iast 9.245 s 600.967 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.188 s 544.812 ms (6.3%)
Total iast_TELEMETRY_OFF 9.255 s 611.055 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent iast 1.177 s 140.652 ms (13.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.167 s 131.511 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.174 s 137.793 ms (13.3%)
Total tracing 8.643 s -
Total iast 9.188 s 545.204 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.151 s 507.859 ms (5.9%)
Total iast_TELEMETRY_OFF 9.216 s 573.218 ms (6.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.372 ms) : 0, 718372
BytebuddyAgent [candidate] (715.929 ms) : 0, 715929
GlobalTracer [baseline] (239.028 ms) : 0, 239028
GlobalTracer [candidate] (238.459 ms) : 0, 238459
AppSec [baseline] (54.724 ms) : 0, 54724
AppSec [candidate] (54.404 ms) : 0, 54404
Remote Config [baseline] (694.602 µs) : 0, 695
Remote Config [candidate] (687.167 µs) : 0, 687
Telemetry [baseline] (12.144 ms) : 0, 12144
Telemetry [candidate] (11.319 ms) : 0, 11319
section iast
BytebuddyAgent [baseline] (842.121 ms) : 0, 842121
BytebuddyAgent [candidate] (842.303 ms) : 0, 842303
GlobalTracer [baseline] (230.471 ms) : 0, 230471
GlobalTracer [candidate] (230.782 ms) : 0, 230782
AppSec [baseline] (56.168 ms) : 0, 56168
AppSec [candidate] (56.215 ms) : 0, 56215
Remote Config [baseline] (621.72 µs) : 0, 622
Remote Config [candidate] (606.976 µs) : 0, 607
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.7 ms) : 0, 8700
IAST [baseline] (22.907 ms) : 0, 22907
IAST [candidate] (22.695 ms) : 0, 22695
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (835.114 ms) : 0, 835114
BytebuddyAgent [candidate] (834.97 ms) : 0, 834970
GlobalTracer [baseline] (229.122 ms) : 0, 229122
GlobalTracer [candidate] (229.301 ms) : 0, 229301
AppSec [baseline] (56.091 ms) : 0, 56091
AppSec [candidate] (56.043 ms) : 0, 56043
Remote Config [baseline] (616.82 µs) : 0, 617
Remote Config [candidate] (593.148 µs) : 0, 593
Telemetry [baseline] (8.657 ms) : 0, 8657
Telemetry [candidate] (8.616 ms) : 0, 8616
IAST [baseline] (22.792 ms) : 0, 22792
IAST [candidate] (22.676 ms) : 0, 22676
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (841.535 ms) : 0, 841535
BytebuddyAgent [candidate] (839.723 ms) : 0, 839723
GlobalTracer [baseline] (230.804 ms) : 0, 230804
GlobalTracer [candidate] (230.544 ms) : 0, 230544
AppSec [baseline] (56.466 ms) : 0, 56466
AppSec [candidate] (56.321 ms) : 0, 56321
Remote Config [baseline] (610.254 µs) : 0, 610
Remote Config [candidate] (613.482 µs) : 0, 613
Telemetry [baseline] (8.684 ms) : 0, 8684
Telemetry [candidate] (8.684 ms) : 0, 8684
IAST [baseline] (22.396 ms) : 0, 22396
IAST [candidate] (22.515 ms) : 0, 22515
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040448
Total [baseline] (10.394 s) : 0, 10394068
Agent [candidate] (1.039 s) : 0, 1038532
Total [candidate] (10.43 s) : 0, 10429843
section appsec
Agent [baseline] (1.188 s) : 0, 1187694
Total [baseline] (10.772 s) : 0, 10772359
Agent [candidate] (1.179 s) : 0, 1178902
Total [candidate] (10.718 s) : 0, 10717817
section iast
Agent [baseline] (1.17 s) : 0, 1170423
Total [baseline] (10.977 s) : 0, 10977152
Agent [candidate] (1.168 s) : 0, 1168401
Total [candidate] (11.03 s) : 0, 11030378
section profiling
Agent [baseline] (1.257 s) : 0, 1256628
Total [baseline] (10.767 s) : 0, 10767101
Agent [candidate] (1.26 s) : 0, 1259643
Total [candidate] (10.839 s) : 0, 10839142
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.188 s 147.246 ms (14.2%)
Agent iast 1.17 s 129.976 ms (12.5%)
Agent profiling 1.257 s 216.18 ms (20.8%)
Total tracing 10.394 s -
Total appsec 10.772 s 378.291 ms (3.6%)
Total iast 10.977 s 583.083 ms (5.6%)
Total profiling 10.767 s 373.033 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent appsec 1.179 s 140.371 ms (13.5%)
Agent iast 1.168 s 129.869 ms (12.5%)
Agent profiling 1.26 s 221.111 ms (21.3%)
Total tracing 10.43 s -
Total appsec 10.718 s 287.974 ms (2.8%)
Total iast 11.03 s 600.535 ms (5.8%)
Total profiling 10.839 s 409.299 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.796 ms) : 0, 717796
BytebuddyAgent [candidate] (716.216 ms) : 0, 716216
GlobalTracer [baseline] (239.164 ms) : 0, 239164
GlobalTracer [candidate] (238.459 ms) : 0, 238459
AppSec [baseline] (54.769 ms) : 0, 54769
AppSec [candidate] (54.521 ms) : 0, 54521
Remote Config [baseline] (684.386 µs) : 0, 684
Remote Config [candidate] (684.784 µs) : 0, 685
Telemetry [baseline] (12.877 ms) : 0, 12877
Telemetry [candidate] (13.496 ms) : 0, 13496
section appsec
BytebuddyAgent [baseline] (739.455 ms) : 0, 739455
BytebuddyAgent [candidate] (733.775 ms) : 0, 733775
GlobalTracer [baseline] (237.118 ms) : 0, 237118
GlobalTracer [candidate] (235.231 ms) : 0, 235231
AppSec [baseline] (176.222 ms) : 0, 176222
AppSec [candidate] (175.024 ms) : 0, 175024
Remote Config [baseline] (653.27 µs) : 0, 653
Remote Config [candidate] (655.124 µs) : 0, 655
Telemetry [baseline] (8.256 ms) : 0, 8256
Telemetry [candidate] (8.261 ms) : 0, 8261
IAST [baseline] (21.504 ms) : 0, 21504
IAST [candidate] (21.506 ms) : 0, 21506
section iast
BytebuddyAgent [baseline] (837.727 ms) : 0, 837727
BytebuddyAgent [candidate] (835.325 ms) : 0, 835325
GlobalTracer [baseline] (229.691 ms) : 0, 229691
GlobalTracer [candidate] (229.508 ms) : 0, 229508
AppSec [baseline] (55.92 ms) : 0, 55920
AppSec [candidate] (56.234 ms) : 0, 56234
Remote Config [baseline] (589.604 µs) : 0, 590
Remote Config [candidate] (603.749 µs) : 0, 604
Telemetry [baseline] (8.59 ms) : 0, 8590
Telemetry [candidate] (8.719 ms) : 0, 8719
IAST [baseline] (22.723 ms) : 0, 22723
IAST [candidate] (22.815 ms) : 0, 22815
section profiling
BytebuddyAgent [baseline] (707.583 ms) : 0, 707583
BytebuddyAgent [candidate] (708.65 ms) : 0, 708650
GlobalTracer [baseline] (348.054 ms) : 0, 348054
GlobalTracer [candidate] (350.121 ms) : 0, 350121
AppSec [baseline] (54.249 ms) : 0, 54249
AppSec [candidate] (53.569 ms) : 0, 53569
Remote Config [baseline] (664.747 µs) : 0, 665
Remote Config [candidate] (659.143 µs) : 0, 659
Telemetry [baseline] (8.929 ms) : 0, 8929
Telemetry [candidate] (8.945 ms) : 0, 8945
ProfilingAgent [baseline] (96.645 ms) : 0, 96645
ProfilingAgent [candidate] (96.971 ms) : 0, 96971
Profiling [baseline] (96.67 ms) : 0, 96670
Profiling [candidate] (96.997 ms) : 0, 96997
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-17T19:22:52 2025-03-17T19:30:35
git_branch master mcculls/misc-test-changes
git_commit_date 1742234721 1742238822
git_commit_sha 1c3133b 3de10b6
release_version 1.48.0-SNAPSHOT~1c3133b647 1.48.0-SNAPSHOT~3de10b6a5f
start_time 2025-03-17T19:22:38 2025-03-17T19:30:21
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1742240231 1742240231
ci_job_id 851522729 851522729
ci_pipeline_id 59086121 59086121
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vwsmj6et-project-304-concurrent-1-8tu9t8zw 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vwsmj6et-project-304-concurrent-1-8tu9t8zw 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.332 ms) : 1312, 1352
.   : milestone, 1332,
appsec (1.727 ms) : 1703, 1751
.   : milestone, 1727,
appsec_no_iast (1.733 ms) : 1709, 1757
.   : milestone, 1733,
code_origins (1.677 ms) : 1648, 1705
.   : milestone, 1677,
iast (1.5 ms) : 1475, 1525
.   : milestone, 1500,
profiling (1.543 ms) : 1518, 1569
.   : milestone, 1543,
tracing (1.475 ms) : 1449, 1500
.   : milestone, 1475,
section candidate
no_agent (1.358 ms) : 1338, 1378
.   : milestone, 1358,
appsec (1.733 ms) : 1709, 1756
.   : milestone, 1733,
appsec_no_iast (1.738 ms) : 1712, 1763
.   : milestone, 1738,
code_origins (1.684 ms) : 1657, 1711
.   : milestone, 1684,
iast (1.509 ms) : 1485, 1533
.   : milestone, 1509,
profiling (1.502 ms) : 1479, 1525
.   : milestone, 1502,
tracing (1.505 ms) : 1480, 1530
.   : milestone, 1505,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.332 ms [1.312 ms, 1.352 ms] -
appsec 1.727 ms [1.703 ms, 1.751 ms] 395.273 µs (29.7%)
appsec_no_iast 1.733 ms [1.709 ms, 1.757 ms] 400.535 µs (30.1%)
code_origins 1.677 ms [1.648 ms, 1.705 ms] 344.496 µs (25.9%)
iast 1.5 ms [1.475 ms, 1.525 ms] 167.875 µs (12.6%)
profiling 1.543 ms [1.518 ms, 1.569 ms] 211.173 µs (15.9%)
tracing 1.475 ms [1.449 ms, 1.5 ms] 142.638 µs (10.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.338 ms, 1.378 ms] -
appsec 1.733 ms [1.709 ms, 1.756 ms] 374.852 µs (27.6%)
appsec_no_iast 1.738 ms [1.712 ms, 1.763 ms] 380.032 µs (28.0%)
code_origins 1.684 ms [1.657 ms, 1.711 ms] 325.922 µs (24.0%)
iast 1.509 ms [1.485 ms, 1.533 ms] 151.141 µs (11.1%)
profiling 1.502 ms [1.479 ms, 1.525 ms] 144.12 µs (10.6%)
tracing 1.505 ms [1.48 ms, 1.53 ms] 147.113 µs (10.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647
    dateFormat X
    axisFormat %s
section baseline
no_agent (383.672 µs) : 364, 404
.   : milestone, 384,
iast (511.082 µs) : 489, 533
.   : milestone, 511,
iast_FULL (730.365 µs) : 708, 752
.   : milestone, 730,
iast_GLOBAL (550.769 µs) : 529, 572
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (505.102 µs) : 484, 527
.   : milestone, 505,
iast_INACTIVE (461.229 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (500.001 µs) : 478, 522
.   : milestone, 500,
tracing (452.559 µs) : 432, 473
.   : milestone, 453,
section candidate
no_agent (378.713 µs) : 358, 400
.   : milestone, 379,
iast (507.9 µs) : 486, 529
.   : milestone, 508,
iast_FULL (730.349 µs) : 708, 753
.   : milestone, 730,
iast_GLOBAL (560.341 µs) : 538, 582
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (516.254 µs) : 494, 539
.   : milestone, 516,
iast_INACTIVE (466.565 µs) : 443, 490
.   : milestone, 467,
iast_TELEMETRY_OFF (498.796 µs) : 477, 521
.   : milestone, 499,
tracing (463.837 µs) : 442, 486
.   : milestone, 464,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.672 µs [363.606 µs, 403.738 µs] -
iast 511.082 µs [488.889 µs, 533.274 µs] 127.409 µs (33.2%)
iast_FULL 730.365 µs [708.472 µs, 752.258 µs] 346.692 µs (90.4%)
iast_GLOBAL 550.769 µs [529.245 µs, 572.293 µs] 167.097 µs (43.6%)
iast_HARDCODED_SECRET_DISABLED 505.102 µs [483.51 µs, 526.694 µs] 121.43 µs (31.6%)
iast_INACTIVE 461.229 µs [439.91 µs, 482.548 µs] 77.557 µs (20.2%)
iast_TELEMETRY_OFF 500.001 µs [478.276 µs, 521.726 µs] 116.329 µs (30.3%)
tracing 452.559 µs [431.797 µs, 473.321 µs] 68.887 µs (18.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.713 µs [357.852 µs, 399.574 µs] -
iast 507.9 µs [486.424 µs, 529.376 µs] 129.187 µs (34.1%)
iast_FULL 730.349 µs [708.147 µs, 752.55 µs] 351.636 µs (92.9%)
iast_GLOBAL 560.341 µs [538.231 µs, 582.452 µs] 181.629 µs (48.0%)
iast_HARDCODED_SECRET_DISABLED 516.254 µs [493.705 µs, 538.804 µs] 137.542 µs (36.3%)
iast_INACTIVE 466.565 µs [443.418 µs, 489.712 µs] 87.853 µs (23.2%)
iast_TELEMETRY_OFF 498.796 µs [476.819 µs, 520.773 µs] 120.083 µs (31.7%)
tracing 463.837 µs [441.552 µs, 486.122 µs] 85.124 µs (22.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mcculls/misc-test-changes
git_commit_date 1742234721 1742238822
git_commit_sha 1c3133b 3de10b6
release_version 1.48.0-SNAPSHOT~1c3133b647 1.48.0-SNAPSHOT~3de10b6a5f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1742240833 1742240833
ci_job_id 851522730 851522730
ci_pipeline_id 59086121 59086121
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-1svscxdh-project-304-concurrent-0-f3p5ux8o 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-1svscxdh-project-304-concurrent-0-f3p5ux8o 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.935 s) : 14935000, 14935000
.   : milestone, 14935000,
appsec (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
iast (18.426 s) : 18426000, 18426000
.   : milestone, 18426000,
iast_GLOBAL (17.863 s) : 17863000, 17863000
.   : milestone, 17863000,
profiling (14.928 s) : 14928000, 14928000
.   : milestone, 14928000,
tracing (14.765 s) : 14765000, 14765000
.   : milestone, 14765000,
section candidate
no_agent (15.217 s) : 15217000, 15217000
.   : milestone, 15217000,
appsec (14.845 s) : 14845000, 14845000
.   : milestone, 14845000,
iast (18.933 s) : 18933000, 18933000
.   : milestone, 18933000,
iast_GLOBAL (18.318 s) : 18318000, 18318000
.   : milestone, 18318000,
profiling (15.427 s) : 15427000, 15427000
.   : milestone, 15427000,
tracing (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.935 s [14.935 s, 14.935 s] -
appsec 14.969 s [14.969 s, 14.969 s] 34.0 ms (0.2%)
iast 18.426 s [18.426 s, 18.426 s] 3.491 s (23.4%)
iast_GLOBAL 17.863 s [17.863 s, 17.863 s] 2.928 s (19.6%)
profiling 14.928 s [14.928 s, 14.928 s] -7.0 ms (-0.0%)
tracing 14.765 s [14.765 s, 14.765 s] -170.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.217 s [15.217 s, 15.217 s] -
appsec 14.845 s [14.845 s, 14.845 s] -372.0 ms (-2.4%)
iast 18.933 s [18.933 s, 18.933 s] 3.716 s (24.4%)
iast_GLOBAL 18.318 s [18.318 s, 18.318 s] 3.101 s (20.4%)
profiling 15.427 s [15.427 s, 15.427 s] 210.0 ms (1.4%)
tracing 14.94 s [14.94 s, 14.94 s] -277.0 ms (-1.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~3de10b6a5f, baseline=1.48.0-SNAPSHOT~1c3133b647
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.348 ms) : 2304, 2392
.   : milestone, 2348,
iast (2.118 ms) : 2062, 2174
.   : milestone, 2118,
iast_GLOBAL (2.164 ms) : 2108, 2220
.   : milestone, 2164,
profiling (2.001 ms) : 1955, 2047
.   : milestone, 2001,
tracing (1.958 ms) : 1915, 2001
.   : milestone, 1958,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.35 ms) : 2305, 2394
.   : milestone, 2350,
iast (2.128 ms) : 2072, 2183
.   : milestone, 2128,
iast_GLOBAL (2.168 ms) : 2111, 2224
.   : milestone, 2168,
profiling (1.998 ms) : 1953, 2044
.   : milestone, 1998,
tracing (1.962 ms) : 1919, 2005
.   : milestone, 1962,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.348 ms [2.304 ms, 2.392 ms] 877.732 µs (59.7%)
iast 2.118 ms [2.062 ms, 2.174 ms] 647.565 µs (44.0%)
iast_GLOBAL 2.164 ms [2.108 ms, 2.22 ms] 693.53 µs (47.2%)
profiling 2.001 ms [1.955 ms, 2.047 ms] 530.424 µs (36.1%)
tracing 1.958 ms [1.915 ms, 2.001 ms] 487.647 µs (33.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.35 ms [2.305 ms, 2.394 ms] 878.787 µs (59.7%)
iast 2.128 ms [2.072 ms, 2.183 ms] 656.638 µs (44.6%)
iast_GLOBAL 2.168 ms [2.111 ms, 2.224 ms] 696.732 µs (47.4%)
profiling 1.998 ms [1.953 ms, 2.044 ms] 527.384 µs (35.9%)
tracing 1.962 ms [1.919 ms, 2.005 ms] 490.846 µs (33.4%)

@mcculls mcculls enabled auto-merge (squash) March 17, 2025 17:41
@mcculls mcculls force-pushed the mcculls/misc-test-changes branch from 1a2b49e to 3de10b6 Compare March 17, 2025 19:13
@mcculls mcculls merged commit b046b86 into master Mar 18, 2025
@mcculls mcculls deleted the mcculls/misc-test-changes branch March 18, 2025 08:05
@github-actions github-actions Bot added this to the 1.48.0 milestone Mar 18, 2025
mtoffl01 pushed a commit that referenced this pull request Mar 24, 2025
@mcculls @mtoffl01
Minor test changes to avoid deprecated API (#8574)
6473621
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: refactoring

Projects

None yet

Milestone

1.48.0

Development

Successfully merging this pull request may close these issues.

2 participants

@mcculls @amarziali