Skip to content

Enable system-tests scenarios for API Security#8442

Merged
smola merged 1 commit intomasterfrom
smola/api-security-system-tests
Feb 25, 2025
Merged

Enable system-tests scenarios for API Security#8442
smola merged 1 commit intomasterfrom
smola/api-security-system-tests

Conversation

@smola
Copy link
Copy Markdown
Member

@smola smola commented Feb 25, 2025 •
edited by atlassian Bot
Loading

What Does This Do

Enable the following system-tests scenarios:

APPSEC_API_SECURITY
APPSEC_API_SECURITY_RC
APPSEC_API_SECURITY_WITH_SAMPLING

Not adding APPSEC_API_SECURITY_NO_RESPONSE_BODY which is currently irrelevant for Java, since we do not implement this functionality at all.

Motivation

Ensure we do not break anything as we start modifying API Security features now.

Additional Notes

Contributor Checklist

Jira ticket: APPSEC-55337

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: asm waf Application Security Management (WAF) labels Feb 25, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Feb 25, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/api-security-system-tests
git_commit_date 1740435079 1740473781
git_commit_sha c643643 3ab7f70
release_version 1.47.0-SNAPSHOT~c643643e68 1.47.0-SNAPSHOT~3ab7f7095a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740476284 1740476284
ci_job_id 821389373 821389373
ci_pipeline_id 56846989 56846989
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-chbxpuyt-project-304-concurrent-0-n2kxdlgd 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-chbxpuyt-project-304-concurrent-0-n2kxdlgd 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.042 s) : 0, 1041613
Total [baseline] (10.39 s) : 0, 10389605
Agent [candidate] (1.046 s) : 0, 1046001
Total [candidate] (10.549 s) : 0, 10549218
section appsec
Agent [baseline] (1.181 s) : 0, 1180650
Total [baseline] (10.754 s) : 0, 10754427
Agent [candidate] (1.188 s) : 0, 1188070
Total [candidate] (10.79 s) : 0, 10790232
section iast
Agent [baseline] (1.171 s) : 0, 1171014
Total [baseline] (10.99 s) : 0, 10990321
Agent [candidate] (1.17 s) : 0, 1169644
Total [candidate] (10.984 s) : 0, 10983592
section profiling
Agent [baseline] (1.263 s) : 0, 1262584
Total [baseline] (10.828 s) : 0, 10827882
Agent [candidate] (1.262 s) : 0, 1261845
Total [candidate] (10.85 s) : 0, 10850042
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent appsec 1.181 s 139.037 ms (13.3%)
Agent iast 1.171 s 129.401 ms (12.4%)
Agent profiling 1.263 s 220.971 ms (21.2%)
Total tracing 10.39 s -
Total appsec 10.754 s 364.822 ms (3.5%)
Total iast 10.99 s 600.716 ms (5.8%)
Total profiling 10.828 s 438.277 ms (4.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.188 s 142.069 ms (13.6%)
Agent iast 1.17 s 123.642 ms (11.8%)
Agent profiling 1.262 s 215.844 ms (20.6%)
Total tracing 10.549 s -
Total appsec 10.79 s 241.014 ms (2.3%)
Total iast 10.984 s 434.374 ms (4.1%)
Total profiling 10.85 s 300.824 ms (2.9%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.127 ms) : 0, 718127
BytebuddyAgent [candidate] (722.466 ms) : 0, 722466
GlobalTracer [baseline] (239.665 ms) : 0, 239665
GlobalTracer [candidate] (241.05 ms) : 0, 241050
AppSec [baseline] (55.913 ms) : 0, 55913
AppSec [candidate] (55.902 ms) : 0, 55902
Remote Config [baseline] (696.942 µs) : 0, 697
Remote Config [candidate] (691.318 µs) : 0, 691
Telemetry [baseline] (12.235 ms) : 0, 12235
Telemetry [candidate] (10.844 ms) : 0, 10844
section appsec
BytebuddyAgent [baseline] (733.853 ms) : 0, 733853
BytebuddyAgent [candidate] (738.622 ms) : 0, 738622
GlobalTracer [baseline] (235.771 ms) : 0, 235771
GlobalTracer [candidate] (237.5 ms) : 0, 237500
AppSec [baseline] (176.399 ms) : 0, 176399
AppSec [candidate] (177.198 ms) : 0, 177198
Remote Config [baseline] (649.954 µs) : 0, 650
Remote Config [candidate] (670.334 µs) : 0, 670
Telemetry [baseline] (8.267 ms) : 0, 8267
Telemetry [candidate] (8.324 ms) : 0, 8324
IAST [baseline] (21.608 ms) : 0, 21608
IAST [candidate] (21.588 ms) : 0, 21588
section iast
BytebuddyAgent [baseline] (836.428 ms) : 0, 836428
BytebuddyAgent [candidate] (835.22 ms) : 0, 835220
GlobalTracer [baseline] (230.197 ms) : 0, 230197
GlobalTracer [candidate] (230.18 ms) : 0, 230180
AppSec [baseline] (57.168 ms) : 0, 57168
AppSec [candidate] (57.261 ms) : 0, 57261
Remote Config [baseline] (623.841 µs) : 0, 624
Remote Config [candidate] (610.155 µs) : 0, 610
Telemetry [baseline] (8.706 ms) : 0, 8706
Telemetry [candidate] (8.711 ms) : 0, 8711
IAST [baseline] (22.927 ms) : 0, 22927
IAST [candidate] (22.731 ms) : 0, 22731
section profiling
BytebuddyAgent [baseline] (709.673 ms) : 0, 709673
BytebuddyAgent [candidate] (709.475 ms) : 0, 709475
GlobalTracer [baseline] (350.87 ms) : 0, 350870
GlobalTracer [candidate] (351.457 ms) : 0, 351457
AppSec [baseline] (55.517 ms) : 0, 55517
AppSec [candidate] (54.557 ms) : 0, 54557
Remote Config [baseline] (684.171 µs) : 0, 684
Remote Config [candidate] (675.077 µs) : 0, 675
Telemetry [baseline] (8.921 ms) : 0, 8921
Telemetry [candidate] (9.037 ms) : 0, 9037
ProfilingAgent [baseline] (96.558 ms) : 0, 96558
ProfilingAgent [candidate] (96.412 ms) : 0, 96412
Profiling [baseline] (96.582 ms) : 0, 96582
Profiling [candidate] (96.437 ms) : 0, 96437
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.038 s) : 0, 1037823
Total [baseline] (8.666 s) : 0, 8666066
Agent [candidate] (1.041 s) : 0, 1040550
Total [candidate] (8.681 s) : 0, 8681367
section iast
Agent [baseline] (1.171 s) : 0, 1171227
Total [baseline] (9.282 s) : 0, 9281743
Agent [candidate] (1.179 s) : 0, 1179375
Total [candidate] (9.258 s) : 0, 9258244
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1171231
Total [baseline] (9.213 s) : 0, 9213232
Agent [candidate] (1.173 s) : 0, 1172520
Total [candidate] (9.268 s) : 0, 9268267
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1166207
Total [baseline] (9.257 s) : 0, 9257320
Agent [candidate] (1.168 s) : 0, 1168401
Total [candidate] (9.255 s) : 0, 9254937
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.038 s -
Agent iast 1.171 s 133.405 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 133.408 ms (12.9%)
Agent iast_TELEMETRY_OFF 1.166 s 128.385 ms (12.4%)
Total tracing 8.666 s -
Total iast 9.282 s 615.676 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.213 s 547.166 ms (6.3%)
Total iast_TELEMETRY_OFF 9.257 s 591.254 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.179 s 138.825 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 131.97 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.168 s 127.851 ms (12.3%)
Total tracing 8.681 s -
Total iast 9.258 s 576.877 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.268 s 586.9 ms (6.8%)
Total iast_TELEMETRY_OFF 9.255 s 573.57 ms (6.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.015 ms) : 0, 717015
BytebuddyAgent [candidate] (716.738 ms) : 0, 716738
GlobalTracer [baseline] (239.032 ms) : 0, 239032
GlobalTracer [candidate] (239.406 ms) : 0, 239406
AppSec [baseline] (55.44 ms) : 0, 55440
AppSec [candidate] (55.344 ms) : 0, 55344
Remote Config [baseline] (697.675 µs) : 0, 698
Remote Config [candidate] (684.362 µs) : 0, 684
Telemetry [baseline] (10.693 ms) : 0, 10693
Telemetry [candidate] (13.516 ms) : 0, 13516
section iast
BytebuddyAgent [baseline] (836.832 ms) : 0, 836832
BytebuddyAgent [candidate] (842.863 ms) : 0, 842863
GlobalTracer [baseline] (229.985 ms) : 0, 229985
GlobalTracer [candidate] (231.271 ms) : 0, 231271
AppSec [baseline] (57.246 ms) : 0, 57246
AppSec [candidate] (57.561 ms) : 0, 57561
Remote Config [baseline] (609.645 µs) : 0, 610
Remote Config [candidate] (615.209 µs) : 0, 615
Telemetry [baseline] (8.795 ms) : 0, 8795
Telemetry [candidate] (8.826 ms) : 0, 8826
IAST [baseline] (22.863 ms) : 0, 22863
IAST [candidate] (23.12 ms) : 0, 23120
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.938 ms) : 0, 836938
BytebuddyAgent [candidate] (837.319 ms) : 0, 837319
GlobalTracer [baseline] (230.214 ms) : 0, 230214
GlobalTracer [candidate] (230.39 ms) : 0, 230390
AppSec [baseline] (56.806 ms) : 0, 56806
AppSec [candidate] (57.26 ms) : 0, 57260
Remote Config [baseline] (618.609 µs) : 0, 619
Remote Config [candidate] (623.563 µs) : 0, 624
Telemetry [baseline] (8.73 ms) : 0, 8730
Telemetry [candidate] (8.796 ms) : 0, 8796
IAST [baseline] (22.923 ms) : 0, 22923
IAST [candidate] (23.17 ms) : 0, 23170
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.529 ms) : 0, 833529
BytebuddyAgent [candidate] (834.709 ms) : 0, 834709
GlobalTracer [baseline] (229.584 ms) : 0, 229584
GlobalTracer [candidate] (230.219 ms) : 0, 230219
AppSec [baseline] (52.162 ms) : 0, 52162
AppSec [candidate] (51.294 ms) : 0, 51294
Remote Config [baseline] (610.738 µs) : 0, 611
Remote Config [candidate] (611.736 µs) : 0, 612
Telemetry [baseline] (8.518 ms) : 0, 8518
Telemetry [candidate] (8.619 ms) : 0, 8619
IAST [baseline] (26.849 ms) : 0, 26849
IAST [candidate] (27.973 ms) : 0, 27973
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-25T09:08:14 2025-02-25T09:16:00
git_branch master smola/api-security-system-tests
git_commit_date 1740435079 1740473781
git_commit_sha c643643 3ab7f70
release_version 1.47.0-SNAPSHOT~c643643e68 1.47.0-SNAPSHOT~3ab7f7095a
start_time 2025-02-25T09:08:00 2025-02-25T09:15:47
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740475359 1740475359
ci_job_id 821389374 821389374
ci_pipeline_id 56846989 56846989
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-pfcwcnbt-project-304-concurrent-0-3462y35k 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-pfcwcnbt-project-304-concurrent-0-3462y35k 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.364 ms) : 1345, 1384
.   : milestone, 1364,
appsec (1.775 ms) : 1751, 1798
.   : milestone, 1775,
appsec_no_iast (1.765 ms) : 1741, 1789
.   : milestone, 1765,
code_origins (1.706 ms) : 1673, 1738
.   : milestone, 1706,
iast (1.509 ms) : 1486, 1533
.   : milestone, 1509,
profiling (1.521 ms) : 1498, 1544
.   : milestone, 1521,
tracing (1.517 ms) : 1492, 1542
.   : milestone, 1517,
section candidate
no_agent (1.365 ms) : 1345, 1385
.   : milestone, 1365,
appsec (1.759 ms) : 1735, 1783
.   : milestone, 1759,
appsec_no_iast (1.784 ms) : 1760, 1808
.   : milestone, 1784,
code_origins (1.684 ms) : 1651, 1718
.   : milestone, 1684,
iast (1.508 ms) : 1484, 1532
.   : milestone, 1508,
profiling (1.508 ms) : 1485, 1531
.   : milestone, 1508,
tracing (1.491 ms) : 1467, 1515
.   : milestone, 1491,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.364 ms [1.345 ms, 1.384 ms] -
appsec 1.775 ms [1.751 ms, 1.798 ms] 410.22 µs (30.1%)
appsec_no_iast 1.765 ms [1.741 ms, 1.789 ms] 400.777 µs (29.4%)
code_origins 1.706 ms [1.673 ms, 1.738 ms] 341.296 µs (25.0%)
iast 1.509 ms [1.486 ms, 1.533 ms] 144.891 µs (10.6%)
profiling 1.521 ms [1.498 ms, 1.544 ms] 156.672 µs (11.5%)
tracing 1.517 ms [1.492 ms, 1.542 ms] 152.791 µs (11.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.365 ms [1.345 ms, 1.385 ms] -
appsec 1.759 ms [1.735 ms, 1.783 ms] 394.023 µs (28.9%)
appsec_no_iast 1.784 ms [1.76 ms, 1.808 ms] 418.912 µs (30.7%)
code_origins 1.684 ms [1.651 ms, 1.718 ms] 319.473 µs (23.4%)
iast 1.508 ms [1.484 ms, 1.532 ms] 142.844 µs (10.5%)
profiling 1.508 ms [1.485 ms, 1.531 ms] 142.796 µs (10.5%)
tracing 1.491 ms [1.467 ms, 1.515 ms] 125.913 µs (9.2%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68
    dateFormat X
    axisFormat %s
section baseline
no_agent (377.59 µs) : 358, 397
.   : milestone, 378,
iast (512.016 µs) : 490, 534
.   : milestone, 512,
iast_FULL (732.501 µs) : 711, 754
.   : milestone, 733,
iast_GLOBAL (557.377 µs) : 535, 580
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (509.125 µs) : 487, 531
.   : milestone, 509,
iast_INACTIVE (461.388 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (500.564 µs) : 477, 524
.   : milestone, 501,
tracing (461.492 µs) : 439, 484
.   : milestone, 461,
section candidate
no_agent (381.369 µs) : 360, 402
.   : milestone, 381,
iast (508.95 µs) : 487, 531
.   : milestone, 509,
iast_FULL (727.159 µs) : 705, 749
.   : milestone, 727,
iast_GLOBAL (554.461 µs) : 533, 576
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (516.502 µs) : 495, 538
.   : milestone, 517,
iast_INACTIVE (457.214 µs) : 436, 478
.   : milestone, 457,
iast_TELEMETRY_OFF (496.565 µs) : 474, 520
.   : milestone, 497,
tracing (460.852 µs) : 439, 482
.   : milestone, 461,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.59 µs [357.78 µs, 397.401 µs] -
iast 512.016 µs [490.347 µs, 533.684 µs] 134.425 µs (35.6%)
iast_FULL 732.501 µs [710.549 µs, 754.453 µs] 354.91 µs (94.0%)
iast_GLOBAL 557.377 µs [535.077 µs, 579.678 µs] 179.787 µs (47.6%)
iast_HARDCODED_SECRET_DISABLED 509.125 µs [487.387 µs, 530.863 µs] 131.535 µs (34.8%)
iast_INACTIVE 461.388 µs [440.139 µs, 482.637 µs] 83.797 µs (22.2%)
iast_TELEMETRY_OFF 500.564 µs [477.322 µs, 523.805 µs] 122.973 µs (32.6%)
tracing 461.492 µs [439.424 µs, 483.559 µs] 83.901 µs (22.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.369 µs [360.402 µs, 402.335 µs] -
iast 508.95 µs [487.176 µs, 530.724 µs] 127.582 µs (33.5%)
iast_FULL 727.159 µs [705.296 µs, 749.023 µs] 345.791 µs (90.7%)
iast_GLOBAL 554.461 µs [532.837 µs, 576.085 µs] 173.092 µs (45.4%)
iast_HARDCODED_SECRET_DISABLED 516.502 µs [494.576 µs, 538.427 µs] 135.133 µs (35.4%)
iast_INACTIVE 457.214 µs [436.136 µs, 478.293 µs] 75.846 µs (19.9%)
iast_TELEMETRY_OFF 496.565 µs [473.6 µs, 519.529 µs] 115.196 µs (30.2%)
tracing 460.852 µs [439.345 µs, 482.358 µs] 79.483 µs (20.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/api-security-system-tests
git_commit_date 1740435079 1740473781
git_commit_sha c643643 3ab7f70
release_version 1.47.0-SNAPSHOT~c643643e68 1.47.0-SNAPSHOT~3ab7f7095a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740475848 1740475848
ci_job_id 821389375 821389375
ci_pipeline_id 56846989 56846989
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-guxxpazr-project-304-concurrent-0-obblc9ki 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-guxxpazr-project-304-concurrent-0-obblc9ki 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.72 s) : 14720000, 14720000
.   : milestone, 14720000,
appsec (15.152 s) : 15152000, 15152000
.   : milestone, 15152000,
iast (18.311 s) : 18311000, 18311000
.   : milestone, 18311000,
iast_GLOBAL (17.899 s) : 17899000, 17899000
.   : milestone, 17899000,
profiling (15.671 s) : 15671000, 15671000
.   : milestone, 15671000,
tracing (15.079 s) : 15079000, 15079000
.   : milestone, 15079000,
section candidate
no_agent (15.512 s) : 15512000, 15512000
.   : milestone, 15512000,
appsec (14.826 s) : 14826000, 14826000
.   : milestone, 14826000,
iast (18.973 s) : 18973000, 18973000
.   : milestone, 18973000,
iast_GLOBAL (17.62 s) : 17620000, 17620000
.   : milestone, 17620000,
profiling (15.479 s) : 15479000, 15479000
.   : milestone, 15479000,
tracing (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.72 s [14.72 s, 14.72 s] -
appsec 15.152 s [15.152 s, 15.152 s] 432.0 ms (2.9%)
iast 18.311 s [18.311 s, 18.311 s] 3.591 s (24.4%)
iast_GLOBAL 17.899 s [17.899 s, 17.899 s] 3.179 s (21.6%)
profiling 15.671 s [15.671 s, 15.671 s] 951.0 ms (6.5%)
tracing 15.079 s [15.079 s, 15.079 s] 359.0 ms (2.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.512 s [15.512 s, 15.512 s] -
appsec 14.826 s [14.826 s, 14.826 s] -686.0 ms (-4.4%)
iast 18.973 s [18.973 s, 18.973 s] 3.461 s (22.3%)
iast_GLOBAL 17.62 s [17.62 s, 17.62 s] 2.108 s (13.6%)
profiling 15.479 s [15.479 s, 15.479 s] -33.0 ms (-0.2%)
tracing 14.843 s [14.843 s, 14.843 s] -669.0 ms (-4.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~3ab7f7095a, baseline=1.47.0-SNAPSHOT~c643643e68
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (2.347 ms) : 2304, 2390
.   : milestone, 2347,
iast (2.125 ms) : 2070, 2180
.   : milestone, 2125,
iast_GLOBAL (2.159 ms) : 2104, 2215
.   : milestone, 2159,
profiling (1.973 ms) : 1930, 2017
.   : milestone, 1973,
tracing (1.954 ms) : 1912, 1997
.   : milestone, 1954,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.377 ms) : 2334, 2420
.   : milestone, 2377,
iast (2.131 ms) : 2076, 2186
.   : milestone, 2131,
iast_GLOBAL (2.156 ms) : 2101, 2211
.   : milestone, 2156,
profiling (1.983 ms) : 1938, 2027
.   : milestone, 1983,
tracing (1.95 ms) : 1908, 1992
.   : milestone, 1950,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 2.347 ms [2.304 ms, 2.39 ms] 869.149 µs (58.8%)
iast 2.125 ms [2.07 ms, 2.18 ms] 646.641 µs (43.7%)
iast_GLOBAL 2.159 ms [2.104 ms, 2.215 ms] 680.996 µs (46.1%)
profiling 1.973 ms [1.93 ms, 2.017 ms] 494.93 µs (33.5%)
tracing 1.954 ms [1.912 ms, 1.997 ms] 476.127 µs (32.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.377 ms [2.334 ms, 2.42 ms] 901.355 µs (61.1%)
iast 2.131 ms [2.076 ms, 2.186 ms] 655.685 µs (44.4%)
iast_GLOBAL 2.156 ms [2.101 ms, 2.211 ms] 680.285 µs (46.1%)
profiling 1.983 ms [1.938 ms, 2.027 ms] 507.183 µs (34.4%)
tracing 1.95 ms [1.908 ms, 1.992 ms] 474.562 µs (32.2%)

@smola smola marked this pull request as ready for review February 25, 2025 12:23
@smola smola requested a review from a team as a code owner February 25, 2025 12:23
@smola smola merged commit 5a2c959 into master Feb 25, 2025
@smola smola deleted the smola/api-security-system-tests branch February 25, 2025 18:22
@github-actions github-actions Bot added this to the 1.47.0 milestone Feb 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez manuel-alvarez-alvarez approved these changes

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

@sezen-datadog sezen-datadog Awaiting requested review from sezen-datadog sezen-datadog was automatically assigned from DataDog/asm-java

Assignees

No one assigned

Labels

comp: asm waf Application Security Management (WAF) comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.47.0

Development

Successfully merging this pull request may close these issues.

3 participants

@smola @PerfectSlayer @manuel-alvarez-alvarez