Skip to content

Update system-tests to 7e14da64c8b78bc26c8037c27cf2f68c5d880e4e#7481

Closed
zacharycmontoya wants to merge 1 commit intomasterfrom
zach.montoya/update-system-tests
Closed

Update system-tests to 7e14da64c8b78bc26c8037c27cf2f68c5d880e4e#7481
zacharycmontoya wants to merge 1 commit intomasterfrom
zach.montoya/update-system-tests

Conversation

@zacharycmontoya
Copy link
Copy Markdown

@zacharycmontoya zacharycmontoya commented Aug 20, 2024

What Does This Do

Motivation

Additional Notes

Enables new parametric tests for #7355

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@zacharycmontoya zacharycmontoya requested a review from a team as a code owner August 20, 2024 21:23
@zacharycmontoya zacharycmontoya mentioned this pull request Aug 20, 2024
Merged
5 tasks
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 20, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zach.montoya/update-system-tests
git_commit_date 1724168948 1724188885
git_commit_sha 63ccd4c 02a97e5
release_version 1.39.0-SNAPSHOT~63ccd4c8fc 1.39.0-SNAPSHOT~02a97e5ab9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724191306 1724191306
ci_job_id 611359922 611359922
ci_pipeline_id 42354745 42354745
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 16 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1047614
Total [baseline] (8.494 s) : 0, 8494211
Agent [candidate] (1.046 s) : 0, 1045775
Total [candidate] (8.501 s) : 0, 8501269
section iast
Agent [baseline] (1.185 s) : 0, 1184675
Total [baseline] (8.994 s) : 0, 8994132
Agent [candidate] (1.185 s) : 0, 1185277
Total [candidate] (9.003 s) : 0, 9002800
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.177 s) : 0, 1177462
Total [baseline] (8.974 s) : 0, 8973872
Agent [candidate] (1.174 s) : 0, 1174185
Total [candidate] (8.976 s) : 0, 8975573
section iast_TELEMETRY_OFF
Agent [baseline] (1.173 s) : 0, 1172712
Total [baseline] (8.965 s) : 0, 8965402
Agent [candidate] (1.172 s) : 0, 1172218
Total [candidate] (8.99 s) : 0, 8990301
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent iast 1.185 s 137.061 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.177 s 129.848 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.173 s 125.098 ms (11.9%)
Total tracing 8.494 s -
Total iast 8.994 s 499.921 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 8.974 s 479.661 ms (5.6%)
Total iast_TELEMETRY_OFF 8.965 s 471.191 ms (5.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent iast 1.185 s 139.502 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 128.41 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.172 s 126.443 ms (12.1%)
Total tracing 8.501 s -
Total iast 9.003 s 501.531 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 8.976 s 474.304 ms (5.6%)
Total iast_TELEMETRY_OFF 8.99 s 489.032 ms (5.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (668.201 ms) : 0, 668201
BytebuddyAgent [candidate] (667.196 ms) : 0, 667196
GlobalTracer [baseline] (306.505 ms) : 0, 306505
GlobalTracer [candidate] (305.969 ms) : 0, 305969
AppSec [baseline] (51.17 ms) : 0, 51170
AppSec [candidate] (50.954 ms) : 0, 50954
Remote Config [baseline] (689.288 µs) : 0, 689
Remote Config [candidate] (694.811 µs) : 0, 695
Telemetry [baseline] (7.572 ms) : 0, 7572
Telemetry [candidate] (7.482 ms) : 0, 7482
section iast
BytebuddyAgent [baseline] (788.354 ms) : 0, 788354
BytebuddyAgent [candidate] (788.111 ms) : 0, 788111
GlobalTracer [baseline] (298.501 ms) : 0, 298501
GlobalTracer [candidate] (298.567 ms) : 0, 298567
AppSec [baseline] (52.629 ms) : 0, 52629
AppSec [candidate] (52.81 ms) : 0, 52810
IAST [baseline] (21.591 ms) : 0, 21591
IAST [candidate] (22.715 ms) : 0, 22715
Remote Config [baseline] (576.539 µs) : 0, 577
Remote Config [candidate] (592.26 µs) : 0, 592
Telemetry [baseline] (9.48 ms) : 0, 9480
Telemetry [candidate] (8.921 ms) : 0, 8921
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (782.62 ms) : 0, 782620
BytebuddyAgent [candidate] (780.981 ms) : 0, 780981
GlobalTracer [baseline] (296.419 ms) : 0, 296419
GlobalTracer [candidate] (296.319 ms) : 0, 296319
AppSec [baseline] (50.327 ms) : 0, 50327
AppSec [candidate] (49.777 ms) : 0, 49777
IAST [baseline] (24.427 ms) : 0, 24427
IAST [candidate] (23.424 ms) : 0, 23424
Remote Config [baseline] (581.831 µs) : 0, 582
Remote Config [candidate] (589.7 µs) : 0, 590
Telemetry [baseline] (9.549 ms) : 0, 9549
Telemetry [candidate] (9.596 ms) : 0, 9596
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (780.18 ms) : 0, 780180
BytebuddyAgent [candidate] (779.383 ms) : 0, 779383
GlobalTracer [baseline] (296.766 ms) : 0, 296766
GlobalTracer [candidate] (296.842 ms) : 0, 296842
AppSec [baseline] (51.647 ms) : 0, 51647
AppSec [candidate] (52.5 ms) : 0, 52500
IAST [baseline] (22.084 ms) : 0, 22084
IAST [candidate] (22.244 ms) : 0, 22244
Remote Config [baseline] (626.975 µs) : 0, 627
Remote Config [candidate] (620.659 µs) : 0, 621
Telemetry [baseline] (7.885 ms) : 0, 7885
Telemetry [candidate] (7.108 ms) : 0, 7108
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045910
Total [baseline] (10.391 s) : 0, 10391029
Agent [candidate] (1.051 s) : 0, 1050835
Total [candidate] (10.445 s) : 0, 10445016
section appsec
Agent [baseline] (1.173 s) : 0, 1173088
Total [baseline] (10.556 s) : 0, 10555708
Agent [candidate] (1.182 s) : 0, 1182225
Total [candidate] (10.495 s) : 0, 10494639
section iast
Agent [baseline] (1.185 s) : 0, 1184656
Total [baseline] (10.861 s) : 0, 10860587
Agent [candidate] (1.179 s) : 0, 1178792
Total [candidate] (10.913 s) : 0, 10913452
section profiling
Agent [baseline] (1.245 s) : 0, 1245119
Total [baseline] (10.558 s) : 0, 10557898
Agent [candidate] (1.248 s) : 0, 1247810
Total [candidate] (10.637 s) : 0, 10637383
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.173 s 127.177 ms (12.2%)
Agent iast 1.185 s 138.746 ms (13.3%)
Agent profiling 1.245 s 199.209 ms (19.0%)
Total tracing 10.391 s -
Total appsec 10.556 s 164.679 ms (1.6%)
Total iast 10.861 s 469.558 ms (4.5%)
Total profiling 10.558 s 166.869 ms (1.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.182 s 131.39 ms (12.5%)
Agent iast 1.179 s 127.956 ms (12.2%)
Agent profiling 1.248 s 196.975 ms (18.7%)
Total tracing 10.445 s -
Total appsec 10.495 s 49.623 ms (0.5%)
Total iast 10.913 s 468.436 ms (4.5%)
Total profiling 10.637 s 192.366 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (667.234 ms) : 0, 667234
BytebuddyAgent [candidate] (669.349 ms) : 0, 669349
GlobalTracer [baseline] (306.061 ms) : 0, 306061
GlobalTracer [candidate] (308.545 ms) : 0, 308545
AppSec [baseline] (51.029 ms) : 0, 51029
AppSec [candidate] (51.275 ms) : 0, 51275
Remote Config [baseline] (682.612 µs) : 0, 683
Remote Config [candidate] (690.126 µs) : 0, 690
Telemetry [baseline] (7.516 ms) : 0, 7516
Telemetry [candidate] (7.537 ms) : 0, 7537
section appsec
BytebuddyAgent [baseline] (680.479 ms) : 0, 680479
BytebuddyAgent [candidate] (686.541 ms) : 0, 686541
GlobalTracer [baseline] (301.013 ms) : 0, 301013
GlobalTracer [candidate] (303.6 ms) : 0, 303600
AppSec [baseline] (157.587 ms) : 0, 157587
AppSec [candidate] (158.16 ms) : 0, 158160
Remote Config [baseline] (610.068 µs) : 0, 610
Remote Config [candidate] (610.41 µs) : 0, 610
Telemetry [baseline] (9.049 ms) : 0, 9049
Telemetry [candidate] (10.049 ms) : 0, 10049
IAST [baseline] (21.678 ms) : 0, 21678
IAST [candidate] (19.253 ms) : 0, 19253
section iast
BytebuddyAgent [baseline] (788.939 ms) : 0, 788939
BytebuddyAgent [candidate] (784.109 ms) : 0, 784109
GlobalTracer [baseline] (298.512 ms) : 0, 298512
GlobalTracer [candidate] (296.741 ms) : 0, 296741
AppSec [baseline] (52.452 ms) : 0, 52452
AppSec [candidate] (50.726 ms) : 0, 50726
Remote Config [baseline] (582.636 µs) : 0, 583
Remote Config [candidate] (603.49 µs) : 0, 603
Telemetry [baseline] (8.773 ms) : 0, 8773
Telemetry [candidate] (8.763 ms) : 0, 8763
IAST [baseline] (21.83 ms) : 0, 21830
IAST [candidate] (24.307 ms) : 0, 24307
section profiling
ProfilingAgent [baseline] (94.446 ms) : 0, 94446
ProfilingAgent [candidate] (95.316 ms) : 0, 95316
BytebuddyAgent [baseline] (663.764 ms) : 0, 663764
BytebuddyAgent [candidate] (663.349 ms) : 0, 663349
GlobalTracer [baseline] (389.34 ms) : 0, 389340
GlobalTracer [candidate] (391.333 ms) : 0, 391333
AppSec [baseline] (52.211 ms) : 0, 52211
AppSec [candidate] (52.564 ms) : 0, 52564
Remote Config [baseline] (698.148 µs) : 0, 698
Remote Config [candidate] (688.464 µs) : 0, 688
Telemetry [baseline] (7.417 ms) : 0, 7417
Telemetry [candidate] (7.448 ms) : 0, 7448
Profiling [baseline] (94.47 ms) : 0, 94470
Profiling [candidate] (95.34 ms) : 0, 95340
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-20T21:32:22 2024-08-20T21:39:10
git_branch master zach.montoya/update-system-tests
git_commit_date 1724168948 1724188885
git_commit_sha 63ccd4c 02a97e5
release_version 1.39.0-SNAPSHOT~63ccd4c8fc 1.39.0-SNAPSHOT~02a97e5ab9
start_time 2024-08-20T21:32:09 2024-08-20T21:38:57
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724190293 1724190293
ci_job_id 611359923 611359923
ci_pipeline_id 42354745 42354745
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.334 ms) : 1315, 1354
.   : milestone, 1334,
appsec (1.727 ms) : 1703, 1751
.   : milestone, 1727,
appsec_no_iast (1.704 ms) : 1680, 1729
.   : milestone, 1704,
iast (1.476 ms) : 1454, 1498
.   : milestone, 1476,
profiling (1.511 ms) : 1485, 1537
.   : milestone, 1511,
tracing (1.45 ms) : 1425, 1474
.   : milestone, 1450,
section candidate
no_agent (1.341 ms) : 1321, 1361
.   : milestone, 1341,
appsec (1.735 ms) : 1711, 1758
.   : milestone, 1735,
appsec_no_iast (1.709 ms) : 1685, 1732
.   : milestone, 1709,
iast (1.471 ms) : 1448, 1493
.   : milestone, 1471,
profiling (1.481 ms) : 1456, 1505
.   : milestone, 1481,
tracing (1.453 ms) : 1429, 1477
.   : milestone, 1453,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.334 ms [1.315 ms, 1.354 ms] -
appsec 1.727 ms [1.703 ms, 1.751 ms] 392.998 µs (29.5%)
appsec_no_iast 1.704 ms [1.68 ms, 1.729 ms] 370.261 µs (27.8%)
iast 1.476 ms [1.454 ms, 1.498 ms] 141.99 µs (10.6%)
profiling 1.511 ms [1.485 ms, 1.537 ms] 176.492 µs (13.2%)
tracing 1.45 ms [1.425 ms, 1.474 ms] 115.549 µs (8.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.341 ms [1.321 ms, 1.361 ms] -
appsec 1.735 ms [1.711 ms, 1.758 ms] 393.597 µs (29.4%)
appsec_no_iast 1.709 ms [1.685 ms, 1.732 ms] 367.814 µs (27.4%)
iast 1.471 ms [1.448 ms, 1.493 ms] 129.835 µs (9.7%)
profiling 1.481 ms [1.456 ms, 1.505 ms] 139.728 µs (10.4%)
tracing 1.453 ms [1.429 ms, 1.477 ms] 112.081 µs (8.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.545 µs) : 355, 394
.   : milestone, 375,
iast (473.479 µs) : 452, 495
.   : milestone, 473,
iast_FULL (547.466 µs) : 525, 570
.   : milestone, 547,
iast_GLOBAL (508.646 µs) : 486, 532
.   : milestone, 509,
iast_HARDCODED_SECRET_DISABLED (494.46 µs) : 471, 518
.   : milestone, 494,
iast_INACTIVE (450.381 µs) : 428, 472
.   : milestone, 450,
iast_TELEMETRY_OFF (469.004 µs) : 447, 491
.   : milestone, 469,
tracing (441.123 µs) : 421, 461
.   : milestone, 441,
section candidate
no_agent (363.61 µs) : 344, 383
.   : milestone, 364,
iast (476.433 µs) : 455, 498
.   : milestone, 476,
iast_FULL (548.059 µs) : 526, 570
.   : milestone, 548,
iast_GLOBAL (498.158 µs) : 476, 520
.   : milestone, 498,
iast_HARDCODED_SECRET_DISABLED (476.404 µs) : 455, 498
.   : milestone, 476,
iast_INACTIVE (452.694 µs) : 430, 475
.   : milestone, 453,
iast_TELEMETRY_OFF (472.476 µs) : 450, 495
.   : milestone, 472,
tracing (436.985 µs) : 417, 457
.   : milestone, 437,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.545 µs [355.011 µs, 394.079 µs] -
iast 473.479 µs [452.233 µs, 494.726 µs] 98.934 µs (26.4%)
iast_FULL 547.466 µs [525.075 µs, 569.856 µs] 172.92 µs (46.2%)
iast_GLOBAL 508.646 µs [485.661 µs, 531.63 µs] 134.1 µs (35.8%)
iast_HARDCODED_SECRET_DISABLED 494.46 µs [471.324 µs, 517.595 µs] 119.914 µs (32.0%)
iast_INACTIVE 450.381 µs [428.314 µs, 472.448 µs] 75.835 µs (20.2%)
iast_TELEMETRY_OFF 469.004 µs [447.193 µs, 490.816 µs] 94.459 µs (25.2%)
tracing 441.123 µs [420.876 µs, 461.37 µs] 66.578 µs (17.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 363.61 µs [343.801 µs, 383.418 µs] -
iast 476.433 µs [455.154 µs, 497.713 µs] 112.824 µs (31.0%)
iast_FULL 548.059 µs [525.692 µs, 570.426 µs] 184.449 µs (50.7%)
iast_GLOBAL 498.158 µs [476.245 µs, 520.07 µs] 134.548 µs (37.0%)
iast_HARDCODED_SECRET_DISABLED 476.404 µs [455.014 µs, 497.794 µs] 112.795 µs (31.0%)
iast_INACTIVE 452.694 µs [430.117 µs, 475.272 µs] 89.084 µs (24.5%)
iast_TELEMETRY_OFF 472.476 µs [450.373 µs, 494.579 µs] 108.866 µs (29.9%)
tracing 436.985 µs [416.668 µs, 457.302 µs] 73.375 µs (20.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master zach.montoya/update-system-tests
git_commit_date 1724168948 1724188885
git_commit_sha 63ccd4c 02a97e5
release_version 1.39.0-SNAPSHOT~63ccd4c8fc 1.39.0-SNAPSHOT~02a97e5ab9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1724190920 1724190920
ci_job_id 611359924 611359924
ci_pipeline_id 42354745 42354745
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.456 ms) : 1445, 1468
.   : milestone, 1456,
appsec (2.222 ms) : 2187, 2257
.   : milestone, 2222,
iast (1.97 ms) : 1928, 2012
.   : milestone, 1970,
iast_GLOBAL (2.019 ms) : 1976, 2063
.   : milestone, 2019,
profiling (1.867 ms) : 1833, 1901
.   : milestone, 1867,
tracing (1.848 ms) : 1815, 1881
.   : milestone, 1848,
section candidate
no_agent (1.47 ms) : 1458, 1481
.   : milestone, 1470,
appsec (2.227 ms) : 2192, 2262
.   : milestone, 2227,
iast (1.984 ms) : 1942, 2027
.   : milestone, 1984,
iast_GLOBAL (2.012 ms) : 1970, 2054
.   : milestone, 2012,
profiling (1.871 ms) : 1836, 1906
.   : milestone, 1871,
tracing (1.849 ms) : 1815, 1882
.   : milestone, 1849,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.456 ms [1.445 ms, 1.468 ms] -
appsec 2.222 ms [2.187 ms, 2.257 ms] 765.724 µs (52.6%)
iast 1.97 ms [1.928 ms, 2.012 ms] 513.246 µs (35.2%)
iast_GLOBAL 2.019 ms [1.976 ms, 2.063 ms] 563.024 µs (38.7%)
profiling 1.867 ms [1.833 ms, 1.901 ms] 410.468 µs (28.2%)
tracing 1.848 ms [1.815 ms, 1.881 ms] 391.623 µs (26.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.458 ms, 1.481 ms] -
appsec 2.227 ms [2.192 ms, 2.262 ms] 757.646 µs (51.6%)
iast 1.984 ms [1.942 ms, 2.027 ms] 514.732 µs (35.0%)
iast_GLOBAL 2.012 ms [1.97 ms, 2.054 ms] 542.332 µs (36.9%)
profiling 1.871 ms [1.836 ms, 1.906 ms] 401.457 µs (27.3%)
tracing 1.849 ms [1.815 ms, 1.882 ms] 378.993 µs (25.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~02a97e5ab9, baseline=1.39.0-SNAPSHOT~63ccd4c8fc
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.237 s) : 15237000, 15237000
.   : milestone, 15237000,
appsec (15.28 s) : 15280000, 15280000
.   : milestone, 15280000,
iast (18.732 s) : 18732000, 18732000
.   : milestone, 18732000,
iast_GLOBAL (17.861 s) : 17861000, 17861000
.   : milestone, 17861000,
profiling (15.047 s) : 15047000, 15047000
.   : milestone, 15047000,
tracing (15.135 s) : 15135000, 15135000
.   : milestone, 15135000,
section candidate
no_agent (14.97 s) : 14970000, 14970000
.   : milestone, 14970000,
appsec (15.041 s) : 15041000, 15041000
.   : milestone, 15041000,
iast (19.033 s) : 19033000, 19033000
.   : milestone, 19033000,
iast_GLOBAL (17.86 s) : 17860000, 17860000
.   : milestone, 17860000,
profiling (15.239 s) : 15239000, 15239000
.   : milestone, 15239000,
tracing (14.997 s) : 14997000, 14997000
.   : milestone, 14997000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.237 s [15.237 s, 15.237 s] -
appsec 15.28 s [15.28 s, 15.28 s] 43.0 ms (0.3%)
iast 18.732 s [18.732 s, 18.732 s] 3.495 s (22.9%)
iast_GLOBAL 17.861 s [17.861 s, 17.861 s] 2.624 s (17.2%)
profiling 15.047 s [15.047 s, 15.047 s] -190.0 ms (-1.2%)
tracing 15.135 s [15.135 s, 15.135 s] -102.0 ms (-0.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.97 s [14.97 s, 14.97 s] -
appsec 15.041 s [15.041 s, 15.041 s] 71.0 ms (0.5%)
iast 19.033 s [19.033 s, 19.033 s] 4.063 s (27.1%)
iast_GLOBAL 17.86 s [17.86 s, 17.86 s] 2.89 s (19.3%)
profiling 15.239 s [15.239 s, 15.239 s] 269.0 ms (1.8%)
tracing 14.997 s [14.997 s, 14.997 s] 27.0 ms (0.2%)

@PerfectSlayer
Copy link
Copy Markdown
Contributor

PerfectSlayer commented Aug 23, 2024

I am taking over here: #7492

@zacharycmontoya zacharycmontoya deleted the zach.montoya/update-system-tests branch August 26, 2024 13:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@zacharycmontoya @PerfectSlayer