Skip to content

Update system-tests to 2d531d6f809cfcdd5d6d375f92bda86202dea332#8198

Merged
PerfectSlayer merged 1 commit intomasterfrom
cbeauchesne/update-system-tests
Jan 14, 2025
Merged

Update system-tests to 2d531d6f809cfcdd5d6d375f92bda86202dea332#8198
PerfectSlayer merged 1 commit intomasterfrom
cbeauchesne/update-system-tests

Conversation

@cbeauchesne
Copy link
Copy Markdown
Contributor

@cbeauchesne cbeauchesne commented Jan 14, 2025

What Does This Do

Update system-tests to last version

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@cbeauchesne cbeauchesne requested a review from a team as a code owner January 14, 2025 14:57
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jan 14, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@cbeauchesne cbeauchesne added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jan 14, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jan 14, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master cbeauchesne/update-system-tests
git_commit_date 1736864662 1736866617
git_commit_sha 0df72c4 7d51a4b
release_version 1.46.0-SNAPSHOT~0df72c42da 1.46.0-SNAPSHOT~7d51a4b9fa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736869041 1736869041
ci_job_id 765535221 765535221
ci_pipeline_id 52942782 52942782
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1056167
Total [baseline] (8.598 s) : 0, 8598256
Agent [candidate] (1.057 s) : 0, 1057032
Total [candidate] (8.605 s) : 0, 8605462
section iast
Agent [baseline] (1.181 s) : 0, 1181455
Total [baseline] (9.168 s) : 0, 9168360
Agent [candidate] (1.191 s) : 0, 1191088
Total [candidate] (9.231 s) : 0, 9230675
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.181 s) : 0, 1180605
Total [baseline] (9.199 s) : 0, 9198672
Agent [candidate] (1.182 s) : 0, 1181802
Total [candidate] (9.166 s) : 0, 9165506
section iast_TELEMETRY_OFF
Agent [baseline] (1.176 s) : 0, 1176255
Total [baseline] (9.171 s) : 0, 9171017
Agent [candidate] (1.186 s) : 0, 1186036
Total [candidate] (9.19 s) : 0, 9190170
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.181 s 125.288 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.181 s 124.437 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.176 s 120.087 ms (11.4%)
Total tracing 8.598 s -
Total iast 9.168 s 570.104 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.199 s 600.416 ms (7.0%)
Total iast_TELEMETRY_OFF 9.171 s 572.76 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.191 s 134.056 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 124.77 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.186 s 129.003 ms (12.2%)
Total tracing 8.605 s -
Total iast 9.231 s 625.213 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.166 s 560.044 ms (6.5%)
Total iast_TELEMETRY_OFF 9.19 s 584.708 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (712.441 ms) : 0, 712441
BytebuddyAgent [candidate] (714.325 ms) : 0, 714325
GlobalTracer [baseline] (257.002 ms) : 0, 257002
GlobalTracer [candidate] (256.246 ms) : 0, 256246
AppSec [baseline] (56.109 ms) : 0, 56109
AppSec [candidate] (57.33 ms) : 0, 57330
Remote Config [baseline] (722.142 µs) : 0, 722
Remote Config [candidate] (718.742 µs) : 0, 719
Telemetry [baseline] (14.879 ms) : 0, 14879
Telemetry [candidate] (13.436 ms) : 0, 13436
section iast
BytebuddyAgent [baseline] (831.371 ms) : 0, 831371
BytebuddyAgent [candidate] (837.978 ms) : 0, 837978
GlobalTracer [baseline] (246.346 ms) : 0, 246346
GlobalTracer [candidate] (248.052 ms) : 0, 248052
AppSec [baseline] (57.84 ms) : 0, 57840
AppSec [candidate] (58.644 ms) : 0, 58644
IAST [baseline] (21.436 ms) : 0, 21436
IAST [candidate] (21.707 ms) : 0, 21707
Remote Config [baseline] (660.207 µs) : 0, 660
Remote Config [candidate] (663.904 µs) : 0, 664
Telemetry [baseline] (8.762 ms) : 0, 8762
Telemetry [candidate] (8.862 ms) : 0, 8862
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (829.751 ms) : 0, 829751
BytebuddyAgent [candidate] (830.693 ms) : 0, 830693
GlobalTracer [baseline] (246.593 ms) : 0, 246593
GlobalTracer [candidate] (247.186 ms) : 0, 247186
AppSec [baseline] (58.247 ms) : 0, 58247
AppSec [candidate] (58.156 ms) : 0, 58156
IAST [baseline] (21.479 ms) : 0, 21479
IAST [candidate] (21.331 ms) : 0, 21331
Remote Config [baseline] (680.341 µs) : 0, 680
Remote Config [candidate] (671.492 µs) : 0, 671
Telemetry [baseline] (8.909 ms) : 0, 8909
Telemetry [candidate] (8.772 ms) : 0, 8772
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (826.904 ms) : 0, 826904
BytebuddyAgent [candidate] (833.963 ms) : 0, 833963
GlobalTracer [baseline] (246.74 ms) : 0, 246740
GlobalTracer [candidate] (248.372 ms) : 0, 248372
AppSec [baseline] (57.551 ms) : 0, 57551
AppSec [candidate] (58.03 ms) : 0, 58030
IAST [baseline] (20.796 ms) : 0, 20796
IAST [candidate] (21.124 ms) : 0, 21124
Remote Config [baseline] (664.572 µs) : 0, 665
Remote Config [candidate] (668.235 µs) : 0, 668
Telemetry [baseline] (8.57 ms) : 0, 8570
Telemetry [candidate] (8.696 ms) : 0, 8696
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1056365
Total [baseline] (10.5 s) : 0, 10500169
Agent [candidate] (1.056 s) : 0, 1056165
Total [candidate] (10.463 s) : 0, 10463166
section appsec
Agent [baseline] (1.188 s) : 0, 1188218
Total [baseline] (10.729 s) : 0, 10729336
Agent [candidate] (1.189 s) : 0, 1189347
Total [candidate] (10.747 s) : 0, 10746917
section iast
Agent [baseline] (1.182 s) : 0, 1182492
Total [baseline] (10.944 s) : 0, 10943801
Agent [candidate] (1.183 s) : 0, 1182702
Total [candidate] (10.903 s) : 0, 10903488
section profiling
Agent [baseline] (1.264 s) : 0, 1264095
Total [baseline] (10.908 s) : 0, 10908432
Agent [candidate] (1.255 s) : 0, 1254799
Total [candidate] (10.806 s) : 0, 10805678
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.188 s 131.854 ms (12.5%)
Agent iast 1.182 s 126.127 ms (11.9%)
Agent profiling 1.264 s 207.73 ms (19.7%)
Total tracing 10.5 s -
Total appsec 10.729 s 229.166 ms (2.2%)
Total iast 10.944 s 443.631 ms (4.2%)
Total profiling 10.908 s 408.263 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.189 s 133.182 ms (12.6%)
Agent iast 1.183 s 126.537 ms (12.0%)
Agent profiling 1.255 s 198.634 ms (18.8%)
Total tracing 10.463 s -
Total appsec 10.747 s 283.751 ms (2.7%)
Total iast 10.903 s 440.323 ms (4.2%)
Total profiling 10.806 s 342.512 ms (3.3%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.994 ms) : 0, 713994
BytebuddyAgent [candidate] (713.938 ms) : 0, 713938
GlobalTracer [baseline] (255.82 ms) : 0, 255820
GlobalTracer [candidate] (256.117 ms) : 0, 256117
AppSec [baseline] (55.27 ms) : 0, 55270
AppSec [candidate] (56.077 ms) : 0, 56077
Remote Config [baseline] (722.35 µs) : 0, 722
Remote Config [candidate] (714.273 µs) : 0, 714
Telemetry [baseline] (15.63 ms) : 0, 15630
Telemetry [candidate] (14.372 ms) : 0, 14372
section appsec
BytebuddyAgent [baseline] (731.389 ms) : 0, 731389
BytebuddyAgent [candidate] (732.337 ms) : 0, 732337
GlobalTracer [baseline] (252.787 ms) : 0, 252787
GlobalTracer [candidate] (252.953 ms) : 0, 252953
AppSec [baseline] (170.471 ms) : 0, 170471
AppSec [candidate] (170.102 ms) : 0, 170102
Remote Config [baseline] (666.483 µs) : 0, 666
Remote Config [candidate] (681.125 µs) : 0, 681
Telemetry [baseline] (8.263 ms) : 0, 8263
Telemetry [candidate] (8.196 ms) : 0, 8196
IAST [baseline] (19.372 ms) : 0, 19372
IAST [candidate] (20.199 ms) : 0, 20199
section iast
BytebuddyAgent [baseline] (831.707 ms) : 0, 831707
BytebuddyAgent [candidate] (831.764 ms) : 0, 831764
GlobalTracer [baseline] (247.223 ms) : 0, 247223
GlobalTracer [candidate] (246.927 ms) : 0, 246927
AppSec [baseline] (57.588 ms) : 0, 57588
AppSec [candidate] (58.165 ms) : 0, 58165
Remote Config [baseline] (661.513 µs) : 0, 662
Remote Config [candidate] (674.216 µs) : 0, 674
Telemetry [baseline] (8.772 ms) : 0, 8772
Telemetry [candidate] (8.732 ms) : 0, 8732
IAST [baseline] (21.562 ms) : 0, 21562
IAST [candidate] (21.434 ms) : 0, 21434
section profiling
ProfilingAgent [baseline] (96.827 ms) : 0, 96827
ProfilingAgent [candidate] (95.095 ms) : 0, 95095
BytebuddyAgent [baseline] (708.186 ms) : 0, 708186
BytebuddyAgent [candidate] (703.828 ms) : 0, 703828
GlobalTracer [baseline] (352.125 ms) : 0, 352125
GlobalTracer [candidate] (350.634 ms) : 0, 350634
AppSec [baseline] (55.032 ms) : 0, 55032
AppSec [candidate] (53.74 ms) : 0, 53740
Remote Config [baseline] (663.078 µs) : 0, 663
Remote Config [candidate] (646.06 µs) : 0, 646
Telemetry [baseline] (8.988 ms) : 0, 8988
Telemetry [candidate] (8.812 ms) : 0, 8812
Profiling [baseline] (96.853 ms) : 0, 96853
Profiling [candidate] (95.122 ms) : 0, 95122
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-14T15:09:23 2025-01-14T15:16:27
git_branch master cbeauchesne/update-system-tests
git_commit_date 1736864662 1736866617
git_commit_sha 0df72c4 7d51a4b
release_version 1.46.0-SNAPSHOT~0df72c42da 1.46.0-SNAPSHOT~7d51a4b9fa
start_time 2025-01-14T15:09:09 2025-01-14T15:16:13
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736868142 1736868142
ci_job_id 765535222 765535222
ci_pipeline_id 52942782 52942782
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.367 ms) : 1349, 1386
.   : milestone, 1367,
appsec (1.761 ms) : 1736, 1786
.   : milestone, 1761,
appsec_no_iast (1.767 ms) : 1743, 1791
.   : milestone, 1767,
iast (1.516 ms) : 1494, 1539
.   : milestone, 1516,
profiling (1.57 ms) : 1546, 1595
.   : milestone, 1570,
tracing (1.506 ms) : 1482, 1530
.   : milestone, 1506,
section candidate
no_agent (1.351 ms) : 1331, 1371
.   : milestone, 1351,
appsec (1.758 ms) : 1734, 1781
.   : milestone, 1758,
appsec_no_iast (1.755 ms) : 1732, 1778
.   : milestone, 1755,
iast (1.513 ms) : 1490, 1537
.   : milestone, 1513,
profiling (1.521 ms) : 1498, 1544
.   : milestone, 1521,
tracing (1.489 ms) : 1464, 1514
.   : milestone, 1489,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.349 ms, 1.386 ms] -
appsec 1.761 ms [1.736 ms, 1.786 ms] 393.52 µs (28.8%)
appsec_no_iast 1.767 ms [1.743 ms, 1.791 ms] 399.32 µs (29.2%)
iast 1.516 ms [1.494 ms, 1.539 ms] 148.719 µs (10.9%)
profiling 1.57 ms [1.546 ms, 1.595 ms] 202.633 µs (14.8%)
tracing 1.506 ms [1.482 ms, 1.53 ms] 138.851 µs (10.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.331 ms, 1.371 ms] -
appsec 1.758 ms [1.734 ms, 1.781 ms] 406.778 µs (30.1%)
appsec_no_iast 1.755 ms [1.732 ms, 1.778 ms] 404.118 µs (29.9%)
iast 1.513 ms [1.49 ms, 1.537 ms] 162.571 µs (12.0%)
profiling 1.521 ms [1.498 ms, 1.544 ms] 170.278 µs (12.6%)
tracing 1.489 ms [1.464 ms, 1.514 ms] 138.465 µs (10.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da
    dateFormat X
    axisFormat %s
section baseline
no_agent (381.27 µs) : 361, 401
.   : milestone, 381,
iast (509.564 µs) : 488, 531
.   : milestone, 510,
iast_FULL (660.989 µs) : 639, 683
.   : milestone, 661,
iast_GLOBAL (536.986 µs) : 514, 560
.   : milestone, 537,
iast_HARDCODED_SECRET_DISABLED (506.649 µs) : 485, 528
.   : milestone, 507,
iast_INACTIVE (463.502 µs) : 442, 485
.   : milestone, 464,
iast_TELEMETRY_OFF (492.547 µs) : 471, 514
.   : milestone, 493,
tracing (458.741 µs) : 437, 480
.   : milestone, 459,
section candidate
no_agent (381.606 µs) : 362, 402
.   : milestone, 382,
iast (504.111 µs) : 482, 526
.   : milestone, 504,
iast_FULL (659.778 µs) : 638, 681
.   : milestone, 660,
iast_GLOBAL (522.777 µs) : 501, 544
.   : milestone, 523,
iast_HARDCODED_SECRET_DISABLED (503.186 µs) : 482, 525
.   : milestone, 503,
iast_INACTIVE (464.403 µs) : 443, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (490.898 µs) : 469, 512
.   : milestone, 491,
tracing (452.488 µs) : 432, 473
.   : milestone, 452,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.27 µs [361.265 µs, 401.276 µs] -
iast 509.564 µs [487.77 µs, 531.358 µs] 128.294 µs (33.6%)
iast_FULL 660.989 µs [639.261 µs, 682.716 µs] 279.718 µs (73.4%)
iast_GLOBAL 536.986 µs [514.349 µs, 559.623 µs] 155.715 µs (40.8%)
iast_HARDCODED_SECRET_DISABLED 506.649 µs [484.913 µs, 528.384 µs] 125.378 µs (32.9%)
iast_INACTIVE 463.502 µs [442.03 µs, 484.974 µs] 82.231 µs (21.6%)
iast_TELEMETRY_OFF 492.547 µs [470.599 µs, 514.494 µs] 111.276 µs (29.2%)
tracing 458.741 µs [437.298 µs, 480.183 µs] 77.47 µs (20.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.606 µs [361.601 µs, 401.612 µs] -
iast 504.111 µs [482.17 µs, 526.051 µs] 122.505 µs (32.1%)
iast_FULL 659.778 µs [638.187 µs, 681.368 µs] 278.171 µs (72.9%)
iast_GLOBAL 522.777 µs [501.341 µs, 544.213 µs] 141.171 µs (37.0%)
iast_HARDCODED_SECRET_DISABLED 503.186 µs [481.764 µs, 524.608 µs] 121.58 µs (31.9%)
iast_INACTIVE 464.403 µs [443.137 µs, 485.668 µs] 82.796 µs (21.7%)
iast_TELEMETRY_OFF 490.898 µs [469.477 µs, 512.318 µs] 109.291 µs (28.6%)
tracing 452.488 µs [431.957 µs, 473.019 µs] 70.882 µs (18.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master cbeauchesne/update-system-tests
git_commit_date 1736864662 1736866617
git_commit_sha 0df72c4 7d51a4b
release_version 1.46.0-SNAPSHOT~0df72c42da 1.46.0-SNAPSHOT~7d51a4b9fa
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1736868785 1736868785
ci_job_id 765535223 765535223
ci_pipeline_id 52942782 52942782
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (2.344 ms) : 2302, 2387
.   : milestone, 2344,
iast (2.092 ms) : 2038, 2146
.   : milestone, 2092,
iast_GLOBAL (2.132 ms) : 2078, 2186
.   : milestone, 2132,
profiling (1.956 ms) : 1913, 1999
.   : milestone, 1956,
tracing (1.925 ms) : 1884, 1966
.   : milestone, 1925,
section candidate
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.344 ms) : 2301, 2387
.   : milestone, 2344,
iast (2.092 ms) : 2038, 2146
.   : milestone, 2092,
iast_GLOBAL (2.131 ms) : 2077, 2185
.   : milestone, 2131,
profiling (2.436 ms) : 2248, 2623
.   : milestone, 2436,
tracing (1.936 ms) : 1895, 1978
.   : milestone, 1936,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 2.344 ms [2.302 ms, 2.387 ms] 875.99 µs (59.7%)
iast 2.092 ms [2.038 ms, 2.146 ms] 623.873 µs (42.5%)
iast_GLOBAL 2.132 ms [2.078 ms, 2.186 ms] 663.537 µs (45.2%)
profiling 1.956 ms [1.913 ms, 1.999 ms] 487.652 µs (33.2%)
tracing 1.925 ms [1.884 ms, 1.966 ms] 456.427 µs (31.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 2.344 ms [2.301 ms, 2.387 ms] 876.642 µs (59.7%)
iast 2.092 ms [2.038 ms, 2.146 ms] 624.279 µs (42.5%)
iast_GLOBAL 2.131 ms [2.077 ms, 2.185 ms] 663.253 µs (45.2%)
profiling 2.436 ms [2.248 ms, 2.623 ms] 967.973 µs (66.0%)
tracing 1.936 ms [1.895 ms, 1.978 ms] 468.702 µs (31.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~7d51a4b9fa, baseline=1.46.0-SNAPSHOT~0df72c42da
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
appsec (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
iast (19.208 s) : 19208000, 19208000
.   : milestone, 19208000,
iast_GLOBAL (18.149 s) : 18149000, 18149000
.   : milestone, 18149000,
profiling (15.059 s) : 15059000, 15059000
.   : milestone, 15059000,
tracing (14.937 s) : 14937000, 14937000
.   : milestone, 14937000,
section candidate
no_agent (15.269 s) : 15269000, 15269000
.   : milestone, 15269000,
appsec (14.882 s) : 14882000, 14882000
.   : milestone, 14882000,
iast (18.121 s) : 18121000, 18121000
.   : milestone, 18121000,
iast_GLOBAL (17.945 s) : 17945000, 17945000
.   : milestone, 17945000,
profiling (15.214 s) : 15214000, 15214000
.   : milestone, 15214000,
tracing (15.041 s) : 15041000, 15041000
.   : milestone, 15041000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.923 s [14.923 s, 14.923 s] -
appsec 15.23 s [15.23 s, 15.23 s] 307.0 ms (2.1%)
iast 19.208 s [19.208 s, 19.208 s] 4.285 s (28.7%)
iast_GLOBAL 18.149 s [18.149 s, 18.149 s] 3.226 s (21.6%)
profiling 15.059 s [15.059 s, 15.059 s] 136.0 ms (0.9%)
tracing 14.937 s [14.937 s, 14.937 s] 14.0 ms (0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.269 s [15.269 s, 15.269 s] -
appsec 14.882 s [14.882 s, 14.882 s] -387.0 ms (-2.5%)
iast 18.121 s [18.121 s, 18.121 s] 2.852 s (18.7%)
iast_GLOBAL 17.945 s [17.945 s, 17.945 s] 2.676 s (17.5%)
profiling 15.214 s [15.214 s, 15.214 s] -55.0 ms (-0.4%)
tracing 15.041 s [15.041 s, 15.041 s] -228.0 ms (-1.5%)

@PerfectSlayer
Copy link
Copy Markdown
Contributor

PerfectSlayer commented Jan 14, 2025

Duplicate of #8182 ? cc @smola

@PerfectSlayer PerfectSlayer merged commit 07e5d63 into master Jan 14, 2025
@PerfectSlayer PerfectSlayer deleted the cbeauchesne/update-system-tests branch January 14, 2025 17:02
@github-actions github-actions Bot added this to the 1.46.0 milestone Jan 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez manuel-alvarez-alvarez approved these changes

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.46.0

Development

Successfully merging this pull request may close these issues.

4 participants

@cbeauchesne @PerfectSlayer @mcculls @manuel-alvarez-alvarez