Skip to content

Disable flaky tests#8430

Merged
PerfectSlayer merged 1 commit intomasterfrom
bbujon/ci
Feb 21, 2025
Merged

Disable flaky tests#8430
PerfectSlayer merged 1 commit intomasterfrom
bbujon/ci

Conversation

@PerfectSlayer
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer commented Feb 21, 2025 •
edited by atlassian Bot
Loading

What Does This Do

Disable test for CI stability.

Motivation

Additional Notes

Disable tests are tracked under JIRA

Contributor Checklist

Jira ticket: LANGPLAT-323

@PerfectSlayer PerfectSlayer added comp: core Tracer core tag: no release notes Changes to exclude from release notes tag: flaky test Flaky tests tag: flaky test/disabled Disabled flaky tests inst: play framework Play Framework instrumentation labels Feb 21, 2025
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner February 21, 2025 09:36
@PerfectSlayer PerfectSlayer requested a review from dougqh February 21, 2025 09:36
@PerfectSlayer PerfectSlayer enabled auto-merge (squash) February 21, 2025 09:47
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Feb 21, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1740074363 1740130305
git_commit_sha 121f38f 94df61b
release_version 1.47.0-SNAPSHOT~121f38f42d 1.47.0-SNAPSHOT~94df61bae9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740132833 1740132833
ci_job_id 817353426 817353426
ci_pipeline_id 56532531 56532531
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-cvfcshxg-project-304-concurrent-0-kw64zjug 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-cvfcshxg-project-304-concurrent-0-kw64zjug 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1050354
Total [baseline] (10.435 s) : 0, 10434885
Agent [candidate] (1.041 s) : 0, 1040623
Total [candidate] (10.395 s) : 0, 10395310
section appsec
Agent [baseline] (1.185 s) : 0, 1185020
Total [baseline] (10.779 s) : 0, 10779486
Agent [candidate] (1.184 s) : 0, 1183810
Total [candidate] (10.756 s) : 0, 10756445
section iast
Agent [baseline] (1.181 s) : 0, 1180878
Total [baseline] (11.03 s) : 0, 11030138
Agent [candidate] (1.174 s) : 0, 1174114
Total [candidate] (11.017 s) : 0, 11017197
section profiling
Agent [baseline] (1.262 s) : 0, 1261658
Total [baseline] (10.825 s) : 0, 10824684
Agent [candidate] (1.259 s) : 0, 1259446
Total [candidate] (10.822 s) : 0, 10822318
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent appsec 1.185 s 134.665 ms (12.8%)
Agent iast 1.181 s 130.523 ms (12.4%)
Agent profiling 1.262 s 211.304 ms (20.1%)
Total tracing 10.435 s -
Total appsec 10.779 s 344.6 ms (3.3%)
Total iast 11.03 s 595.253 ms (5.7%)
Total profiling 10.825 s 389.798 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.184 s 143.187 ms (13.8%)
Agent iast 1.174 s 133.49 ms (12.8%)
Agent profiling 1.259 s 218.823 ms (21.0%)
Total tracing 10.395 s -
Total appsec 10.756 s 361.136 ms (3.5%)
Total iast 11.017 s 621.888 ms (6.0%)
Total profiling 10.822 s 427.009 ms (4.1%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.669 ms) : 0, 723669
BytebuddyAgent [candidate] (717.552 ms) : 0, 717552
GlobalTracer [baseline] (241.256 ms) : 0, 241256
GlobalTracer [candidate] (239.269 ms) : 0, 239269
AppSec [baseline] (55.74 ms) : 0, 55740
AppSec [candidate] (55.167 ms) : 0, 55167
Remote Config [baseline] (709.767 µs) : 0, 710
Remote Config [candidate] (687.065 µs) : 0, 687
Telemetry [baseline] (13.609 ms) : 0, 13609
Telemetry [candidate] (12.716 ms) : 0, 12716
section appsec
BytebuddyAgent [baseline] (736.672 ms) : 0, 736672
BytebuddyAgent [candidate] (735.051 ms) : 0, 735051
GlobalTracer [baseline] (236.93 ms) : 0, 236930
GlobalTracer [candidate] (236.573 ms) : 0, 236573
IAST [baseline] (21.48 ms) : 0, 21480
IAST [candidate] (21.521 ms) : 0, 21521
AppSec [baseline] (176.517 ms) : 0, 176517
AppSec [candidate] (177.291 ms) : 0, 177291
Remote Config [baseline] (652.9 µs) : 0, 653
Remote Config [candidate] (654.36 µs) : 0, 654
Telemetry [baseline] (8.227 ms) : 0, 8227
Telemetry [candidate] (8.234 ms) : 0, 8234
section iast
BytebuddyAgent [baseline] (843.793 ms) : 0, 843793
BytebuddyAgent [candidate] (838.393 ms) : 0, 838393
GlobalTracer [baseline] (231.585 ms) : 0, 231585
GlobalTracer [candidate] (230.914 ms) : 0, 230914
IAST [baseline] (22.994 ms) : 0, 22994
IAST [candidate] (23.053 ms) : 0, 23053
AppSec [baseline] (57.803 ms) : 0, 57803
AppSec [candidate] (57.097 ms) : 0, 57097
Remote Config [baseline] (613.476 µs) : 0, 613
Remote Config [candidate] (624.351 µs) : 0, 624
Telemetry [baseline] (8.767 ms) : 0, 8767
Telemetry [candidate] (8.736 ms) : 0, 8736
section profiling
BytebuddyAgent [baseline] (708.695 ms) : 0, 708695
BytebuddyAgent [candidate] (707.621 ms) : 0, 707621
GlobalTracer [baseline] (349.888 ms) : 0, 349888
GlobalTracer [candidate] (349.392 ms) : 0, 349392
AppSec [baseline] (55.295 ms) : 0, 55295
AppSec [candidate] (54.625 ms) : 0, 54625
Remote Config [baseline] (668.413 µs) : 0, 668
Remote Config [candidate] (655.989 µs) : 0, 656
Telemetry [baseline] (8.944 ms) : 0, 8944
Telemetry [candidate] (8.908 ms) : 0, 8908
ProfilingAgent [baseline] (95.898 ms) : 0, 95898
ProfilingAgent [candidate] (95.919 ms) : 0, 95919
Profiling [baseline] (95.922 ms) : 0, 95922
Profiling [candidate] (95.945 ms) : 0, 95945
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1043090
Total [baseline] (8.665 s) : 0, 8665139
Agent [candidate] (1.042 s) : 0, 1041822
Total [candidate] (8.665 s) : 0, 8664570
section iast
Agent [baseline] (1.171 s) : 0, 1170943
Total [baseline] (9.27 s) : 0, 9270454
Agent [candidate] (1.181 s) : 0, 1180684
Total [candidate] (9.291 s) : 0, 9290981
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1172975
Total [baseline] (9.202 s) : 0, 9202460
Agent [candidate] (1.173 s) : 0, 1172683
Total [candidate] (9.187 s) : 0, 9187401
section iast_TELEMETRY_OFF
Agent [baseline] (1.177 s) : 0, 1177406
Total [baseline] (9.276 s) : 0, 9276144
Agent [candidate] (1.169 s) : 0, 1169441
Total [candidate] (9.258 s) : 0, 9258499
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.171 s 127.853 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 129.885 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.177 s 134.316 ms (12.9%)
Total tracing 8.665 s -
Total iast 9.27 s 605.315 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.202 s 537.32 ms (6.2%)
Total iast_TELEMETRY_OFF 9.276 s 611.005 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.181 s 138.861 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 130.861 ms (12.6%)
Agent iast_TELEMETRY_OFF 1.169 s 127.619 ms (12.2%)
Total tracing 8.665 s -
Total iast 9.291 s 626.411 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.187 s 522.831 ms (6.0%)
Total iast_TELEMETRY_OFF 9.258 s 593.929 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.091 ms) : 0, 717091
BytebuddyAgent [candidate] (717.825 ms) : 0, 717825
GlobalTracer [baseline] (241.412 ms) : 0, 241412
GlobalTracer [candidate] (239.692 ms) : 0, 239692
AppSec [baseline] (55.614 ms) : 0, 55614
AppSec [candidate] (55.633 ms) : 0, 55633
Remote Config [baseline] (705.526 µs) : 0, 706
Remote Config [candidate] (694.418 µs) : 0, 694
Telemetry [baseline] (13.006 ms) : 0, 13006
Telemetry [candidate] (12.778 ms) : 0, 12778
section iast
BytebuddyAgent [baseline] (836.428 ms) : 0, 836428
BytebuddyAgent [candidate] (843.472 ms) : 0, 843472
GlobalTracer [baseline] (230.189 ms) : 0, 230189
GlobalTracer [candidate] (231.291 ms) : 0, 231291
IAST [baseline] (22.589 ms) : 0, 22589
IAST [candidate] (23.078 ms) : 0, 23078
AppSec [baseline] (57.16 ms) : 0, 57160
AppSec [candidate] (58.077 ms) : 0, 58077
Remote Config [baseline] (613.069 µs) : 0, 613
Remote Config [candidate] (621.183 µs) : 0, 621
Telemetry [baseline] (8.654 ms) : 0, 8654
Telemetry [candidate] (8.764 ms) : 0, 8764
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (838.045 ms) : 0, 838045
BytebuddyAgent [candidate] (836.701 ms) : 0, 836701
GlobalTracer [baseline] (230.01 ms) : 0, 230010
GlobalTracer [candidate] (230.606 ms) : 0, 230606
IAST [baseline] (22.716 ms) : 0, 22716
IAST [candidate] (22.758 ms) : 0, 22758
AppSec [baseline] (57.578 ms) : 0, 57578
AppSec [candidate] (57.92 ms) : 0, 57920
Remote Config [baseline] (610.428 µs) : 0, 610
Remote Config [candidate] (611.324 µs) : 0, 611
Telemetry [baseline] (8.655 ms) : 0, 8655
Telemetry [candidate] (8.737 ms) : 0, 8737
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (841.022 ms) : 0, 841022
BytebuddyAgent [candidate] (834.569 ms) : 0, 834569
GlobalTracer [baseline] (231.998 ms) : 0, 231998
GlobalTracer [candidate] (230.616 ms) : 0, 230616
IAST [baseline] (26.145 ms) : 0, 26145
IAST [candidate] (25.323 ms) : 0, 25323
AppSec [baseline] (53.51 ms) : 0, 53510
AppSec [candidate] (54.274 ms) : 0, 54274
Remote Config [baseline] (621.198 µs) : 0, 621
Remote Config [candidate] (616.895 µs) : 0, 617
Telemetry [baseline] (8.612 ms) : 0, 8612
Telemetry [candidate] (8.704 ms) : 0, 8704
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-21T09:44:09 2025-02-21T09:51:11
git_branch master bbujon/ci
git_commit_date 1740074363 1740130305
git_commit_sha 121f38f 94df61b
release_version 1.47.0-SNAPSHOT~121f38f42d 1.47.0-SNAPSHOT~94df61bae9
start_time 2025-02-21T09:43:55 2025-02-21T09:50:56
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740131825 1740131825
ci_job_id 817353427 817353427
ci_pipeline_id 56532531 56532531
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-cvfcshxg-project-304-concurrent-1-bsid9hha 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-cvfcshxg-project-304-concurrent-1-bsid9hha 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d
    dateFormat X
    axisFormat %s
section baseline
no_agent (376.622 µs) : 357, 397
.   : milestone, 377,
iast (506.514 µs) : 485, 528
.   : milestone, 507,
iast_FULL (723.438 µs) : 701, 745
.   : milestone, 723,
iast_GLOBAL (550.049 µs) : 529, 572
.   : milestone, 550,
iast_HARDCODED_SECRET_DISABLED (500.887 µs) : 478, 524
.   : milestone, 501,
iast_INACTIVE (460.599 µs) : 439, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (500.962 µs) : 477, 524
.   : milestone, 501,
tracing (454.294 µs) : 433, 476
.   : milestone, 454,
section candidate
no_agent (375.948 µs) : 356, 396
.   : milestone, 376,
iast (517.5 µs) : 495, 540
.   : milestone, 518,
iast_FULL (731.183 µs) : 709, 753
.   : milestone, 731,
iast_GLOBAL (547.656 µs) : 526, 569
.   : milestone, 548,
iast_HARDCODED_SECRET_DISABLED (505.528 µs) : 484, 527
.   : milestone, 506,
iast_INACTIVE (455.264 µs) : 434, 476
.   : milestone, 455,
iast_TELEMETRY_OFF (490.346 µs) : 467, 513
.   : milestone, 490,
tracing (448.802 µs) : 428, 469
.   : milestone, 449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.622 µs [356.522 µs, 396.722 µs] -
iast 506.514 µs [484.869 µs, 528.16 µs] 129.892 µs (34.5%)
iast_FULL 723.438 µs [701.414 µs, 745.461 µs] 346.815 µs (92.1%)
iast_GLOBAL 550.049 µs [528.539 µs, 571.559 µs] 173.427 µs (46.0%)
iast_HARDCODED_SECRET_DISABLED 500.887 µs [477.854 µs, 523.92 µs] 124.265 µs (33.0%)
iast_INACTIVE 460.599 µs [438.55 µs, 482.648 µs] 83.977 µs (22.3%)
iast_TELEMETRY_OFF 500.962 µs [477.459 µs, 524.466 µs] 124.34 µs (33.0%)
tracing 454.294 µs [433.05 µs, 475.538 µs] 77.672 µs (20.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.948 µs [355.543 µs, 396.352 µs] -
iast 517.5 µs [494.989 µs, 540.012 µs] 141.553 µs (37.7%)
iast_FULL 731.183 µs [709.269 µs, 753.098 µs] 355.236 µs (94.5%)
iast_GLOBAL 547.656 µs [526.057 µs, 569.254 µs] 171.708 µs (45.7%)
iast_HARDCODED_SECRET_DISABLED 505.528 µs [483.838 µs, 527.218 µs] 129.58 µs (34.5%)
iast_INACTIVE 455.264 µs [434.274 µs, 476.254 µs] 79.316 µs (21.1%)
iast_TELEMETRY_OFF 490.346 µs [467.374 µs, 513.318 µs] 114.398 µs (30.4%)
tracing 448.802 µs [428.38 µs, 469.225 µs] 72.855 µs (19.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1375
.   : milestone, 1355,
appsec (1.744 ms) : 1721, 1767
.   : milestone, 1744,
appsec_no_iast (1.757 ms) : 1734, 1780
.   : milestone, 1757,
iast (1.509 ms) : 1485, 1533
.   : milestone, 1509,
profiling (1.503 ms) : 1478, 1528
.   : milestone, 1503,
tracing (1.477 ms) : 1451, 1502
.   : milestone, 1477,
section candidate
no_agent (1.344 ms) : 1324, 1364
.   : milestone, 1344,
appsec (1.736 ms) : 1713, 1760
.   : milestone, 1736,
appsec_no_iast (1.743 ms) : 1720, 1767
.   : milestone, 1743,
iast (1.507 ms) : 1482, 1531
.   : milestone, 1507,
profiling (1.504 ms) : 1481, 1528
.   : milestone, 1504,
tracing (1.47 ms) : 1444, 1496
.   : milestone, 1470,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.335 ms, 1.375 ms] -
appsec 1.744 ms [1.721 ms, 1.767 ms] 388.839 µs (28.7%)
appsec_no_iast 1.757 ms [1.734 ms, 1.78 ms] 402.058 µs (29.7%)
iast 1.509 ms [1.485 ms, 1.533 ms] 154.146 µs (11.4%)
profiling 1.503 ms [1.478 ms, 1.528 ms] 148.176 µs (10.9%)
tracing 1.477 ms [1.451 ms, 1.502 ms] 121.705 µs (9.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.344 ms [1.324 ms, 1.364 ms] -
appsec 1.736 ms [1.713 ms, 1.76 ms] 392.62 µs (29.2%)
appsec_no_iast 1.743 ms [1.72 ms, 1.767 ms] 399.706 µs (29.7%)
iast 1.507 ms [1.482 ms, 1.531 ms] 162.86 µs (12.1%)
profiling 1.504 ms [1.481 ms, 1.528 ms] 160.653 µs (12.0%)
tracing 1.47 ms [1.444 ms, 1.496 ms] 126.301 µs (9.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1740074363 1740130305
git_commit_sha 121f38f 94df61b
release_version 1.47.0-SNAPSHOT~121f38f42d 1.47.0-SNAPSHOT~94df61bae9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740132402 1740132402
ci_job_id 817353428 817353428
ci_pipeline_id 56532531 56532531
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-y3jyzt9j-project-304-concurrent-0-huj55o10 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-y3jyzt9j-project-304-concurrent-0-huj55o10 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.514 s) : 15514000, 15514000
.   : milestone, 15514000,
appsec (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
iast (19.089 s) : 19089000, 19089000
.   : milestone, 19089000,
iast_GLOBAL (18.115 s) : 18115000, 18115000
.   : milestone, 18115000,
profiling (15.021 s) : 15021000, 15021000
.   : milestone, 15021000,
tracing (14.818 s) : 14818000, 14818000
.   : milestone, 14818000,
section candidate
no_agent (15.292 s) : 15292000, 15292000
.   : milestone, 15292000,
appsec (14.767 s) : 14767000, 14767000
.   : milestone, 14767000,
iast (18.985 s) : 18985000, 18985000
.   : milestone, 18985000,
iast_GLOBAL (17.858 s) : 17858000, 17858000
.   : milestone, 17858000,
profiling (15.607 s) : 15607000, 15607000
.   : milestone, 15607000,
tracing (15.255 s) : 15255000, 15255000
.   : milestone, 15255000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.514 s [15.514 s, 15.514 s] -
appsec 14.8 s [14.8 s, 14.8 s] -714.0 ms (-4.6%)
iast 19.089 s [19.089 s, 19.089 s] 3.575 s (23.0%)
iast_GLOBAL 18.115 s [18.115 s, 18.115 s] 2.601 s (16.8%)
profiling 15.021 s [15.021 s, 15.021 s] -493.0 ms (-3.2%)
tracing 14.818 s [14.818 s, 14.818 s] -696.0 ms (-4.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.292 s [15.292 s, 15.292 s] -
appsec 14.767 s [14.767 s, 14.767 s] -525.0 ms (-3.4%)
iast 18.985 s [18.985 s, 18.985 s] 3.693 s (24.1%)
iast_GLOBAL 17.858 s [17.858 s, 17.858 s] 2.566 s (16.8%)
profiling 15.607 s [15.607 s, 15.607 s] 315.0 ms (2.1%)
tracing 15.255 s [15.255 s, 15.255 s] -37.0 ms (-0.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~94df61bae9, baseline=1.47.0-SNAPSHOT~121f38f42d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1495
.   : milestone, 1483,
appsec (2.387 ms) : 2343, 2430
.   : milestone, 2387,
iast (2.136 ms) : 2080, 2191
.   : milestone, 2136,
iast_GLOBAL (2.168 ms) : 2112, 2224
.   : milestone, 2168,
profiling (1.994 ms) : 1950, 2038
.   : milestone, 1994,
tracing (1.961 ms) : 1919, 2004
.   : milestone, 1961,
section candidate
no_agent (1.49 ms) : 1478, 1502
.   : milestone, 1490,
appsec (2.388 ms) : 2344, 2432
.   : milestone, 2388,
iast (2.12 ms) : 2064, 2175
.   : milestone, 2120,
iast_GLOBAL (2.163 ms) : 2108, 2219
.   : milestone, 2163,
profiling (2.011 ms) : 1966, 2056
.   : milestone, 2011,
tracing (1.951 ms) : 1909, 1993
.   : milestone, 1951,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.495 ms] -
appsec 2.387 ms [2.343 ms, 2.43 ms] 903.498 µs (60.9%)
iast 2.136 ms [2.08 ms, 2.191 ms] 652.514 µs (44.0%)
iast_GLOBAL 2.168 ms [2.112 ms, 2.224 ms] 685.023 µs (46.2%)
profiling 1.994 ms [1.95 ms, 2.038 ms] 511.053 µs (34.5%)
tracing 1.961 ms [1.919 ms, 2.004 ms] 478.02 µs (32.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.49 ms [1.478 ms, 1.502 ms] -
appsec 2.388 ms [2.344 ms, 2.432 ms] 897.536 µs (60.2%)
iast 2.12 ms [2.064 ms, 2.175 ms] 629.552 µs (42.2%)
iast_GLOBAL 2.163 ms [2.108 ms, 2.219 ms] 673.276 µs (45.2%)
profiling 2.011 ms [1.966 ms, 2.056 ms] 520.564 µs (34.9%)
tracing 1.951 ms [1.909 ms, 1.993 ms] 461.246 µs (31.0%)

@PerfectSlayer PerfectSlayer merged commit f6c50ad into master Feb 21, 2025
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch February 21, 2025 10:33
@github-actions github-actions Bot added this to the 1.47.0 milestone Feb 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: core Tracer core inst: play framework Play Framework instrumentation tag: flaky test/disabled Disabled flaky tests tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.47.0

Development

Successfully merging this pull request may close these issues.

2 participants

@PerfectSlayer @amarziali