Skip to content

Mark profiling test as flaky#8459

Merged
PerfectSlayer merged 1 commit intomasterfrom
bbujon/ci
Feb 27, 2025
Merged

Mark profiling test as flaky#8459
PerfectSlayer merged 1 commit intomasterfrom
bbujon/ci

Conversation

@PerfectSlayer
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer commented Feb 27, 2025 •
edited by atlassian Bot
Loading

What Does This Do

Mark profiling test as flaky

Motivation

Keep CI green

Additional Notes

Contributor Checklist

Jira ticket: LANGPLAT-323

@PerfectSlayer PerfectSlayer requested a review from a team as a code owner February 27, 2025 09:31
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Feb 27, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@PerfectSlayer PerfectSlayer added the tag: no release notes Changes to exclude from release notes label Feb 27, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Feb 27, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1740640620 1740648304
git_commit_sha 85ac63b 4c2d9a1
release_version 1.47.0-SNAPSHOT~85ac63be61 1.47.0-SNAPSHOT~4c2d9a1ddc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740650879 1740650879
ci_job_id 825431119 825431119
ci_pipeline_id 57168559 57168559
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-amcegqwf-project-304-concurrent-0-8ml46r6o 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-amcegqwf-project-304-concurrent-0-8ml46r6o 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.037 s) : 0, 1036690
Total [baseline] (8.637 s) : 0, 8637284
Agent [candidate] (1.041 s) : 0, 1040798
Total [candidate] (8.703 s) : 0, 8703481
section iast
Agent [baseline] (1.168 s) : 0, 1167552
Total [baseline] (9.219 s) : 0, 9219074
Agent [candidate] (1.168 s) : 0, 1167667
Total [candidate] (9.228 s) : 0, 9228072
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.172 s) : 0, 1171651
Total [baseline] (9.231 s) : 0, 9231293
Agent [candidate] (1.177 s) : 0, 1177452
Total [candidate] (9.232 s) : 0, 9232342
section iast_TELEMETRY_OFF
Agent [baseline] (1.165 s) : 0, 1164534
Total [baseline] (9.229 s) : 0, 9229220
Agent [candidate] (1.163 s) : 0, 1162780
Total [candidate] (9.189 s) : 0, 9189050
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.037 s -
Agent iast 1.168 s 130.862 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 134.96 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.165 s 127.843 ms (12.3%)
Total tracing 8.637 s -
Total iast 9.219 s 581.79 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.231 s 594.009 ms (6.9%)
Total iast_TELEMETRY_OFF 9.229 s 591.936 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.168 s 126.868 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.177 s 136.654 ms (13.1%)
Agent iast_TELEMETRY_OFF 1.163 s 121.982 ms (11.7%)
Total tracing 8.703 s -
Total iast 9.228 s 524.591 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.232 s 528.861 ms (6.1%)
Total iast_TELEMETRY_OFF 9.189 s 485.569 ms (5.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.131 ms) : 0, 716131
BytebuddyAgent [candidate] (717.474 ms) : 0, 717474
GlobalTracer [baseline] (238.302 ms) : 0, 238302
GlobalTracer [candidate] (239.692 ms) : 0, 239692
AppSec [baseline] (55.237 ms) : 0, 55237
AppSec [candidate] (55.748 ms) : 0, 55748
Remote Config [baseline] (682.704 µs) : 0, 683
Remote Config [candidate] (700.455 µs) : 0, 700
Telemetry [baseline] (11.447 ms) : 0, 11447
Telemetry [candidate] (12.209 ms) : 0, 12209
section iast
BytebuddyAgent [baseline] (833.936 ms) : 0, 833936
BytebuddyAgent [candidate] (834.283 ms) : 0, 834283
GlobalTracer [baseline] (229.396 ms) : 0, 229396
GlobalTracer [candidate] (229.462 ms) : 0, 229462
IAST [baseline] (22.54 ms) : 0, 22540
IAST [candidate] (22.73 ms) : 0, 22730
AppSec [baseline] (57.403 ms) : 0, 57403
AppSec [candidate] (56.861 ms) : 0, 56861
Remote Config [baseline] (609.628 µs) : 0, 610
Remote Config [candidate] (621.027 µs) : 0, 621
Telemetry [baseline] (8.736 ms) : 0, 8736
Telemetry [candidate] (8.702 ms) : 0, 8702
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.652 ms) : 0, 836652
BytebuddyAgent [candidate] (841.455 ms) : 0, 841455
GlobalTracer [baseline] (230.176 ms) : 0, 230176
GlobalTracer [candidate] (230.858 ms) : 0, 230858
IAST [baseline] (23.019 ms) : 0, 23019
IAST [candidate] (23.046 ms) : 0, 23046
AppSec [baseline] (57.344 ms) : 0, 57344
AppSec [candidate] (57.545 ms) : 0, 57545
Remote Config [baseline] (621.554 µs) : 0, 622
Remote Config [candidate] (628.77 µs) : 0, 629
Telemetry [baseline] (8.854 ms) : 0, 8854
Telemetry [candidate] (8.88 ms) : 0, 8880
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (831.232 ms) : 0, 831232
BytebuddyAgent [candidate] (830.736 ms) : 0, 830736
GlobalTracer [baseline] (230.038 ms) : 0, 230038
GlobalTracer [candidate] (228.926 ms) : 0, 228926
IAST [baseline] (24.479 ms) : 0, 24479
IAST [candidate] (24.584 ms) : 0, 24584
AppSec [baseline] (54.668 ms) : 0, 54668
AppSec [candidate] (54.443 ms) : 0, 54443
Remote Config [baseline] (618.764 µs) : 0, 619
Remote Config [candidate] (620.543 µs) : 0, 621
Telemetry [baseline] (8.558 ms) : 0, 8558
Telemetry [candidate] (8.549 ms) : 0, 8549
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040232
Total [baseline] (10.461 s) : 0, 10461441
Agent [candidate] (1.035 s) : 0, 1034616
Total [candidate] (10.486 s) : 0, 10486179
section appsec
Agent [baseline] (1.182 s) : 0, 1182350
Total [baseline] (10.722 s) : 0, 10722199
Agent [candidate] (1.179 s) : 0, 1179015
Total [candidate] (10.719 s) : 0, 10719030
section iast
Agent [baseline] (1.169 s) : 0, 1168863
Total [baseline] (11.022 s) : 0, 11022278
Agent [candidate] (1.168 s) : 0, 1167780
Total [candidate] (10.964 s) : 0, 10963626
section profiling
Agent [baseline] (1.258 s) : 0, 1258092
Total [baseline] (10.825 s) : 0, 10825021
Agent [candidate] (1.261 s) : 0, 1261083
Total [candidate] (10.875 s) : 0, 10875084
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.182 s 142.118 ms (13.7%)
Agent iast 1.169 s 128.632 ms (12.4%)
Agent profiling 1.258 s 217.86 ms (20.9%)
Total tracing 10.461 s -
Total appsec 10.722 s 260.758 ms (2.5%)
Total iast 11.022 s 560.837 ms (5.4%)
Total profiling 10.825 s 363.58 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent appsec 1.179 s 144.399 ms (14.0%)
Agent iast 1.168 s 133.164 ms (12.9%)
Agent profiling 1.261 s 226.467 ms (21.9%)
Total tracing 10.486 s -
Total appsec 10.719 s 232.851 ms (2.2%)
Total iast 10.964 s 477.447 ms (4.6%)
Total profiling 10.875 s 388.905 ms (3.7%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.1 ms) : 0, 718100
BytebuddyAgent [candidate] (714.821 ms) : 0, 714821
GlobalTracer [baseline] (239.107 ms) : 0, 239107
GlobalTracer [candidate] (238.35 ms) : 0, 238350
AppSec [baseline] (55.755 ms) : 0, 55755
AppSec [candidate] (55.149 ms) : 0, 55149
Remote Config [baseline] (692.832 µs) : 0, 693
Remote Config [candidate] (689.814 µs) : 0, 690
Telemetry [baseline] (11.615 ms) : 0, 11615
Telemetry [candidate] (10.634 ms) : 0, 10634
section appsec
BytebuddyAgent [baseline] (735.071 ms) : 0, 735071
BytebuddyAgent [candidate] (733.093 ms) : 0, 733093
GlobalTracer [baseline] (236.255 ms) : 0, 236255
GlobalTracer [candidate] (235.238 ms) : 0, 235238
IAST [baseline] (21.592 ms) : 0, 21592
IAST [candidate] (21.355 ms) : 0, 21355
AppSec [baseline] (176.237 ms) : 0, 176237
AppSec [candidate] (176.166 ms) : 0, 176166
Remote Config [baseline] (657.226 µs) : 0, 657
Remote Config [candidate] (658.011 µs) : 0, 658
Telemetry [baseline] (8.367 ms) : 0, 8367
Telemetry [candidate] (8.29 ms) : 0, 8290
section iast
BytebuddyAgent [baseline] (835.078 ms) : 0, 835078
BytebuddyAgent [candidate] (834.273 ms) : 0, 834273
GlobalTracer [baseline] (229.342 ms) : 0, 229342
GlobalTracer [candidate] (229.368 ms) : 0, 229368
IAST [baseline] (22.953 ms) : 0, 22953
IAST [candidate] (22.848 ms) : 0, 22848
AppSec [baseline] (57.234 ms) : 0, 57234
AppSec [candidate] (57.029 ms) : 0, 57029
Remote Config [baseline] (609.907 µs) : 0, 610
Remote Config [candidate] (604.071 µs) : 0, 604
Telemetry [baseline] (8.685 ms) : 0, 8685
Telemetry [candidate] (8.691 ms) : 0, 8691
section profiling
BytebuddyAgent [baseline] (707.951 ms) : 0, 707951
BytebuddyAgent [candidate] (707.7 ms) : 0, 707700
GlobalTracer [baseline] (349.083 ms) : 0, 349083
GlobalTracer [candidate] (350.899 ms) : 0, 350899
AppSec [baseline] (55.269 ms) : 0, 55269
AppSec [candidate] (55.041 ms) : 0, 55041
Remote Config [baseline] (681.082 µs) : 0, 681
Remote Config [candidate] (680.093 µs) : 0, 680
Telemetry [baseline] (8.884 ms) : 0, 8884
Telemetry [candidate] (9.003 ms) : 0, 9003
ProfilingAgent [baseline] (95.939 ms) : 0, 95939
ProfilingAgent [candidate] (97.36 ms) : 0, 97360
Profiling [baseline] (95.964 ms) : 0, 95964
Profiling [candidate] (97.384 ms) : 0, 97384
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-27T09:38:18 2025-02-27T09:46:09
git_branch master bbujon/ci
git_commit_date 1740640620 1740648304
git_commit_sha 85ac63b 4c2d9a1
release_version 1.47.0-SNAPSHOT~85ac63be61 1.47.0-SNAPSHOT~4c2d9a1ddc
start_time 2025-02-27T09:38:04 2025-02-27T09:45:54
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740649971 1740649971
ci_job_id 825431120 825431120
ci_pipeline_id 57168559 57168559
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dxnsdv7f-project-304-concurrent-0-yvodrnfc 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dxnsdv7f-project-304-concurrent-0-yvodrnfc 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61
    dateFormat X
    axisFormat %s
section baseline
no_agent (394.934 µs) : 374, 416
.   : milestone, 395,
iast (527.687 µs) : 505, 551
.   : milestone, 528,
iast_FULL (741.824 µs) : 720, 764
.   : milestone, 742,
iast_GLOBAL (573.167 µs) : 551, 596
.   : milestone, 573,
iast_HARDCODED_SECRET_DISABLED (523.477 µs) : 501, 546
.   : milestone, 523,
iast_INACTIVE (474.2 µs) : 452, 496
.   : milestone, 474,
iast_TELEMETRY_OFF (507.024 µs) : 484, 530
.   : milestone, 507,
tracing (468.549 µs) : 447, 490
.   : milestone, 469,
section candidate
no_agent (396.495 µs) : 376, 417
.   : milestone, 396,
iast (514.37 µs) : 493, 536
.   : milestone, 514,
iast_FULL (732.15 µs) : 710, 754
.   : milestone, 732,
iast_GLOBAL (566.822 µs) : 545, 589
.   : milestone, 567,
iast_HARDCODED_SECRET_DISABLED (519.495 µs) : 497, 542
.   : milestone, 519,
iast_INACTIVE (470.224 µs) : 448, 492
.   : milestone, 470,
iast_TELEMETRY_OFF (509.149 µs) : 486, 533
.   : milestone, 509,
tracing (471.705 µs) : 451, 493
.   : milestone, 472,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 394.934 µs [373.882 µs, 415.986 µs] -
iast 527.687 µs [504.675 µs, 550.7 µs] 132.754 µs (33.6%)
iast_FULL 741.824 µs [719.792 µs, 763.857 µs] 346.891 µs (87.8%)
iast_GLOBAL 573.167 µs [550.66 µs, 595.674 µs] 178.233 µs (45.1%)
iast_HARDCODED_SECRET_DISABLED 523.477 µs [500.607 µs, 546.346 µs] 128.543 µs (32.5%)
iast_INACTIVE 474.2 µs [452.414 µs, 495.986 µs] 79.266 µs (20.1%)
iast_TELEMETRY_OFF 507.024 µs [484.074 µs, 529.975 µs] 112.09 µs (28.4%)
tracing 468.549 µs [447.448 µs, 489.651 µs] 73.616 µs (18.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 396.495 µs [376.432 µs, 416.558 µs] -
iast 514.37 µs [492.661 µs, 536.079 µs] 117.875 µs (29.7%)
iast_FULL 732.15 µs [709.976 µs, 754.323 µs] 335.655 µs (84.7%)
iast_GLOBAL 566.822 µs [544.867 µs, 588.777 µs] 170.328 µs (43.0%)
iast_HARDCODED_SECRET_DISABLED 519.495 µs [497.432 µs, 541.559 µs] 123.001 µs (31.0%)
iast_INACTIVE 470.224 µs [448.499 µs, 491.95 µs] 73.73 µs (18.6%)
iast_TELEMETRY_OFF 509.149 µs [485.573 µs, 532.726 µs] 112.655 µs (28.4%)
tracing 471.705 µs [450.796 µs, 492.613 µs] 75.21 µs (19.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.377 ms) : 1358, 1396
.   : milestone, 1377,
appsec (1.767 ms) : 1743, 1791
.   : milestone, 1767,
appsec_no_iast (1.778 ms) : 1754, 1802
.   : milestone, 1778,
code_origins (1.694 ms) : 1661, 1727
.   : milestone, 1694,
iast (1.517 ms) : 1493, 1541
.   : milestone, 1517,
profiling (1.55 ms) : 1525, 1576
.   : milestone, 1550,
tracing (1.491 ms) : 1465, 1517
.   : milestone, 1491,
section candidate
no_agent (1.381 ms) : 1361, 1401
.   : milestone, 1381,
appsec (1.775 ms) : 1752, 1799
.   : milestone, 1775,
appsec_no_iast (1.761 ms) : 1736, 1787
.   : milestone, 1761,
code_origins (1.705 ms) : 1672, 1737
.   : milestone, 1705,
iast (1.521 ms) : 1498, 1545
.   : milestone, 1521,
profiling (1.543 ms) : 1518, 1569
.   : milestone, 1543,
tracing (1.504 ms) : 1478, 1529
.   : milestone, 1504,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.377 ms [1.358 ms, 1.396 ms] -
appsec 1.767 ms [1.743 ms, 1.791 ms] 389.79 µs (28.3%)
appsec_no_iast 1.778 ms [1.754 ms, 1.802 ms] 400.887 µs (29.1%)
code_origins 1.694 ms [1.661 ms, 1.727 ms] 316.604 µs (23.0%)
iast 1.517 ms [1.493 ms, 1.541 ms] 140.167 µs (10.2%)
profiling 1.55 ms [1.525 ms, 1.576 ms] 173.237 µs (12.6%)
tracing 1.491 ms [1.465 ms, 1.517 ms] 113.824 µs (8.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.381 ms [1.361 ms, 1.401 ms] -
appsec 1.775 ms [1.752 ms, 1.799 ms] 394.046 µs (28.5%)
appsec_no_iast 1.761 ms [1.736 ms, 1.787 ms] 380.199 µs (27.5%)
code_origins 1.705 ms [1.672 ms, 1.737 ms] 323.342 µs (23.4%)
iast 1.521 ms [1.498 ms, 1.545 ms] 140.272 µs (10.2%)
profiling 1.543 ms [1.518 ms, 1.569 ms] 162.285 µs (11.7%)
tracing 1.504 ms [1.478 ms, 1.529 ms] 122.46 µs (8.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1740640620 1740648304
git_commit_sha 85ac63b 4c2d9a1
release_version 1.47.0-SNAPSHOT~85ac63be61 1.47.0-SNAPSHOT~4c2d9a1ddc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740650449 1740650449
ci_job_id 825431121 825431121
ci_pipeline_id 57168559 57168559
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-bqvsdzkf-project-304-concurrent-0-ua9kapyl 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-bqvsdzkf-project-304-concurrent-0-ua9kapyl 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (2.37 ms) : 2327, 2414
.   : milestone, 2370,
iast (2.112 ms) : 2057, 2167
.   : milestone, 2112,
iast_GLOBAL (2.165 ms) : 2110, 2221
.   : milestone, 2165,
profiling (1.966 ms) : 1922, 2010
.   : milestone, 1966,
tracing (1.945 ms) : 1904, 1987
.   : milestone, 1945,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.371 ms) : 2327, 2414
.   : milestone, 2371,
iast (2.122 ms) : 2067, 2178
.   : milestone, 2122,
iast_GLOBAL (2.167 ms) : 2112, 2223
.   : milestone, 2167,
profiling (1.965 ms) : 1921, 2009
.   : milestone, 1965,
tracing (1.954 ms) : 1911, 1997
.   : milestone, 1954,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 2.37 ms [2.327 ms, 2.414 ms] 894.652 µs (60.6%)
iast 2.112 ms [2.057 ms, 2.167 ms] 636.205 µs (43.1%)
iast_GLOBAL 2.165 ms [2.11 ms, 2.221 ms] 689.835 µs (46.8%)
profiling 1.966 ms [1.922 ms, 2.01 ms] 490.556 µs (33.2%)
tracing 1.945 ms [1.904 ms, 1.987 ms] 470.018 µs (31.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.371 ms [2.327 ms, 2.414 ms] 901.332 µs (61.3%)
iast 2.122 ms [2.067 ms, 2.178 ms] 652.995 µs (44.4%)
iast_GLOBAL 2.167 ms [2.112 ms, 2.223 ms] 698.098 µs (47.5%)
profiling 1.965 ms [1.921 ms, 2.009 ms] 495.636 µs (33.7%)
tracing 1.954 ms [1.911 ms, 1.997 ms] 484.714 µs (33.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~4c2d9a1ddc, baseline=1.47.0-SNAPSHOT~85ac63be61
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.389 s) : 15389000, 15389000
.   : milestone, 15389000,
appsec (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
iast (19.034 s) : 19034000, 19034000
.   : milestone, 19034000,
iast_GLOBAL (17.999 s) : 17999000, 17999000
.   : milestone, 17999000,
profiling (14.99 s) : 14990000, 14990000
.   : milestone, 14990000,
tracing (14.81 s) : 14810000, 14810000
.   : milestone, 14810000,
section candidate
no_agent (15.039 s) : 15039000, 15039000
.   : milestone, 15039000,
appsec (15.138 s) : 15138000, 15138000
.   : milestone, 15138000,
iast (18.743 s) : 18743000, 18743000
.   : milestone, 18743000,
iast_GLOBAL (18.139 s) : 18139000, 18139000
.   : milestone, 18139000,
profiling (15.137 s) : 15137000, 15137000
.   : milestone, 15137000,
tracing (14.947 s) : 14947000, 14947000
.   : milestone, 14947000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.389 s [15.389 s, 15.389 s] -
appsec 14.945 s [14.945 s, 14.945 s] -444.0 ms (-2.9%)
iast 19.034 s [19.034 s, 19.034 s] 3.645 s (23.7%)
iast_GLOBAL 17.999 s [17.999 s, 17.999 s] 2.61 s (17.0%)
profiling 14.99 s [14.99 s, 14.99 s] -399.0 ms (-2.6%)
tracing 14.81 s [14.81 s, 14.81 s] -579.0 ms (-3.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.039 s [15.039 s, 15.039 s] -
appsec 15.138 s [15.138 s, 15.138 s] 99.0 ms (0.7%)
iast 18.743 s [18.743 s, 18.743 s] 3.704 s (24.6%)
iast_GLOBAL 18.139 s [18.139 s, 18.139 s] 3.1 s (20.6%)
profiling 15.137 s [15.137 s, 15.137 s] 98.0 ms (0.7%)
tracing 14.947 s [14.947 s, 14.947 s] -92.0 ms (-0.6%)

@PerfectSlayer PerfectSlayer merged commit 51b4833 into master Feb 27, 2025
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch February 27, 2025 12:47
@github-actions github-actions Bot added this to the 1.47.0 milestone Feb 27, 2025
PerfectSlayer added a commit that referenced this pull request Mar 3, 2025
@PerfectSlayer
fix(ci): Fix #8459
dd19bf5
@PerfectSlayer PerfectSlayer mentioned this pull request Mar 3, 2025
Merged
PerfectSlayer added a commit that referenced this pull request Mar 3, 2025
@PerfectSlayer
fix(ci): Fix #8459 (#8485)
1587c49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@jbachorik jbachorik jbachorik approved these changes

Assignees

No one assigned

Labels

comp: profiling Profiling tag: flaky test/disabled Disabled flaky tests tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.47.0

Development

Successfully merging this pull request may close these issues.

3 participants

@PerfectSlayer @mcculls @jbachorik