Skip to content

Re-enable profiler for Java9ModulesSmokeTest#8257

Merged
jbachorik merged 1 commit intomasterfrom
jb/jlinked_with_profiler
Jan 21, 2025
Merged

Re-enable profiler for Java9ModulesSmokeTest#8257
jbachorik merged 1 commit intomasterfrom
jb/jlinked_with_profiler

Conversation

@jbachorik
Copy link
Copy Markdown
Contributor

@jbachorik jbachorik commented Jan 21, 2025

What Does This Do

It reverts the change disabling profiling in Java9ModulesSmokeTest

Motivation

The underlying bug in the profiler was fixed so it is safe to enable it again such that we have also profiling coverage.

Additional Notes

Contributor Checklist

Jira ticket: PROF-11080

@jbachorik jbachorik added tag: no release notes Changes to exclude from release notes comp: profiling Profiling type:task labels Jan 21, 2025
@jbachorik jbachorik requested a review from a team as a code owner January 21, 2025 08:54
@jbachorik jbachorik requested a review from amarziali January 21, 2025 08:54
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jan 21, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/jlinked_with_profiler
git_commit_date 1737449112 1737449553
git_commit_sha b63b852 3a6c3c0
release_version 1.46.0-SNAPSHOT~b63b852c6d 1.46.0-SNAPSHOT~3a6c3c0ddc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737452061 1737452061
ci_job_id 773485668 773485668
ci_pipeline_id 53523571 53523571
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 3 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:AppSec better
[-6.754ms; -1.845ms] or [-11.309%; -3.089%]
55.418ms 59.717ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068831
Total [baseline] (10.524 s) : 0, 10524020
Agent [candidate] (1.054 s) : 0, 1054396
Total [candidate] (10.432 s) : 0, 10431524
section appsec
Agent [baseline] (1.194 s) : 0, 1194383
Total [baseline] (10.727 s) : 0, 10727007
Agent [candidate] (1.187 s) : 0, 1186974
Total [candidate] (10.706 s) : 0, 10706061
section iast
Agent [baseline] (1.181 s) : 0, 1180917
Total [baseline] (10.904 s) : 0, 10904272
Agent [candidate] (1.198 s) : 0, 1198369
Total [candidate] (11.027 s) : 0, 11026823
section profiling
Agent [baseline] (1.263 s) : 0, 1262755
Total [baseline] (10.751 s) : 0, 10751414
Agent [candidate] (1.262 s) : 0, 1261606
Total [candidate] (10.905 s) : 0, 10904541
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent appsec 1.194 s 125.552 ms (11.7%)
Agent iast 1.181 s 112.086 ms (10.5%)
Agent profiling 1.263 s 193.925 ms (18.1%)
Total tracing 10.524 s -
Total appsec 10.727 s 202.988 ms (1.9%)
Total iast 10.904 s 380.253 ms (3.6%)
Total profiling 10.751 s 227.395 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.187 s 132.578 ms (12.6%)
Agent iast 1.198 s 143.973 ms (13.7%)
Agent profiling 1.262 s 207.21 ms (19.7%)
Total tracing 10.432 s -
Total appsec 10.706 s 274.537 ms (2.6%)
Total iast 11.027 s 595.299 ms (5.7%)
Total profiling 10.905 s 473.017 ms (4.5%)
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.855 ms) : 0, 723855
BytebuddyAgent [candidate] (713.24 ms) : 0, 713240
GlobalTracer [baseline] (258.082 ms) : 0, 258082
GlobalTracer [candidate] (255.206 ms) : 0, 255206
AppSec [baseline] (56.115 ms) : 0, 56115
AppSec [candidate] (56.21 ms) : 0, 56210
Remote Config [baseline] (746.931 µs) : 0, 747
Remote Config [candidate] (733.1 µs) : 0, 733
Telemetry [baseline] (14.937 ms) : 0, 14937
Telemetry [candidate] (14.036 ms) : 0, 14036
section appsec
BytebuddyAgent [baseline] (735.144 ms) : 0, 735144
BytebuddyAgent [candidate] (730.691 ms) : 0, 730691
GlobalTracer [baseline] (254.519 ms) : 0, 254519
GlobalTracer [candidate] (252.293 ms) : 0, 252293
AppSec [baseline] (171.068 ms) : 0, 171068
AppSec [candidate] (170.537 ms) : 0, 170537
IAST [baseline] (19.466 ms) : 0, 19466
IAST [candidate] (19.318 ms) : 0, 19318
Remote Config [baseline] (671.675 µs) : 0, 672
Remote Config [candidate] (659.831 µs) : 0, 660
Telemetry [baseline] (8.221 ms) : 0, 8221
Telemetry [candidate] (8.171 ms) : 0, 8171
section iast
BytebuddyAgent [baseline] (830.671 ms) : 0, 830671
BytebuddyAgent [candidate] (844.019 ms) : 0, 844019
GlobalTracer [baseline] (246.218 ms) : 0, 246218
GlobalTracer [candidate] (249.234 ms) : 0, 249234
AppSec [baseline] (57.985 ms) : 0, 57985
AppSec [candidate] (58.502 ms) : 0, 58502
IAST [baseline] (21.661 ms) : 0, 21661
IAST [candidate] (21.83 ms) : 0, 21830
Remote Config [baseline] (687.527 µs) : 0, 688
Remote Config [candidate] (671.926 µs) : 0, 672
Telemetry [baseline] (8.748 ms) : 0, 8748
Telemetry [candidate] (8.966 ms) : 0, 8966
section profiling
BytebuddyAgent [baseline] (707.593 ms) : 0, 707593
BytebuddyAgent [candidate] (707.98 ms) : 0, 707980
GlobalTracer [baseline] (351.425 ms) : 0, 351425
GlobalTracer [candidate] (351.719 ms) : 0, 351719
AppSec [baseline] (55.296 ms) : 0, 55296
AppSec [candidate] (54.207 ms) : 0, 54207
Remote Config [baseline] (724.203 µs) : 0, 724
Remote Config [candidate] (713.115 µs) : 0, 713
Telemetry [baseline] (8.893 ms) : 0, 8893
Telemetry [candidate] (8.883 ms) : 0, 8883
ProfilingAgent [baseline] (96.678 ms) : 0, 96678
ProfilingAgent [candidate] (95.894 ms) : 0, 95894
Profiling [baseline] (96.703 ms) : 0, 96703
Profiling [candidate] (95.919 ms) : 0, 95919
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076337
Total [baseline] (8.7 s) : 0, 8699779
Agent [candidate] (1.054 s) : 0, 1053640
Total [candidate] (8.606 s) : 0, 8606360
section iast
Agent [baseline] (1.198 s) : 0, 1197622
Total [baseline] (9.243 s) : 0, 9243257
Agent [candidate] (1.183 s) : 0, 1183230
Total [candidate] (9.238 s) : 0, 9237598
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.182 s) : 0, 1182199
Total [baseline] (9.15 s) : 0, 9149506
Agent [candidate] (1.183 s) : 0, 1183056
Total [candidate] (9.162 s) : 0, 9161559
section iast_TELEMETRY_OFF
Agent [baseline] (1.179 s) : 0, 1179263
Total [baseline] (9.169 s) : 0, 9168880
Agent [candidate] (1.177 s) : 0, 1177034
Total [candidate] (9.185 s) : 0, 9184822
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent iast 1.198 s 121.286 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 105.862 ms (9.8%)
Agent iast_TELEMETRY_OFF 1.179 s 102.926 ms (9.6%)
Total tracing 8.7 s -
Total iast 9.243 s 543.478 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.15 s 449.727 ms (5.2%)
Total iast_TELEMETRY_OFF 9.169 s 469.1 ms (5.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.183 s 129.591 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.183 s 129.417 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.177 s 123.394 ms (11.7%)
Total tracing 8.606 s -
Total iast 9.238 s 631.237 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.162 s 555.199 ms (6.5%)
Total iast_TELEMETRY_OFF 9.185 s 578.461 ms (6.7%)
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (728.582 ms) : 0, 728582
BytebuddyAgent [candidate] (713.943 ms) : 0, 713943
GlobalTracer [baseline] (259.033 ms) : 0, 259033
GlobalTracer [candidate] (255.083 ms) : 0, 255083
AppSec [baseline] (59.717 ms) : 0, 59717
AppSec [candidate] (55.418 ms) : 0, 55418
Remote Config [baseline] (751.827 µs) : 0, 752
Remote Config [candidate] (734.009 µs) : 0, 734
Telemetry [baseline] (13.125 ms) : 0, 13125
Telemetry [candidate] (13.521 ms) : 0, 13521
section iast
BytebuddyAgent [baseline] (843.606 ms) : 0, 843606
BytebuddyAgent [candidate] (832.685 ms) : 0, 832685
GlobalTracer [baseline] (248.717 ms) : 0, 248717
GlobalTracer [candidate] (246.446 ms) : 0, 246446
AppSec [baseline] (58.477 ms) : 0, 58477
AppSec [candidate] (58.21 ms) : 0, 58210
IAST [baseline] (21.874 ms) : 0, 21874
IAST [candidate] (21.5 ms) : 0, 21500
Remote Config [baseline] (686.712 µs) : 0, 687
Remote Config [candidate] (661.234 µs) : 0, 661
Telemetry [baseline] (9.067 ms) : 0, 9067
Telemetry [candidate] (8.733 ms) : 0, 8733
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (832.071 ms) : 0, 832071
BytebuddyAgent [candidate] (832.189 ms) : 0, 832189
GlobalTracer [baseline] (246.163 ms) : 0, 246163
GlobalTracer [candidate] (246.865 ms) : 0, 246865
AppSec [baseline] (58.014 ms) : 0, 58014
AppSec [candidate] (58.2 ms) : 0, 58200
IAST [baseline] (21.522 ms) : 0, 21522
IAST [candidate] (21.45 ms) : 0, 21450
Remote Config [baseline] (670.487 µs) : 0, 670
Remote Config [candidate] (660.064 µs) : 0, 660
Telemetry [baseline] (8.744 ms) : 0, 8744
Telemetry [candidate] (8.724 ms) : 0, 8724
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (829.363 ms) : 0, 829363
BytebuddyAgent [candidate] (827.999 ms) : 0, 827999
GlobalTracer [baseline] (246.904 ms) : 0, 246904
GlobalTracer [candidate] (245.889 ms) : 0, 245889
AppSec [baseline] (57.836 ms) : 0, 57836
AppSec [candidate] (58.089 ms) : 0, 58089
IAST [baseline] (20.919 ms) : 0, 20919
IAST [candidate] (20.828 ms) : 0, 20828
Remote Config [baseline] (655.53 µs) : 0, 656
Remote Config [candidate] (651.924 µs) : 0, 652
Telemetry [baseline] (8.613 ms) : 0, 8613
Telemetry [candidate] (8.57 ms) : 0, 8570
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-21T09:02:25 2025-01-21T09:09:27
git_branch master jb/jlinked_with_profiler
git_commit_date 1737449112 1737449553
git_commit_sha b63b852 3a6c3c0
release_version 1.46.0-SNAPSHOT~b63b852c6d 1.46.0-SNAPSHOT~3a6c3c0ddc
start_time 2025-01-21T09:02:11 2025-01-21T09:09:13
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737450923 1737450923
ci_job_id 773485669 773485669
ci_pipeline_id 53523571 53523571
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.357 ms) : 1337, 1376
.   : milestone, 1357,
appsec (1.734 ms) : 1710, 1758
.   : milestone, 1734,
appsec_no_iast (1.752 ms) : 1729, 1774
.   : milestone, 1752,
iast (1.508 ms) : 1482, 1533
.   : milestone, 1508,
profiling (1.489 ms) : 1464, 1513
.   : milestone, 1489,
tracing (1.483 ms) : 1459, 1507
.   : milestone, 1483,
section candidate
no_agent (1.338 ms) : 1318, 1359
.   : milestone, 1338,
appsec (1.745 ms) : 1722, 1769
.   : milestone, 1745,
appsec_no_iast (1.744 ms) : 1719, 1769
.   : milestone, 1744,
iast (1.504 ms) : 1479, 1528
.   : milestone, 1504,
profiling (1.511 ms) : 1487, 1534
.   : milestone, 1511,
tracing (1.49 ms) : 1465, 1516
.   : milestone, 1490,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.357 ms [1.337 ms, 1.376 ms] -
appsec 1.734 ms [1.71 ms, 1.758 ms] 376.83 µs (27.8%)
appsec_no_iast 1.752 ms [1.729 ms, 1.774 ms] 395.142 µs (29.1%)
iast 1.508 ms [1.482 ms, 1.533 ms] 151.085 µs (11.1%)
profiling 1.489 ms [1.464 ms, 1.513 ms] 131.929 µs (9.7%)
tracing 1.483 ms [1.459 ms, 1.507 ms] 125.913 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.338 ms [1.318 ms, 1.359 ms] -
appsec 1.745 ms [1.722 ms, 1.769 ms] 406.983 µs (30.4%)
appsec_no_iast 1.744 ms [1.719 ms, 1.769 ms] 405.387 µs (30.3%)
iast 1.504 ms [1.479 ms, 1.528 ms] 165.313 µs (12.4%)
profiling 1.511 ms [1.487 ms, 1.534 ms] 172.146 µs (12.9%)
tracing 1.49 ms [1.465 ms, 1.516 ms] 151.964 µs (11.4%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (370.941 µs) : 351, 391
.   : milestone, 371,
iast (497.705 µs) : 476, 520
.   : milestone, 498,
iast_FULL (735.786 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (556.488 µs) : 533, 580
.   : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (496.603 µs) : 475, 518
.   : milestone, 497,
iast_INACTIVE (458.497 µs) : 436, 481
.   : milestone, 458,
iast_TELEMETRY_OFF (485.014 µs) : 464, 506
.   : milestone, 485,
tracing (449.546 µs) : 428, 471
.   : milestone, 450,
section candidate
no_agent (377.849 µs) : 358, 397
.   : milestone, 378,
iast (500.756 µs) : 479, 523
.   : milestone, 501,
iast_FULL (733.174 µs) : 711, 755
.   : milestone, 733,
iast_GLOBAL (547.559 µs) : 526, 570
.   : milestone, 548,
iast_HARDCODED_SECRET_DISABLED (500.58 µs) : 479, 523
.   : milestone, 501,
iast_INACTIVE (451.523 µs) : 430, 473
.   : milestone, 452,
iast_TELEMETRY_OFF (490.647 µs) : 469, 513
.   : milestone, 491,
tracing (445.439 µs) : 425, 466
.   : milestone, 445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.941 µs [351.348 µs, 390.535 µs] -
iast 497.705 µs [475.89 µs, 519.521 µs] 126.764 µs (34.2%)
iast_FULL 735.786 µs [713.925 µs, 757.648 µs] 364.845 µs (98.4%)
iast_GLOBAL 556.488 µs [532.555 µs, 580.422 µs] 185.547 µs (50.0%)
iast_HARDCODED_SECRET_DISABLED 496.603 µs [474.963 µs, 518.242 µs] 125.661 µs (33.9%)
iast_INACTIVE 458.497 µs [436.258 µs, 480.736 µs] 87.556 µs (23.6%)
iast_TELEMETRY_OFF 485.014 µs [463.531 µs, 506.497 µs] 114.073 µs (30.8%)
tracing 449.546 µs [428.253 µs, 470.84 µs] 78.605 µs (21.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.849 µs [358.366 µs, 397.332 µs] -
iast 500.756 µs [478.568 µs, 522.944 µs] 122.906 µs (32.5%)
iast_FULL 733.174 µs [711.265 µs, 755.083 µs] 355.325 µs (94.0%)
iast_GLOBAL 547.559 µs [525.535 µs, 569.584 µs] 169.71 µs (44.9%)
iast_HARDCODED_SECRET_DISABLED 500.58 µs [478.618 µs, 522.543 µs] 122.731 µs (32.5%)
iast_INACTIVE 451.523 µs [429.805 µs, 473.24 µs] 73.673 µs (19.5%)
iast_TELEMETRY_OFF 490.647 µs [468.679 µs, 512.616 µs] 112.798 µs (29.9%)
tracing 445.439 µs [424.902 µs, 465.977 µs] 67.59 µs (17.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/jlinked_with_profiler
git_commit_date 1737449112 1737449553
git_commit_sha b63b852 3a6c3c0
release_version 1.46.0-SNAPSHOT~b63b852c6d 1.46.0-SNAPSHOT~3a6c3c0ddc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737451591 1737451591
ci_job_id 773485670 773485670
ci_pipeline_id 53523571 53523571
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
appsec (15.134 s) : 15134000, 15134000
.   : milestone, 15134000,
iast (19.031 s) : 19031000, 19031000
.   : milestone, 19031000,
iast_GLOBAL (18.147 s) : 18147000, 18147000
.   : milestone, 18147000,
profiling (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
tracing (14.95 s) : 14950000, 14950000
.   : milestone, 14950000,
section candidate
no_agent (14.856 s) : 14856000, 14856000
.   : milestone, 14856000,
appsec (15.165 s) : 15165000, 15165000
.   : milestone, 15165000,
iast (18.949 s) : 18949000, 18949000
.   : milestone, 18949000,
iast_GLOBAL (17.846 s) : 17846000, 17846000
.   : milestone, 17846000,
profiling (15.288 s) : 15288000, 15288000
.   : milestone, 15288000,
tracing (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.036 s [15.036 s, 15.036 s] -
appsec 15.134 s [15.134 s, 15.134 s] 98.0 ms (0.7%)
iast 19.031 s [19.031 s, 19.031 s] 3.995 s (26.6%)
iast_GLOBAL 18.147 s [18.147 s, 18.147 s] 3.111 s (20.7%)
profiling 15.006 s [15.006 s, 15.006 s] -30.0 ms (-0.2%)
tracing 14.95 s [14.95 s, 14.95 s] -86.0 ms (-0.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.856 s [14.856 s, 14.856 s] -
appsec 15.165 s [15.165 s, 15.165 s] 309.0 ms (2.1%)
iast 18.949 s [18.949 s, 18.949 s] 4.093 s (27.6%)
iast_GLOBAL 17.846 s [17.846 s, 17.846 s] 2.99 s (20.1%)
profiling 15.288 s [15.288 s, 15.288 s] 432.0 ms (2.9%)
tracing 14.998 s [14.998 s, 14.998 s] 142.0 ms (1.0%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~3a6c3c0ddc, baseline=1.46.0-SNAPSHOT~b63b852c6d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.37 ms) : 2326, 2413
.   : milestone, 2370,
iast (2.107 ms) : 2053, 2162
.   : milestone, 2107,
iast_GLOBAL (2.151 ms) : 2097, 2206
.   : milestone, 2151,
profiling (1.958 ms) : 1915, 2001
.   : milestone, 1958,
tracing (1.947 ms) : 1904, 1989
.   : milestone, 1947,
section candidate
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.367 ms) : 2324, 2410
.   : milestone, 2367,
iast (2.108 ms) : 2054, 2163
.   : milestone, 2108,
iast_GLOBAL (2.151 ms) : 2096, 2205
.   : milestone, 2151,
profiling (1.968 ms) : 1924, 2012
.   : milestone, 1968,
tracing (1.955 ms) : 1913, 1997
.   : milestone, 1955,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.37 ms [2.326 ms, 2.413 ms] 897.269 µs (60.9%)
iast 2.107 ms [2.053 ms, 2.162 ms] 635.123 µs (43.1%)
iast_GLOBAL 2.151 ms [2.097 ms, 2.206 ms] 679.137 µs (46.1%)
profiling 1.958 ms [1.915 ms, 2.001 ms] 485.757 µs (33.0%)
tracing 1.947 ms [1.904 ms, 1.989 ms] 474.198 µs (32.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 2.367 ms [2.324 ms, 2.41 ms] 899.391 µs (61.3%)
iast 2.108 ms [2.054 ms, 2.163 ms] 640.705 µs (43.7%)
iast_GLOBAL 2.151 ms [2.096 ms, 2.205 ms] 683.055 µs (46.5%)
profiling 1.968 ms [1.924 ms, 2.012 ms] 500.297 µs (34.1%)
tracing 1.955 ms [1.913 ms, 1.997 ms] 487.005 µs (33.2%)

@jbachorik jbachorik added type: bug Bug report and fix and removed type:task labels Jan 21, 2025
@jbachorik jbachorik merged commit 01c83aa into master Jan 21, 2025
@jbachorik jbachorik deleted the jb/jlinked_with_profiler branch January 21, 2025 09:58
@github-actions github-actions Bot added this to the 1.46.0 milestone Jan 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: profiling Profiling tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants