Skip to content

Log a warning when profiling enablement is misconfigured.#7511

Merged
jbachorik merged 1 commit intomasterfrom
jb/profiling_enablement_warning
Aug 26, 2024
Merged

Log a warning when profiling enablement is misconfigured.#7511
jbachorik merged 1 commit intomasterfrom
jb/profiling_enablement_warning

Conversation

@jbachorik
Copy link
Copy Markdown
Contributor

@jbachorik jbachorik commented Aug 26, 2024 •
edited by atlassian Bot
Loading

What Does This Do

It validates the profiler enablement config and emits a warning when it is not on of the expected values.

Motivation

We can see that there are users with accidentally misconfigured profiler enablement. This is to help them to identify and fix the problem.

Additional Notes

Contributor Checklist

Jira ticket: PROF-10402

@jbachorik jbachorik added the comp: profiling Profiling label Aug 26, 2024
@jbachorik jbachorik requested a review from a team as a code owner August 26, 2024 13:26
@jbachorik jbachorik requested a review from ygree August 26, 2024 13:26
@jbachorik jbachorik force-pushed the jb/profiling_enablement_warning branch from 8adf0fa to b286d99 Compare August 26, 2024 13:42
@jbachorik jbachorik requested a review from a team as a code owner August 26, 2024 13:42
@jbachorik jbachorik enabled auto-merge (squash) August 26, 2024 13:50
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Aug 26, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/profiling_enablement_warning
git_commit_date 1724659573 1724678143
git_commit_sha 074bc9b 8adf0fa90f
release_version 1.39.0-SNAPSHOT~074bc9bc4e 1.39.0-SNAPSHOT~8adf0fa90f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724680993 1724680993
ci_job_id 616870529 616870529
ci_pipeline_id 42804425 42804425
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 13 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:AppSec better
[-7.217ms; -1.914ms] or [-13.131%; -3.482%]		 50.398ms 54.964ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054867
Total [baseline] (8.509 s) : 0, 8509178
Agent [candidate] (1.056 s) : 0, 1055977
Total [candidate] (8.512 s) : 0, 8512311
section iast
Agent [baseline] (1.179 s) : 0, 1178821
Total [baseline] (8.993 s) : 0, 8993471
Agent [candidate] (1.171 s) : 0, 1170913
Total [candidate] (8.961 s) : 0, 8960833
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.178 s) : 0, 1177856
Total [baseline] (8.971 s) : 0, 8971378
Agent [candidate] (1.177 s) : 0, 1177380
Total [candidate] (8.933 s) : 0, 8932770
section iast_TELEMETRY_OFF
Agent [baseline] (1.183 s) : 0, 1182886
Total [baseline] (8.999 s) : 0, 8998762
Agent [candidate] (1.176 s) : 0, 1175857
Total [candidate] (8.957 s) : 0, 8957138
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.179 s 123.954 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 122.989 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.183 s 128.019 ms (12.1%)
Total tracing 8.509 s -
Total iast 8.993 s 484.294 ms (5.7%)
Total iast_HARDCODED_SECRET_DISABLED 8.971 s 462.201 ms (5.4%)
Total iast_TELEMETRY_OFF 8.999 s 489.584 ms (5.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.171 s 114.936 ms (10.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.177 s 121.403 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.176 s 119.88 ms (11.4%)
Total tracing 8.512 s -
Total iast 8.961 s 448.522 ms (5.3%)
Total iast_HARDCODED_SECRET_DISABLED 8.933 s 420.459 ms (4.9%)
Total iast_TELEMETRY_OFF 8.957 s 444.827 ms (5.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.844 ms) : 0, 672844
BytebuddyAgent [candidate] (674.028 ms) : 0, 674028
GlobalTracer [baseline] (308.619 ms) : 0, 308619
GlobalTracer [candidate] (308.199 ms) : 0, 308199
AppSec [baseline] (51.638 ms) : 0, 51638
AppSec [candidate] (51.749 ms) : 0, 51749
Remote Config [baseline] (673.695 µs) : 0, 674
Remote Config [candidate] (690.51 µs) : 0, 691
Telemetry [baseline] (7.55 ms) : 0, 7550
Telemetry [candidate] (7.65 ms) : 0, 7650
section iast
BytebuddyAgent [baseline] (783.042 ms) : 0, 783042
BytebuddyAgent [candidate] (777.714 ms) : 0, 777714
GlobalTracer [baseline] (297.49 ms) : 0, 297490
GlobalTracer [candidate] (295.831 ms) : 0, 295831
AppSec [baseline] (54.964 ms) : 0, 54964
AppSec [candidate] (50.398 ms) : 0, 50398
IAST [baseline] (21.207 ms) : 0, 21207
IAST [candidate] (25.616 ms) : 0, 25616
Remote Config [baseline] (593.767 µs) : 0, 594
Remote Config [candidate] (592.319 µs) : 0, 592
Telemetry [baseline] (8.003 ms) : 0, 8003
Telemetry [candidate] (7.206 ms) : 0, 7206
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (783.749 ms) : 0, 783749
BytebuddyAgent [candidate] (782.065 ms) : 0, 782065
GlobalTracer [baseline] (296.837 ms) : 0, 296837
GlobalTracer [candidate] (297.126 ms) : 0, 297126
AppSec [baseline] (49.002 ms) : 0, 49002
AppSec [candidate] (49.164 ms) : 0, 49164
IAST [baseline] (25.388 ms) : 0, 25388
IAST [candidate] (25.202 ms) : 0, 25202
Remote Config [baseline] (593.175 µs) : 0, 593
Remote Config [candidate] (602.619 µs) : 0, 603
Telemetry [baseline] (8.707 ms) : 0, 8707
Telemetry [candidate] (9.568 ms) : 0, 9568
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (784.671 ms) : 0, 784671
BytebuddyAgent [candidate] (780.365 ms) : 0, 780365
GlobalTracer [baseline] (299.414 ms) : 0, 299414
GlobalTracer [candidate] (297.806 ms) : 0, 297806
AppSec [baseline] (50.653 ms) : 0, 50653
AppSec [candidate] (49.084 ms) : 0, 49084
IAST [baseline] (23.675 ms) : 0, 23675
IAST [candidate] (24.282 ms) : 0, 24282
Remote Config [baseline] (604.683 µs) : 0, 605
Remote Config [candidate] (604.079 µs) : 0, 604
Telemetry [baseline] (10.329 ms) : 0, 10329
Telemetry [candidate] (10.055 ms) : 0, 10055
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057781
Total [baseline] (10.472 s) : 0, 10471869
Agent [candidate] (1.053 s) : 0, 1052921
Total [candidate] (10.406 s) : 0, 10406335
section appsec
Agent [baseline] (1.17 s) : 0, 1169714
Total [baseline] (10.445 s) : 0, 10445012
Agent [candidate] (1.171 s) : 0, 1170704
Total [candidate] (10.399 s) : 0, 10399395
section iast
Agent [baseline] (1.175 s) : 0, 1174789
Total [baseline] (10.801 s) : 0, 10801222
Agent [candidate] (1.183 s) : 0, 1183269
Total [candidate] (10.87 s) : 0, 10869937
section profiling
Agent [baseline] (1.256 s) : 0, 1256077
Total [baseline] (10.54 s) : 0, 10539564
Agent [candidate] (1.245 s) : 0, 1244504
Total [candidate] (10.639 s) : 0, 10639065
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.17 s 111.933 ms (10.6%)
Agent iast 1.175 s 117.009 ms (11.1%)
Agent profiling 1.256 s 198.297 ms (18.7%)
Total tracing 10.472 s -
Total appsec 10.445 s -26.858 ms (-0.3%)
Total iast 10.801 s 329.353 ms (3.1%)
Total profiling 10.54 s 67.695 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.171 s 117.783 ms (11.2%)
Agent iast 1.183 s 130.348 ms (12.4%)
Agent profiling 1.245 s 191.584 ms (18.2%)
Total tracing 10.406 s -
Total appsec 10.399 s -6.94 ms (-0.1%)
Total iast 10.87 s 463.603 ms (4.5%)
Total profiling 10.639 s 232.73 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (675.149 ms) : 0, 675149
BytebuddyAgent [candidate] (672.072 ms) : 0, 672072
GlobalTracer [baseline] (309.07 ms) : 0, 309070
GlobalTracer [candidate] (307.668 ms) : 0, 307668
AppSec [baseline] (51.868 ms) : 0, 51868
AppSec [candidate] (51.477 ms) : 0, 51477
Remote Config [baseline] (671.022 µs) : 0, 671
Remote Config [candidate] (666.416 µs) : 0, 666
Telemetry [baseline] (7.494 ms) : 0, 7494
Telemetry [candidate] (7.465 ms) : 0, 7465
section appsec
BytebuddyAgent [baseline] (679.463 ms) : 0, 679463
BytebuddyAgent [candidate] (678.92 ms) : 0, 678920
GlobalTracer [baseline] (300.33 ms) : 0, 300330
GlobalTracer [candidate] (299.902 ms) : 0, 299902
AppSec [baseline] (159.261 ms) : 0, 159261
AppSec [candidate] (161.067 ms) : 0, 161067
Remote Config [baseline] (618.801 µs) : 0, 619
Remote Config [candidate] (642.49 µs) : 0, 642
Telemetry [baseline] (7.44 ms) : 0, 7440
Telemetry [candidate] (7.388 ms) : 0, 7388
IAST [baseline] (18.245 ms) : 0, 18245
IAST [candidate] (18.455 ms) : 0, 18455
section iast
BytebuddyAgent [baseline] (780.425 ms) : 0, 780425
BytebuddyAgent [candidate] (785.469 ms) : 0, 785469
GlobalTracer [baseline] (296.759 ms) : 0, 296759
GlobalTracer [candidate] (298.602 ms) : 0, 298602
AppSec [baseline] (50.874 ms) : 0, 50874
AppSec [candidate] (53.283 ms) : 0, 53283
Remote Config [baseline] (573.152 µs) : 0, 573
Remote Config [candidate] (610.335 µs) : 0, 610
Telemetry [baseline] (7.777 ms) : 0, 7777
Telemetry [candidate] (10.387 ms) : 0, 10387
IAST [baseline] (24.855 ms) : 0, 24855
IAST [candidate] (21.245 ms) : 0, 21245
section profiling
BytebuddyAgent [baseline] (669.049 ms) : 0, 669049
BytebuddyAgent [candidate] (662.534 ms) : 0, 662534
GlobalTracer [baseline] (391.483 ms) : 0, 391483
GlobalTracer [candidate] (388.636 ms) : 0, 388636
AppSec [baseline] (52.574 ms) : 0, 52574
AppSec [candidate] (52.246 ms) : 0, 52246
Remote Config [baseline] (688.867 µs) : 0, 689
Remote Config [candidate] (678.039 µs) : 0, 678
Telemetry [baseline] (7.427 ms) : 0, 7427
Telemetry [candidate] (7.301 ms) : 0, 7301
ProfilingAgent [baseline] (97.275 ms) : 0, 97275
ProfilingAgent [candidate] (95.84 ms) : 0, 95840
Profiling [baseline] (97.299 ms) : 0, 97299
Profiling [candidate] (95.863 ms) : 0, 95863
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-26T13:31:48 2024-08-26T13:38:37
git_branch master jb/profiling_enablement_warning
git_commit_date 1724659573 1724678143
git_commit_sha 074bc9b 8adf0fa90f
release_version 1.39.0-SNAPSHOT~074bc9bc4e 1.39.0-SNAPSHOT~8adf0fa90f
start_time 2024-08-26T13:31:35 2024-08-26T13:38:23
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724679860 1724679860
ci_job_id 616870530 616870530
ci_pipeline_id 42804425 42804425
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 19 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.333 ms) : 1314, 1352
.   : milestone, 1333,
appsec (1.715 ms) : 1690, 1740
.   : milestone, 1715,
appsec_no_iast (1.737 ms) : 1713, 1761
.   : milestone, 1737,
iast (1.465 ms) : 1442, 1488
.   : milestone, 1465,
profiling (1.488 ms) : 1463, 1514
.   : milestone, 1488,
tracing (1.446 ms) : 1421, 1471
.   : milestone, 1446,
section candidate
no_agent (1.332 ms) : 1312, 1352
.   : milestone, 1332,
appsec (1.718 ms) : 1693, 1742
.   : milestone, 1718,
appsec_no_iast (1.716 ms) : 1691, 1741
.   : milestone, 1716,
iast (1.474 ms) : 1451, 1496
.   : milestone, 1474,
profiling (1.484 ms) : 1459, 1508
.   : milestone, 1484,
tracing (1.457 ms) : 1433, 1482
.   : milestone, 1457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.333 ms [1.314 ms, 1.352 ms] -
appsec 1.715 ms [1.69 ms, 1.74 ms] 381.866 µs (28.6%)
appsec_no_iast 1.737 ms [1.713 ms, 1.761 ms] 404.128 µs (30.3%)
iast 1.465 ms [1.442 ms, 1.488 ms] 132.11 µs (9.9%)
profiling 1.488 ms [1.463 ms, 1.514 ms] 155.402 µs (11.7%)
tracing 1.446 ms [1.421 ms, 1.471 ms] 113.376 µs (8.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.332 ms [1.312 ms, 1.352 ms] -
appsec 1.718 ms [1.693 ms, 1.742 ms] 385.592 µs (28.9%)
appsec_no_iast 1.716 ms [1.691 ms, 1.741 ms] 383.969 µs (28.8%)
iast 1.474 ms [1.451 ms, 1.496 ms] 141.416 µs (10.6%)
profiling 1.484 ms [1.459 ms, 1.508 ms] 151.646 µs (11.4%)
tracing 1.457 ms [1.433 ms, 1.482 ms] 125.198 µs (9.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e
    dateFormat X
    axisFormat %s
section baseline
no_agent (366.259 µs) : 347, 386
.   : milestone, 366,
iast (485.293 µs) : 463, 508
.   : milestone, 485,
iast_FULL (551.821 µs) : 531, 573
.   : milestone, 552,
iast_GLOBAL (501.81 µs) : 481, 523
.   : milestone, 502,
iast_HARDCODED_SECRET_DISABLED (486.484 µs) : 464, 509
.   : milestone, 486,
iast_INACTIVE (443.648 µs) : 423, 465
.   : milestone, 444,
iast_TELEMETRY_OFF (474.277 µs) : 452, 497
.   : milestone, 474,
tracing (435.59 µs) : 416, 456
.   : milestone, 436,
section candidate
no_agent (367.91 µs) : 348, 387
.   : milestone, 368,
iast (484.152 µs) : 461, 507
.   : milestone, 484,
iast_FULL (553.982 µs) : 532, 575
.   : milestone, 554,
iast_GLOBAL (516.707 µs) : 494, 539
.   : milestone, 517,
iast_HARDCODED_SECRET_DISABLED (479.992 µs) : 458, 502
.   : milestone, 480,
iast_INACTIVE (447.367 µs) : 426, 469
.   : milestone, 447,
iast_TELEMETRY_OFF (472.376 µs) : 449, 495
.   : milestone, 472,
tracing (442.964 µs) : 422, 464
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 366.259 µs [346.628 µs, 385.891 µs] -
iast 485.293 µs [462.839 µs, 507.746 µs] 119.033 µs (32.5%)
iast_FULL 551.821 µs [530.578 µs, 573.063 µs] 185.561 µs (50.7%)
iast_GLOBAL 501.81 µs [480.589 µs, 523.03 µs] 135.55 µs (37.0%)
iast_HARDCODED_SECRET_DISABLED 486.484 µs [463.691 µs, 509.277 µs] 120.225 µs (32.8%)
iast_INACTIVE 443.648 µs [422.641 µs, 464.655 µs] 77.388 µs (21.1%)
iast_TELEMETRY_OFF 474.277 µs [451.506 µs, 497.047 µs] 108.017 µs (29.5%)
tracing 435.59 µs [415.572 µs, 455.609 µs] 69.331 µs (18.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 367.91 µs [348.5 µs, 387.32 µs] -
iast 484.152 µs [461.258 µs, 507.046 µs] 116.242 µs (31.6%)
iast_FULL 553.982 µs [532.498 µs, 575.466 µs] 186.072 µs (50.6%)
iast_GLOBAL 516.707 µs [493.919 µs, 539.494 µs] 148.797 µs (40.4%)
iast_HARDCODED_SECRET_DISABLED 479.992 µs [457.703 µs, 502.282 µs] 112.082 µs (30.5%)
iast_INACTIVE 447.367 µs [426.087 µs, 468.648 µs] 79.457 µs (21.6%)
iast_TELEMETRY_OFF 472.376 µs [449.328 µs, 495.423 µs] 104.466 µs (28.4%)
tracing 442.964 µs [422.205 µs, 463.723 µs] 75.054 µs (20.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/profiling_enablement_warning
git_commit_date 1724659573 1724678143
git_commit_sha 074bc9b 8adf0fa90f
release_version 1.39.0-SNAPSHOT~074bc9bc4e 1.39.0-SNAPSHOT~8adf0fa90f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1724680377 1724680377
ci_job_id 616870531 616870531
ci_pipeline_id 42804425 42804425
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.505 s) : 15505000, 15505000
.   : milestone, 15505000,
appsec (15.098 s) : 15098000, 15098000
.   : milestone, 15098000,
iast (18.704 s) : 18704000, 18704000
.   : milestone, 18704000,
iast_GLOBAL (17.676 s) : 17676000, 17676000
.   : milestone, 17676000,
profiling (15.929 s) : 15929000, 15929000
.   : milestone, 15929000,
tracing (15.152 s) : 15152000, 15152000
.   : milestone, 15152000,
section candidate
no_agent (15.324 s) : 15324000, 15324000
.   : milestone, 15324000,
appsec (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
iast (18.711 s) : 18711000, 18711000
.   : milestone, 18711000,
iast_GLOBAL (17.917 s) : 17917000, 17917000
.   : milestone, 17917000,
profiling (15.276 s) : 15276000, 15276000
.   : milestone, 15276000,
tracing (15.263 s) : 15263000, 15263000
.   : milestone, 15263000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.505 s [15.505 s, 15.505 s] -
appsec 15.098 s [15.098 s, 15.098 s] -407.0 ms (-2.6%)
iast 18.704 s [18.704 s, 18.704 s] 3.199 s (20.6%)
iast_GLOBAL 17.676 s [17.676 s, 17.676 s] 2.171 s (14.0%)
profiling 15.929 s [15.929 s, 15.929 s] 424.0 ms (2.7%)
tracing 15.152 s [15.152 s, 15.152 s] -353.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.324 s [15.324 s, 15.324 s] -
appsec 14.965 s [14.965 s, 14.965 s] -359.0 ms (-2.3%)
iast 18.711 s [18.711 s, 18.711 s] 3.387 s (22.1%)
iast_GLOBAL 17.917 s [17.917 s, 17.917 s] 2.593 s (16.9%)
profiling 15.276 s [15.276 s, 15.276 s] -48.0 ms (-0.3%)
tracing 15.263 s [15.263 s, 15.263 s] -61.0 ms (-0.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~8adf0fa90f, baseline=1.39.0-SNAPSHOT~074bc9bc4e
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.452 ms) : 1441, 1464
.   : milestone, 1452,
appsec (2.224 ms) : 2189, 2259
.   : milestone, 2224,
iast (1.958 ms) : 1915, 2000
.   : milestone, 1958,
iast_GLOBAL (2.018 ms) : 1974, 2063
.   : milestone, 2018,
profiling (1.856 ms) : 1822, 1891
.   : milestone, 1856,
tracing (1.829 ms) : 1797, 1862
.   : milestone, 1829,
section candidate
no_agent (1.456 ms) : 1445, 1468
.   : milestone, 1456,
appsec (2.222 ms) : 2187, 2257
.   : milestone, 2222,
iast (1.958 ms) : 1916, 2000
.   : milestone, 1958,
iast_GLOBAL (2.008 ms) : 1964, 2051
.   : milestone, 2008,
profiling (1.857 ms) : 1822, 1892
.   : milestone, 1857,
tracing (1.842 ms) : 1809, 1876
.   : milestone, 1842,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.452 ms [1.441 ms, 1.464 ms] -
appsec 2.224 ms [2.189 ms, 2.259 ms] 771.787 µs (53.1%)
iast 1.958 ms [1.915 ms, 2.0 ms] 505.251 µs (34.8%)
iast_GLOBAL 2.018 ms [1.974 ms, 2.063 ms] 565.908 µs (39.0%)
profiling 1.856 ms [1.822 ms, 1.891 ms] 403.83 µs (27.8%)
tracing 1.829 ms [1.797 ms, 1.862 ms] 376.907 µs (25.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.456 ms [1.445 ms, 1.468 ms] -
appsec 2.222 ms [2.187 ms, 2.257 ms] 766.159 µs (52.6%)
iast 1.958 ms [1.916 ms, 2.0 ms] 501.82 µs (34.5%)
iast_GLOBAL 2.008 ms [1.964 ms, 2.051 ms] 551.399 µs (37.9%)
profiling 1.857 ms [1.822 ms, 1.892 ms] 400.823 µs (27.5%)
tracing 1.842 ms [1.809 ms, 1.876 ms] 386.018 µs (26.5%)

@jbachorik jbachorik merged commit 40f624d into master Aug 26, 2024
@jbachorik jbachorik deleted the jb/profiling_enablement_warning branch August 26, 2024 14:17
@github-actions github-actions Bot added this to the 1.39.0 milestone Aug 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@manuel-alvarez-alvarez manuel-alvarez-alvarez manuel-alvarez-alvarez approved these changes

@amarziali amarziali amarziali approved these changes

@ygree ygree Awaiting requested review from ygree ygree is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: profiling Profiling

Projects

None yet

Milestone

1.39.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jbachorik @manuel-alvarez-alvarez @amarziali