Skip to content

Check for JFP override file in flare when appropriate#9479

Merged
MattAlp merged 2 commits intomasterfrom
mattalp/greater-profile-flare-test-cov
Sep 5, 2025
Merged

Check for JFP override file in flare when appropriate#9479
MattAlp merged 2 commits intomasterfrom
mattalp/greater-profile-flare-test-cov

Conversation

@MattAlp
Copy link
Copy Markdown

@MattAlp MattAlp commented Sep 5, 2025 •
edited by atlassian Bot
Loading

What Does This Do

Extends the flare smoke testing to consider whether or not we've provided a JFP template override to the profiler

Motivation

Better coverage of flare reporting functionality + improving correctness

Additional Notes

Contributor Checklist

Jira ticket: PROF-12436

@MattAlp MattAlp requested a review from a team as a code owner September 5, 2025 16:54
@MattAlp MattAlp added the type: enhancement Enhancements and improvements label Sep 5, 2025
@MattAlp MattAlp requested a review from smola September 5, 2025 16:54
@MattAlp MattAlp added comp: testing Testing tag: no release notes Changes to exclude from release notes run-tests: oracle8 Run tests using Oracle 8 JDK labels Sep 5, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Sep 5, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/greater-profile-flare-test-cov
git_commit_date 1757084909 1757091858
git_commit_sha 4abe3ff d95abb0
release_version 1.54.0-SNAPSHOT~4abe3ff9a9 1.54.0-SNAPSHOT~d95abb0eac
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757093656 1757093656
ci_job_id 1116234954 1116234954
ci_pipeline_id 75683238 75683238
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-yweiy6km 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-yweiy6km 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052484
Total [baseline] (10.663 s) : 0, 10662985
Agent [candidate] (1.062 s) : 0, 1062293
Total [candidate] (10.847 s) : 0, 10846620
section appsec
Agent [baseline] (1.223 s) : 0, 1222759
Total [baseline] (10.856 s) : 0, 10856076
Agent [candidate] (1.223 s) : 0, 1222577
Total [candidate] (10.803 s) : 0, 10802808
section iast
Agent [baseline] (1.181 s) : 0, 1180817
Total [baseline] (10.947 s) : 0, 10947164
Agent [candidate] (1.183 s) : 0, 1183496
Total [candidate] (11.02 s) : 0, 11019973
section profiling
Agent [baseline] (1.2 s) : 0, 1199933
Total [baseline] (10.886 s) : 0, 10886217
Agent [candidate] (1.202 s) : 0, 1201914
Total [candidate] (10.958 s) : 0, 10957841
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.223 s 170.275 ms (16.2%)
Agent iast 1.181 s 128.333 ms (12.2%)
Agent profiling 1.2 s 147.449 ms (14.0%)
Total tracing 10.663 s -
Total appsec 10.856 s 193.09 ms (1.8%)
Total iast 10.947 s 284.178 ms (2.7%)
Total profiling 10.886 s 223.232 ms (2.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.223 s 160.283 ms (15.1%)
Agent iast 1.183 s 121.203 ms (11.4%)
Agent profiling 1.202 s 139.62 ms (13.1%)
Total tracing 10.847 s -
Total appsec 10.803 s -43.813 ms (-0.4%)
Total iast 11.02 s 173.352 ms (1.6%)
Total profiling 10.958 s 111.221 ms (1.0%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (735.639 ms) : 0, 735639
BytebuddyAgent [candidate] (741.788 ms) : 0, 741788
GlobalTracer [baseline] (243.573 ms) : 0, 243573
GlobalTracer [candidate] (246.269 ms) : 0, 246269
AppSec [baseline] (30.115 ms) : 0, 30115
AppSec [candidate] (30.685 ms) : 0, 30685
Debugger [baseline] (6.067 ms) : 0, 6067
Debugger [candidate] (6.124 ms) : 0, 6124
Remote Config [baseline] (700.588 µs) : 0, 701
Remote Config [candidate] (699.914 µs) : 0, 700
Telemetry [baseline] (13.713 ms) : 0, 13713
Telemetry [candidate] (13.944 ms) : 0, 13944
section appsec
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (754.993 ms) : 0, 754993
BytebuddyAgent [candidate] (755.093 ms) : 0, 755093
GlobalTracer [baseline] (235.246 ms) : 0, 235246
GlobalTracer [candidate] (235.247 ms) : 0, 235247
IAST [baseline] (23.651 ms) : 0, 23651
IAST [candidate] (23.595 ms) : 0, 23595
AppSec [baseline] (170.039 ms) : 0, 170039
AppSec [candidate] (168.865 ms) : 0, 168865
Debugger [baseline] (7.215 ms) : 0, 7215
Debugger [candidate] (8.114 ms) : 0, 8114
Remote Config [baseline] (623.63 µs) : 0, 624
Remote Config [candidate] (640.697 µs) : 0, 641
Telemetry [baseline] (8.493 ms) : 0, 8493
Telemetry [candidate] (8.481 ms) : 0, 8481
section iast
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (852.487 ms) : 0, 852487
BytebuddyAgent [candidate] (853.883 ms) : 0, 853883
GlobalTracer [baseline] (233.394 ms) : 0, 233394
GlobalTracer [candidate] (234.25 ms) : 0, 234250
IAST [baseline] (31.659 ms) : 0, 31659
IAST [candidate] (29.268 ms) : 0, 29268
AppSec [baseline] (25.229 ms) : 0, 25229
AppSec [candidate] (27.91 ms) : 0, 27910
Debugger [baseline] (6.614 ms) : 0, 6614
Debugger [candidate] (6.607 ms) : 0, 6607
Remote Config [baseline] (596.786 µs) : 0, 597
Remote Config [candidate] (597.452 µs) : 0, 597
Telemetry [baseline] (8.245 ms) : 0, 8245
Telemetry [candidate] (8.399 ms) : 0, 8399
section profiling
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (762.923 ms) : 0, 762923
BytebuddyAgent [candidate] (765.123 ms) : 0, 765123
GlobalTracer [baseline] (223.191 ms) : 0, 223191
GlobalTracer [candidate] (222.725 ms) : 0, 222725
AppSec [baseline] (30.411 ms) : 0, 30411
AppSec [candidate] (30.444 ms) : 0, 30444
Debugger [baseline] (6.305 ms) : 0, 6305
Debugger [candidate] (6.287 ms) : 0, 6287
Remote Config [baseline] (730.174 µs) : 0, 730
Remote Config [candidate] (720.351 µs) : 0, 720
Telemetry [baseline] (15.786 ms) : 0, 15786
Telemetry [candidate] (16.303 ms) : 0, 16303
ProfilingAgent [baseline] (108.622 ms) : 0, 108622
ProfilingAgent [candidate] (107.72 ms) : 0, 107720
Profiling [baseline] (109.29 ms) : 0, 109290
Profiling [candidate] (108.395 ms) : 0, 108395
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052328
Total [baseline] (8.639 s) : 0, 8639482
Agent [candidate] (1.05 s) : 0, 1049650
Total [candidate] (8.66 s) : 0, 8659979
section iast
Agent [baseline] (1.177 s) : 0, 1177235
Total [baseline] (9.304 s) : 0, 9304444
Agent [candidate] (1.178 s) : 0, 1177952
Total [candidate] (9.342 s) : 0, 9342244
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent iast 1.177 s 124.907 ms (11.9%)
Total tracing 8.639 s -
Total iast 9.304 s 664.962 ms (7.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.178 s 128.303 ms (12.2%)
Total tracing 8.66 s -
Total iast 9.342 s 682.265 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (737.034 ms) : 0, 737034
BytebuddyAgent [candidate] (733.036 ms) : 0, 733036
GlobalTracer [baseline] (243.878 ms) : 0, 243878
GlobalTracer [candidate] (242.362 ms) : 0, 242362
AppSec [baseline] (30.412 ms) : 0, 30412
AppSec [candidate] (30.26 ms) : 0, 30260
Debugger [baseline] (6.131 ms) : 0, 6131
Debugger [candidate] (6.11 ms) : 0, 6110
Remote Config [baseline] (694.316 µs) : 0, 694
Remote Config [candidate] (696.447 µs) : 0, 696
Telemetry [baseline] (11.503 ms) : 0, 11503
Telemetry [candidate] (14.666 ms) : 0, 14666
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (850.312 ms) : 0, 850312
BytebuddyAgent [candidate] (850.391 ms) : 0, 850391
GlobalTracer [baseline] (232.417 ms) : 0, 232417
GlobalTracer [candidate] (232.655 ms) : 0, 232655
IAST [baseline] (28.509 ms) : 0, 28509
IAST [candidate] (29.356 ms) : 0, 29356
AppSec [baseline] (27.372 ms) : 0, 27372
AppSec [candidate] (27.517 ms) : 0, 27517
Debugger [baseline] (7.45 ms) : 0, 7450
Debugger [candidate] (6.616 ms) : 0, 6616
Remote Config [baseline] (600.383 µs) : 0, 600
Remote Config [candidate] (595.918 µs) : 0, 596
Telemetry [baseline] (8.17 ms) : 0, 8170
Telemetry [candidate] (8.262 ms) : 0, 8262
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/greater-profile-flare-test-cov
git_commit_date 1757084909 1757091858
git_commit_sha 4abe3ff d95abb0
release_version 1.54.0-SNAPSHOT~4abe3ff9a9 1.54.0-SNAPSHOT~d95abb0eac
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1757093334 1757093334
ci_job_id 1116234955 1116234955
ci_pipeline_id 75683238 75683238
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-9vrk2srr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-9vrk2srr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+266.190µs; +571.942µs] or [+3.095%; +6.651%]		 unstable
[-92.721op/s; +43.221op/s] or [-17.194%; +8.015%]		 9.019ms 514.500op/s 8.599ms 539.250op/s
scenario:load:insecure-bank:no_agent:high_load worse
[+187.688µs; +297.389µs] or [+4.447%; +7.046%]		 unstable
[-179.673op/s; +63.611op/s] or [-16.539%; +5.855%]		 4.464ms 1028.344op/s 4.221ms 1086.375op/s
scenario:load:petclinic:profiling:high_load better
[-3.610ms; -2.591ms] or [-7.081%; -5.081%]		 unstable
[-0.918op/s; +12.868op/s] or [-1.001%; +14.024%]		 47.886ms 97.737op/s 50.986ms 91.763op/s
scenario:load:petclinic:appsec:high_load worse
[+1.171ms; +2.128ms] or [+2.438%; +4.432%]		 unstable
[-9.876op/s; +3.551op/s] or [-10.136%; +3.644%]		 49.667ms 94.275op/s 48.018ms 97.438op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.532 ms) : 36241, 36823
.   : milestone, 36532,
appsec (48.018 ms) : 47590, 48446
.   : milestone, 48018,
code_origins (44.56 ms) : 44198, 44922
.   : milestone, 44560,
iast (44.709 ms) : 44326, 45093
.   : milestone, 44709,
profiling (50.986 ms) : 50494, 51478
.   : milestone, 50986,
tracing (44.63 ms) : 44259, 45002
.   : milestone, 44630,
section candidate
no_agent (37.382 ms) : 37083, 37681
.   : milestone, 37382,
appsec (49.667 ms) : 49206, 50128
.   : milestone, 49667,
code_origins (44.914 ms) : 44524, 45305
.   : milestone, 44914,
iast (44.237 ms) : 43851, 44622
.   : milestone, 44237,
profiling (47.886 ms) : 47431, 48341
.   : milestone, 47886,
tracing (44.841 ms) : 44464, 45217
.   : milestone, 44841,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.532 ms [36.241 ms, 36.823 ms] -
appsec 48.018 ms [47.59 ms, 48.446 ms] 11.485 ms (31.4%)
code_origins 44.56 ms [44.198 ms, 44.922 ms] 8.027 ms (22.0%)
iast 44.709 ms [44.326 ms, 45.093 ms] 8.177 ms (22.4%)
profiling 50.986 ms [50.494 ms, 51.478 ms] 14.454 ms (39.6%)
tracing 44.63 ms [44.259 ms, 45.002 ms] 8.098 ms (22.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.382 ms [37.083 ms, 37.681 ms] -
appsec 49.667 ms [49.206 ms, 50.128 ms] 12.285 ms (32.9%)
code_origins 44.914 ms [44.524 ms, 45.305 ms] 7.532 ms (20.1%)
iast 44.237 ms [43.851 ms, 44.622 ms] 6.854 ms (18.3%)
profiling 47.886 ms [47.431 ms, 48.341 ms] 10.504 ms (28.1%)
tracing 44.841 ms [44.464 ms, 45.217 ms] 7.459 ms (20.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.221 ms) : 4173, 4269
.   : milestone, 4221,
iast (9.213 ms) : 9064, 9361
.   : milestone, 9213,
iast_FULL (13.95 ms) : 13674, 14227
.   : milestone, 13950,
iast_GLOBAL (11.09 ms) : 10879, 11301
.   : milestone, 11090,
profiling (8.599 ms) : 8466, 8733
.   : milestone, 8599,
tracing (7.561 ms) : 7457, 7664
.   : milestone, 7561,
section candidate
no_agent (4.464 ms) : 4410, 4517
.   : milestone, 4464,
iast (9.345 ms) : 9190, 9499
.   : milestone, 9345,
iast_FULL (14.046 ms) : 13769, 14324
.   : milestone, 14046,
iast_GLOBAL (10.653 ms) : 10445, 10860
.   : milestone, 10653,
profiling (9.019 ms) : 8868, 9169
.   : milestone, 9019,
tracing (7.565 ms) : 7449, 7680
.   : milestone, 7565,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.221 ms [4.173 ms, 4.269 ms] -
iast 9.213 ms [9.064 ms, 9.361 ms] 4.992 ms (118.3%)
iast_FULL 13.95 ms [13.674 ms, 14.227 ms] 9.729 ms (230.5%)
iast_GLOBAL 11.09 ms [10.879 ms, 11.301 ms] 6.869 ms (162.7%)
profiling 8.599 ms [8.466 ms, 8.733 ms] 4.378 ms (103.7%)
tracing 7.561 ms [7.457 ms, 7.664 ms] 3.34 ms (79.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.464 ms [4.41 ms, 4.517 ms] -
iast 9.345 ms [9.19 ms, 9.499 ms] 4.881 ms (109.4%)
iast_FULL 14.046 ms [13.769 ms, 14.324 ms] 9.583 ms (214.7%)
iast_GLOBAL 10.653 ms [10.445 ms, 10.86 ms] 6.189 ms (138.7%)
profiling 9.019 ms [8.868 ms, 9.169 ms] 4.555 ms (102.0%)
tracing 7.565 ms [7.449 ms, 7.68 ms] 3.101 ms (69.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/greater-profile-flare-test-cov
git_commit_date 1757084909 1757091858
git_commit_sha 4abe3ff d95abb0
release_version 1.54.0-SNAPSHOT~4abe3ff9a9 1.54.0-SNAPSHOT~d95abb0eac
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1757093738 1757093738
ci_job_id 1116234956 1116234956
ci_pipeline_id 75683238 75683238
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-wuo57r19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-wuo57r19 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
appsec (14.973 s) : 14973000, 14973000
.   : milestone, 14973000,
iast (18.553 s) : 18553000, 18553000
.   : milestone, 18553000,
iast_GLOBAL (17.847 s) : 17847000, 17847000
.   : milestone, 17847000,
profiling (16.053 s) : 16053000, 16053000
.   : milestone, 16053000,
tracing (14.887 s) : 14887000, 14887000
.   : milestone, 14887000,
section candidate
no_agent (15.71 s) : 15710000, 15710000
.   : milestone, 15710000,
appsec (14.781 s) : 14781000, 14781000
.   : milestone, 14781000,
iast (18.112 s) : 18112000, 18112000
.   : milestone, 18112000,
iast_GLOBAL (17.759 s) : 17759000, 17759000
.   : milestone, 17759000,
profiling (15.63 s) : 15630000, 15630000
.   : milestone, 15630000,
tracing (15.079 s) : 15079000, 15079000
.   : milestone, 15079000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.995 s [14.995 s, 14.995 s] -
appsec 14.973 s [14.973 s, 14.973 s] -22.0 ms (-0.1%)
iast 18.553 s [18.553 s, 18.553 s] 3.558 s (23.7%)
iast_GLOBAL 17.847 s [17.847 s, 17.847 s] 2.852 s (19.0%)
profiling 16.053 s [16.053 s, 16.053 s] 1.058 s (7.1%)
tracing 14.887 s [14.887 s, 14.887 s] -108.0 ms (-0.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.71 s [15.71 s, 15.71 s] -
appsec 14.781 s [14.781 s, 14.781 s] -929.0 ms (-5.9%)
iast 18.112 s [18.112 s, 18.112 s] 2.402 s (15.3%)
iast_GLOBAL 17.759 s [17.759 s, 17.759 s] 2.049 s (13.0%)
profiling 15.63 s [15.63 s, 15.63 s] -80.0 ms (-0.5%)
tracing 15.079 s [15.079 s, 15.079 s] -631.0 ms (-4.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~d95abb0eac, baseline=1.54.0-SNAPSHOT~4abe3ff9a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.406 ms) : 2356, 2455
.   : milestone, 2406,
iast (2.194 ms) : 2132, 2257
.   : milestone, 2194,
iast_GLOBAL (2.233 ms) : 2170, 2296
.   : milestone, 2233,
profiling (2.065 ms) : 2013, 2117
.   : milestone, 2065,
tracing (2.012 ms) : 1964, 2060
.   : milestone, 2012,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.582 ms) : 3368, 3796
.   : milestone, 3582,
iast (2.188 ms) : 2126, 2250
.   : milestone, 2188,
iast_GLOBAL (2.227 ms) : 2165, 2290
.   : milestone, 2227,
profiling (2.06 ms) : 2008, 2112
.   : milestone, 2060,
tracing (2.018 ms) : 1970, 2067
.   : milestone, 2018,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.406 ms [2.356 ms, 2.455 ms] 932.924 µs (63.3%)
iast 2.194 ms [2.132 ms, 2.257 ms] 721.627 µs (49.0%)
iast_GLOBAL 2.233 ms [2.17 ms, 2.296 ms] 760.591 µs (51.6%)
profiling 2.065 ms [2.013 ms, 2.117 ms] 592.322 µs (40.2%)
tracing 2.012 ms [1.964 ms, 2.06 ms] 539.33 µs (36.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.582 ms [3.368 ms, 3.796 ms] 2.107 ms (142.9%)
iast 2.188 ms [2.126 ms, 2.25 ms] 713.72 µs (48.4%)
iast_GLOBAL 2.227 ms [2.165 ms, 2.29 ms] 753.008 µs (51.1%)
profiling 2.06 ms [2.008 ms, 2.112 ms] 585.567 µs (39.7%)
tracing 2.018 ms [1.97 ms, 2.067 ms] 543.989 µs (36.9%)

@MattAlp MattAlp merged commit 7528bd7 into master Sep 5, 2025
503 checks passed
@MattAlp MattAlp deleted the mattalp/greater-profile-flare-test-cov branch September 5, 2025 18:24
@github-actions github-actions Bot added this to the 1.54.0 milestone Sep 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@smola smola Awaiting requested review from smola smola was automatically assigned from DataDog/apm-java

@jbachorik jbachorik Awaiting requested review from jbachorik

Assignees

No one assigned

Labels

comp: testing Testing run-tests: oracle8 Run tests using Oracle 8 JDK tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

3 participants

@MattAlp @AlexeyKuznetsov-DD @jbachorik