Skip to content

Introduce constants to eliminate unnecessary calls to String.format()#8590

Merged
evanchooly merged 1 commit intomasterfrom
evanchooly/codeOriginStrings
Mar 19, 2025
Merged

Introduce constants to eliminate unnecessary calls to String.format()#8590
evanchooly merged 1 commit intomasterfrom
evanchooly/codeOriginStrings

Conversation

@evanchooly
Copy link
Copy Markdown
Contributor

@evanchooly evanchooly commented Mar 19, 2025

What Does This Do

Eliminates some unnecessary calls to String.format() so that they don't show up in the flamegraph when looking at traces.

Motivation

Additional Notes

Contributor Checklist

@evanchooly evanchooly added tag: no release notes Changes to exclude from release notes comp: debugger Dynamic Instrumentation inst: java Core Java language instrumentation labels Mar 19, 2025
@evanchooly evanchooly requested a review from jpbempel March 19, 2025 19:27
@evanchooly evanchooly requested review from a team as code owners March 19, 2025 19:27
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 19, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1742413045 1742413414
end_time 2025-03-19T19:38:44 2025-03-19T19:44:52
git_branch master evanchooly/codeOriginStrings
git_commit_sha 3c989a4 0de7560
start_time 2025-03-19T19:37:26 2025-03-19T19:43:35
See matching parameters
Baseline Candidate
ci_job_id 855798264 855798264
ci_pipeline_id 59372086 59372086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1742412332 1742412332

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-25274.808ns; +25360.279ns] or [-9.038%; +9.068%]		 unstable
[-36844.545ns; +37382.144ns] or [-11.550%; +11.719%]		 unstable
[-47634.872ns; +48625.836ns] or [-14.308%; +14.605%]		 unstable
[-99.915µs; +89.845µs] or [-16.706%; +15.022%]		 same
scenario:basic same same same unstable
[-34.044µs; +36.330µs] or [-6.582%; +7.024%]		 unstable
[-167.090op/s; +167.090op/s] or [-6.684%; +6.684%]
scenario:loop same same same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (319.0 µs) : 285, 353
.   : milestone, 319,
basic (312.22 µs) : 303, 321
.   : milestone, 312,
loop (10.13 ms) : 10097, 10163
.   : milestone, 10130,
section candidate
noprobe (319.269 µs) : 283, 356
.   : milestone, 319,
basic (309.366 µs) : 300, 318
.   : milestone, 309,
loop (10.14 ms) : 10104, 10177
.   : milestone, 10140,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 319.0 µs [285.098 µs, 352.902 µs]
basic 312.22 µs [303.221 µs, 321.22 µs]
loop 10.13 ms [10.097 ms, 10.163 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 319.269 µs [282.51 µs, 356.028 µs]
basic 309.366 µs [300.34 µs, 318.391 µs]
loop 10.14 ms [10.104 ms, 10.177 ms]

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 19, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/codeOriginStrings
git_commit_date 1742406927 1742412332
git_commit_sha 3c989a4 0de7560
release_version 1.48.0-SNAPSHOT~3c989a4ab1 1.48.0-SNAPSHOT~0de7560ec2
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1742414767 1742414767
ci_job_id 855798253 855798253
ci_pipeline_id 59372086 59372086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8h5zseff-project-304-concurrent-2-fgi6uzn1 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8h5zseff-project-304-concurrent-2-fgi6uzn1 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1041407
Total [baseline] (10.475 s) : 0, 10475172
Agent [candidate] (1.041 s) : 0, 1040611
Total [candidate] (10.411 s) : 0, 10411151
section appsec
Agent [baseline] (1.183 s) : 0, 1182531
Total [baseline] (10.793 s) : 0, 10792937
Agent [candidate] (1.184 s) : 0, 1183503
Total [candidate] (10.738 s) : 0, 10738401
section iast
Agent [baseline] (1.178 s) : 0, 1177650
Total [baseline] (11.045 s) : 0, 11045338
Agent [candidate] (1.183 s) : 0, 1182776
Total [candidate] (11.08 s) : 0, 11080394
section profiling
Agent [baseline] (1.262 s) : 0, 1261635
Total [baseline] (10.918 s) : 0, 10917718
Agent [candidate] (1.267 s) : 0, 1267345
Total [candidate] (10.951 s) : 0, 10951006
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.183 s 141.124 ms (13.6%)
Agent iast 1.178 s 136.244 ms (13.1%)
Agent profiling 1.262 s 220.228 ms (21.1%)
Total tracing 10.475 s -
Total appsec 10.793 s 317.765 ms (3.0%)
Total iast 11.045 s 570.166 ms (5.4%)
Total profiling 10.918 s 442.547 ms (4.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.184 s 142.892 ms (13.7%)
Agent iast 1.183 s 142.164 ms (13.7%)
Agent profiling 1.267 s 226.733 ms (21.8%)
Total tracing 10.411 s -
Total appsec 10.738 s 327.25 ms (3.1%)
Total iast 11.08 s 669.242 ms (6.4%)
Total profiling 10.951 s 539.855 ms (5.2%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.748 ms) : 0, 717748
BytebuddyAgent [candidate] (717.44 ms) : 0, 717440
GlobalTracer [baseline] (240.446 ms) : 0, 240446
GlobalTracer [candidate] (239.457 ms) : 0, 239457
AppSec [baseline] (54.861 ms) : 0, 54861
AppSec [candidate] (54.174 ms) : 0, 54174
Remote Config [baseline] (703.164 µs) : 0, 703
Remote Config [candidate] (685.6 µs) : 0, 686
Telemetry [baseline] (11.627 ms) : 0, 11627
Telemetry [candidate] (12.963 ms) : 0, 12963
section appsec
BytebuddyAgent [baseline] (734.848 ms) : 0, 734848
BytebuddyAgent [candidate] (735.875 ms) : 0, 735875
GlobalTracer [baseline] (235.912 ms) : 0, 235912
GlobalTracer [candidate] (236.154 ms) : 0, 236154
AppSec [baseline] (176.042 ms) : 0, 176042
AppSec [candidate] (175.911 ms) : 0, 175911
Remote Config [baseline] (660.372 µs) : 0, 660
Remote Config [candidate] (660.745 µs) : 0, 661
Telemetry [baseline] (8.261 ms) : 0, 8261
Telemetry [candidate] (8.289 ms) : 0, 8289
IAST [baseline] (21.703 ms) : 0, 21703
IAST [candidate] (21.399 ms) : 0, 21399
section iast
BytebuddyAgent [baseline] (842.328 ms) : 0, 842328
BytebuddyAgent [candidate] (845.518 ms) : 0, 845518
GlobalTracer [baseline] (230.865 ms) : 0, 230865
GlobalTracer [candidate] (231.873 ms) : 0, 231873
AppSec [baseline] (56.247 ms) : 0, 56247
AppSec [candidate] (56.755 ms) : 0, 56755
Remote Config [baseline] (605.76 µs) : 0, 606
Remote Config [candidate] (621.345 µs) : 0, 621
Telemetry [baseline] (8.656 ms) : 0, 8656
Telemetry [candidate] (8.794 ms) : 0, 8794
IAST [baseline] (22.961 ms) : 0, 22961
IAST [candidate] (23.187 ms) : 0, 23187
section profiling
BytebuddyAgent [baseline] (709.237 ms) : 0, 709237
BytebuddyAgent [candidate] (713.393 ms) : 0, 713393
GlobalTracer [baseline] (350.623 ms) : 0, 350623
GlobalTracer [candidate] (351.352 ms) : 0, 351352
AppSec [baseline] (54.14 ms) : 0, 54140
AppSec [candidate] (53.877 ms) : 0, 53877
Remote Config [baseline] (712.322 µs) : 0, 712
Remote Config [candidate] (719.61 µs) : 0, 720
Telemetry [baseline] (8.966 ms) : 0, 8966
Telemetry [candidate] (8.978 ms) : 0, 8978
ProfilingAgent [baseline] (96.481 ms) : 0, 96481
ProfilingAgent [candidate] (97.464 ms) : 0, 97464
Profiling [baseline] (96.506 ms) : 0, 96506
Profiling [candidate] (97.488 ms) : 0, 97488
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1040606
Total [baseline] (8.689 s) : 0, 8689065
Agent [candidate] (1.057 s) : 0, 1057003
Total [candidate] (8.728 s) : 0, 8728123
section iast
Agent [baseline] (1.172 s) : 0, 1172200
Total [baseline] (9.313 s) : 0, 9312639
Agent [candidate] (1.172 s) : 0, 1171996
Total [candidate] (9.252 s) : 0, 9251895
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.175 s) : 0, 1174752
Total [baseline] (9.247 s) : 0, 9247046
Agent [candidate] (1.174 s) : 0, 1173827
Total [candidate] (9.196 s) : 0, 9195650
section iast_TELEMETRY_OFF
Agent [baseline] (1.169 s) : 0, 1168888
Total [baseline] (9.257 s) : 0, 9256649
Agent [candidate] (1.178 s) : 0, 1177802
Total [candidate] (9.262 s) : 0, 9262010
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.172 s 131.594 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 134.146 ms (12.9%)
Agent iast_TELEMETRY_OFF 1.169 s 128.282 ms (12.3%)
Total tracing 8.689 s -
Total iast 9.313 s 623.574 ms (7.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.247 s 557.981 ms (6.4%)
Total iast_TELEMETRY_OFF 9.257 s 567.584 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.172 s 114.993 ms (10.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 116.825 ms (11.1%)
Agent iast_TELEMETRY_OFF 1.178 s 120.8 ms (11.4%)
Total tracing 8.728 s -
Total iast 9.252 s 523.772 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.196 s 467.527 ms (5.4%)
Total iast_TELEMETRY_OFF 9.262 s 533.886 ms (6.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.713 ms) : 0, 717713
BytebuddyAgent [candidate] (728.386 ms) : 0, 728386
GlobalTracer [baseline] (239.246 ms) : 0, 239246
GlobalTracer [candidate] (242.062 ms) : 0, 242062
AppSec [baseline] (54.676 ms) : 0, 54676
AppSec [candidate] (55.179 ms) : 0, 55179
Remote Config [baseline] (695.715 µs) : 0, 696
Remote Config [candidate] (712.867 µs) : 0, 713
Telemetry [baseline] (12.328 ms) : 0, 12328
Telemetry [candidate] (14.492 ms) : 0, 14492
section iast
BytebuddyAgent [baseline] (838.83 ms) : 0, 838830
BytebuddyAgent [candidate] (837.905 ms) : 0, 837905
GlobalTracer [baseline] (229.847 ms) : 0, 229847
GlobalTracer [candidate] (229.994 ms) : 0, 229994
IAST [baseline] (23.523 ms) : 0, 23523
IAST [candidate] (23.539 ms) : 0, 23539
AppSec [baseline] (54.762 ms) : 0, 54762
AppSec [candidate] (55.45 ms) : 0, 55450
Remote Config [baseline] (616.853 µs) : 0, 617
Remote Config [candidate] (625.777 µs) : 0, 626
Telemetry [baseline] (8.708 ms) : 0, 8708
Telemetry [candidate] (8.639 ms) : 0, 8639
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (839.195 ms) : 0, 839195
BytebuddyAgent [candidate] (838.922 ms) : 0, 838922
GlobalTracer [baseline] (230.903 ms) : 0, 230903
GlobalTracer [candidate] (231.111 ms) : 0, 231111
IAST [baseline] (22.94 ms) : 0, 22940
IAST [candidate] (23.554 ms) : 0, 23554
AppSec [baseline] (56.349 ms) : 0, 56349
AppSec [candidate] (55.041 ms) : 0, 55041
Remote Config [baseline] (622.934 µs) : 0, 623
Remote Config [candidate] (629.81 µs) : 0, 630
Telemetry [baseline] (8.763 ms) : 0, 8763
Telemetry [candidate] (8.662 ms) : 0, 8662
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.732 ms) : 0, 834732
BytebuddyAgent [candidate] (842.09 ms) : 0, 842090
GlobalTracer [baseline] (230.323 ms) : 0, 230323
GlobalTracer [candidate] (231.527 ms) : 0, 231527
IAST [baseline] (22.399 ms) : 0, 22399
IAST [candidate] (22.653 ms) : 0, 22653
AppSec [baseline] (56.265 ms) : 0, 56265
AppSec [candidate] (56.288 ms) : 0, 56288
Remote Config [baseline] (619.49 µs) : 0, 619
Remote Config [candidate] (616.125 µs) : 0, 616
Telemetry [baseline] (8.608 ms) : 0, 8608
Telemetry [candidate] (8.625 ms) : 0, 8625
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-19T19:38:49 2025-03-19T19:46:31
git_branch master evanchooly/codeOriginStrings
git_commit_date 1742406927 1742412332
git_commit_sha 3c989a4 0de7560
release_version 1.48.0-SNAPSHOT~3c989a4ab1 1.48.0-SNAPSHOT~0de7560ec2
start_time 2025-03-19T19:38:34 2025-03-19T19:46:17
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1742413988 1742413988
ci_job_id 855798255 855798255
ci_pipeline_id 59372086 59372086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-kucxac5a-project-304-concurrent-1-xrwkf7ef 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-kucxac5a-project-304-concurrent-1-xrwkf7ef 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1
    dateFormat X
    axisFormat %s
section baseline
no_agent (376.333 µs) : 356, 397
.   : milestone, 376,
iast (516.543 µs) : 495, 538
.   : milestone, 517,
iast_FULL (727.393 µs) : 706, 749
.   : milestone, 727,
iast_GLOBAL (556.086 µs) : 534, 578
.   : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (509.149 µs) : 487, 531
.   : milestone, 509,
iast_INACTIVE (463.353 µs) : 442, 485
.   : milestone, 463,
iast_TELEMETRY_OFF (502.587 µs) : 480, 525
.   : milestone, 503,
tracing (451.287 µs) : 431, 472
.   : milestone, 451,
section candidate
no_agent (373.792 µs) : 353, 394
.   : milestone, 374,
iast (510.588 µs) : 489, 533
.   : milestone, 511,
iast_FULL (731.24 µs) : 709, 753
.   : milestone, 731,
iast_GLOBAL (557.395 µs) : 536, 579
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (504.662 µs) : 483, 526
.   : milestone, 505,
iast_INACTIVE (464.557 µs) : 443, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (499.452 µs) : 478, 521
.   : milestone, 499,
tracing (453.596 µs) : 433, 475
.   : milestone, 454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.333 µs [355.557 µs, 397.11 µs] -
iast 516.543 µs [494.906 µs, 538.18 µs] 140.21 µs (37.3%)
iast_FULL 727.393 µs [705.508 µs, 749.277 µs] 351.059 µs (93.3%)
iast_GLOBAL 556.086 µs [533.978 µs, 578.195 µs] 179.753 µs (47.8%)
iast_HARDCODED_SECRET_DISABLED 509.149 µs [487.259 µs, 531.039 µs] 132.816 µs (35.3%)
iast_INACTIVE 463.353 µs [441.888 µs, 484.818 µs] 87.019 µs (23.1%)
iast_TELEMETRY_OFF 502.587 µs [479.767 µs, 525.406 µs] 126.253 µs (33.5%)
tracing 451.287 µs [430.555 µs, 472.018 µs] 74.953 µs (19.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.792 µs [353.265 µs, 394.319 µs] -
iast 510.588 µs [488.505 µs, 532.67 µs] 136.796 µs (36.6%)
iast_FULL 731.24 µs [709.131 µs, 753.348 µs] 357.448 µs (95.6%)
iast_GLOBAL 557.395 µs [535.726 µs, 579.065 µs] 183.604 µs (49.1%)
iast_HARDCODED_SECRET_DISABLED 504.662 µs [483.301 µs, 526.023 µs] 130.87 µs (35.0%)
iast_INACTIVE 464.557 µs [442.676 µs, 486.438 µs] 90.765 µs (24.3%)
iast_TELEMETRY_OFF 499.452 µs [477.736 µs, 521.168 µs] 125.66 µs (33.6%)
tracing 453.596 µs [432.624 µs, 474.567 µs] 79.804 µs (21.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.366 ms) : 1346, 1386
.   : milestone, 1366,
appsec (1.735 ms) : 1711, 1758
.   : milestone, 1735,
appsec_no_iast (1.759 ms) : 1732, 1785
.   : milestone, 1759,
code_origins (1.676 ms) : 1649, 1703
.   : milestone, 1676,
iast (1.5 ms) : 1475, 1524
.   : milestone, 1500,
profiling (1.51 ms) : 1486, 1534
.   : milestone, 1510,
tracing (1.473 ms) : 1447, 1498
.   : milestone, 1473,
section candidate
no_agent (1.351 ms) : 1332, 1371
.   : milestone, 1351,
appsec (1.733 ms) : 1709, 1756
.   : milestone, 1733,
appsec_no_iast (1.73 ms) : 1706, 1754
.   : milestone, 1730,
code_origins (1.668 ms) : 1640, 1695
.   : milestone, 1668,
iast (1.521 ms) : 1497, 1545
.   : milestone, 1521,
profiling (1.545 ms) : 1521, 1570
.   : milestone, 1545,
tracing (1.488 ms) : 1464, 1512
.   : milestone, 1488,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.366 ms [1.346 ms, 1.386 ms] -
appsec 1.735 ms [1.711 ms, 1.758 ms] 368.845 µs (27.0%)
appsec_no_iast 1.759 ms [1.732 ms, 1.785 ms] 392.563 µs (28.7%)
code_origins 1.676 ms [1.649 ms, 1.703 ms] 310.401 µs (22.7%)
iast 1.5 ms [1.475 ms, 1.524 ms] 133.848 µs (9.8%)
profiling 1.51 ms [1.486 ms, 1.534 ms] 143.801 µs (10.5%)
tracing 1.473 ms [1.447 ms, 1.498 ms] 106.748 µs (7.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.351 ms [1.332 ms, 1.371 ms] -
appsec 1.733 ms [1.709 ms, 1.756 ms] 381.361 µs (28.2%)
appsec_no_iast 1.73 ms [1.706 ms, 1.754 ms] 378.463 µs (28.0%)
code_origins 1.668 ms [1.64 ms, 1.695 ms] 316.405 µs (23.4%)
iast 1.521 ms [1.497 ms, 1.545 ms] 170.153 µs (12.6%)
profiling 1.545 ms [1.521 ms, 1.57 ms] 194.2 µs (14.4%)
tracing 1.488 ms [1.464 ms, 1.512 ms] 137.033 µs (10.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/codeOriginStrings
git_commit_date 1742406927 1742412332
git_commit_sha 3c989a4 0de7560
release_version 1.48.0-SNAPSHOT~3c989a4ab1 1.48.0-SNAPSHOT~0de7560ec2
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1742414460 1742414460
ci_job_id 855798257 855798257
ci_pipeline_id 59372086 59372086
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8h5zseff-project-304-concurrent-3-47rjxzpd 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8h5zseff-project-304-concurrent-3-47rjxzpd 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (2.362 ms) : 2317, 2407
.   : milestone, 2362,
iast (2.135 ms) : 2078, 2191
.   : milestone, 2135,
iast_GLOBAL (2.183 ms) : 2126, 2240
.   : milestone, 2183,
profiling (1.998 ms) : 1952, 2044
.   : milestone, 1998,
tracing (1.962 ms) : 1918, 2005
.   : milestone, 1962,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.353 ms) : 2308, 2398
.   : milestone, 2353,
iast (2.133 ms) : 2077, 2190
.   : milestone, 2133,
iast_GLOBAL (2.176 ms) : 2119, 2233
.   : milestone, 2176,
profiling (2.456 ms) : 2275, 2636
.   : milestone, 2456,
tracing (1.961 ms) : 1917, 2004
.   : milestone, 1961,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.47 ms, 1.493 ms] -
appsec 2.362 ms [2.317 ms, 2.407 ms] 880.547 µs (59.4%)
iast 2.135 ms [2.078 ms, 2.191 ms] 653.317 µs (44.1%)
iast_GLOBAL 2.183 ms [2.126 ms, 2.24 ms] 701.586 µs (47.4%)
profiling 1.998 ms [1.952 ms, 2.044 ms] 516.569 µs (34.9%)
tracing 1.962 ms [1.918 ms, 2.005 ms] 480.31 µs (32.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 2.353 ms [2.308 ms, 2.398 ms] 879.634 µs (59.7%)
iast 2.133 ms [2.077 ms, 2.19 ms] 660.025 µs (44.8%)
iast_GLOBAL 2.176 ms [2.119 ms, 2.233 ms] 702.808 µs (47.7%)
profiling 2.456 ms [2.275 ms, 2.636 ms] 982.525 µs (66.7%)
tracing 1.961 ms [1.917 ms, 2.004 ms] 487.3 µs (33.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~0de7560ec2, baseline=1.48.0-SNAPSHOT~3c989a4ab1
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
appsec (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
iast (18.466 s) : 18466000, 18466000
.   : milestone, 18466000,
iast_GLOBAL (18.148 s) : 18148000, 18148000
.   : milestone, 18148000,
profiling (15.301 s) : 15301000, 15301000
.   : milestone, 15301000,
tracing (15.173 s) : 15173000, 15173000
.   : milestone, 15173000,
section candidate
no_agent (15.031 s) : 15031000, 15031000
.   : milestone, 15031000,
appsec (15.119 s) : 15119000, 15119000
.   : milestone, 15119000,
iast (18.319 s) : 18319000, 18319000
.   : milestone, 18319000,
iast_GLOBAL (17.981 s) : 17981000, 17981000
.   : milestone, 17981000,
profiling (15.117 s) : 15117000, 15117000
.   : milestone, 15117000,
tracing (15.202 s) : 15202000, 15202000
.   : milestone, 15202000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.326 s [15.326 s, 15.326 s] -
appsec 15.084 s [15.084 s, 15.084 s] -242.0 ms (-1.6%)
iast 18.466 s [18.466 s, 18.466 s] 3.14 s (20.5%)
iast_GLOBAL 18.148 s [18.148 s, 18.148 s] 2.822 s (18.4%)
profiling 15.301 s [15.301 s, 15.301 s] -25.0 ms (-0.2%)
tracing 15.173 s [15.173 s, 15.173 s] -153.0 ms (-1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.031 s [15.031 s, 15.031 s] -
appsec 15.119 s [15.119 s, 15.119 s] 88.0 ms (0.6%)
iast 18.319 s [18.319 s, 18.319 s] 3.288 s (21.9%)
iast_GLOBAL 17.981 s [17.981 s, 17.981 s] 2.95 s (19.6%)
profiling 15.117 s [15.117 s, 15.117 s] 86.0 ms (0.6%)
tracing 15.202 s [15.202 s, 15.202 s] 171.0 ms (1.1%)

@evanchooly evanchooly added inst: java Core Java language instrumentation and removed inst: java Core Java language instrumentation labels Mar 19, 2025
@evanchooly evanchooly merged commit 727c7c7 into master Mar 19, 2025
8 checks passed
@evanchooly evanchooly deleted the evanchooly/codeOriginStrings branch March 19, 2025 21:18
@github-actions github-actions Bot added this to the 1.48.0 milestone Mar 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jpbempel jpbempel jpbempel approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation inst: java Core Java language instrumentation tag: no release notes Changes to exclude from release notes type: refactoring

Projects

None yet

Milestone

1.48.0

Development

Successfully merging this pull request may close these issues.

2 participants

@evanchooly @jpbempel