Skip to content

[🍒 7915] Bump ddprof to 1.17.0#7917

Merged
jbachorik merged 1 commit intorelease/v1.42.xfrom
jaroslav.bachorik/backport-pr-7915
Nov 8, 2024
Merged

[🍒 7915] Bump ddprof to 1.17.0#7917
jbachorik merged 1 commit intorelease/v1.42.xfrom
jaroslav.bachorik/backport-pr-7915

Conversation

@jbachorik
Copy link
Copy Markdown
Contributor

@jbachorik jbachorik commented Nov 8, 2024

Backport #7915 to release/v1.42.x

@jbachorik
Bump ddprof to 1.17.0
2b90bed 
Required to pull in DataDog/java-profiler#150

(cherry picked from commit 49067b0)
@jbachorik jbachorik requested a review from a team as a code owner November 8, 2024 09:45
@jbachorik jbachorik added the type: bug Bug report and fix label Nov 8, 2024
@jbachorik jbachorik requested a review from amarziali November 8, 2024 09:45
@jbachorik jbachorik added tag: dependencies Dependencies related changes comp: profiling Profiling labels Nov 8, 2024
@jbachorik jbachorik added this to the 1.42.1 milestone Nov 8, 2024
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Nov 8, 2024

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1731059685 1731060064
end_time 2024-11-08T09:56:00 2024-11-08T10:02:19
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_sha 864879a 2b90bed
start_time 2024-11-08T09:54:46 2024-11-08T10:01:05
See matching parameters
Baseline Candidate
ci_job_id 700245326 700245326
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1731059112 1731059112

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+422.678µs; +513.872µs] or [+4.094%; +4.978%]		 worse
[+411.284µs; +529.184µs] or [+3.918%; +5.042%]		 worse
[+377.227µs; +518.820µs] or [+3.567%; +4.906%]		 worse
[+307.872µs; +888.567µs] or [+2.811%; +8.114%]		 worse
[-4.604op/s; -3.080op/s] or [-4.881%; -3.264%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-25.040µs; +15.014µs] or [-9.467%; +5.677%]		 unstable
[-41.838µs; +19.463µs] or [-13.764%; +6.403%]		 unstable
[-56.363µs; +28.694µs] or [-17.697%; +9.009%]		 unstable
[-110.267µs; +85.373µs] or [-17.916%; +13.871%]		 same
scenario:basic unsure
[+1.165µs; +11.470µs] or [+0.429%; +4.220%]		 same same unstable
[-35.676µs; +60.547µs] or [-6.646%; +11.279%]		 unstable
[-171.405op/s; +171.405op/s] or [-6.685%; +6.685%]
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (303.961 µs) : 269, 339
.   : milestone, 304,
basic (297.865 µs) : 290, 306
.   : milestone, 298,
loop (10.497 ms) : 10428, 10565
.   : milestone, 10497,
section candidate
noprobe (292.774 µs) : 271, 315
.   : milestone, 293,
basic (304.037 µs) : 295, 313
.   : milestone, 304,
loop (10.967 ms) : 10931, 11003
.   : milestone, 10967,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 303.961 µs [268.902 µs, 339.021 µs]
basic 297.865 µs [289.95 µs, 305.781 µs]
loop 10.497 ms [10.428 ms, 10.565 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 292.774 µs [270.857 µs, 314.691 µs]
basic 304.037 µs [295.023 µs, 313.051 µs]
loop 10.967 ms [10.931 ms, 11.003 ms]

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Nov 8, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_date 1731059125 1731059112
git_commit_sha 864879a 2b90bed
release_version 1.43.0-SNAPSHOT~864879a988 1.43.0-SNAPSHOT~2b90bed8d6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731061530 1731061530
ci_job_id 700245320 700245320
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.077 s) : 0, 1077426
Total [baseline] (10.338 s) : 0, 10337950
Agent [candidate] (1.08 s) : 0, 1079634
Total [candidate] (10.331 s) : 0, 10330561
section appsec
Agent [baseline] (1.214 s) : 0, 1213557
Total [baseline] (10.623 s) : 0, 10622540
Agent [candidate] (1.215 s) : 0, 1214620
Total [candidate] (10.643 s) : 0, 10643234
section iast
Agent [baseline] (1.204 s) : 0, 1203990
Total [baseline] (10.841 s) : 0, 10840512
Agent [candidate] (1.208 s) : 0, 1208159
Total [candidate] (10.846 s) : 0, 10845816
section profiling
Agent [baseline] (1.281 s) : 0, 1280757
Total [baseline] (10.627 s) : 0, 10626809
Agent [candidate] (1.287 s) : 0, 1287156
Total [candidate] (10.743 s) : 0, 10743098
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent appsec 1.214 s 136.131 ms (12.6%)
Agent iast 1.204 s 126.564 ms (11.7%)
Agent profiling 1.281 s 203.331 ms (18.9%)
Total tracing 10.338 s -
Total appsec 10.623 s 284.59 ms (2.8%)
Total iast 10.841 s 502.562 ms (4.9%)
Total profiling 10.627 s 288.859 ms (2.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent appsec 1.215 s 134.986 ms (12.5%)
Agent iast 1.208 s 128.525 ms (11.9%)
Agent profiling 1.287 s 207.522 ms (19.2%)
Total tracing 10.331 s -
Total appsec 10.643 s 312.672 ms (3.0%)
Total iast 10.846 s 515.255 ms (5.0%)
Total profiling 10.743 s 412.537 ms (4.0%) 
gantt
    title petclinic - break down per module: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.932 ms) : 0, 684932
BytebuddyAgent [candidate] (687.049 ms) : 0, 687049
GlobalTracer [baseline] (314.336 ms) : 0, 314336
GlobalTracer [candidate] (316.428 ms) : 0, 316428
AppSec [baseline] (53.964 ms) : 0, 53964
AppSec [candidate] (54.032 ms) : 0, 54032
Remote Config [baseline] (676.246 µs) : 0, 676
Remote Config [candidate] (673.038 µs) : 0, 673
Telemetry [baseline] (9.891 ms) : 0, 9891
Telemetry [candidate] (7.796 ms) : 0, 7796
section appsec
BytebuddyAgent [baseline] (703.136 ms) : 0, 703136
BytebuddyAgent [candidate] (703.222 ms) : 0, 703222
GlobalTracer [baseline] (312.327 ms) : 0, 312327
GlobalTracer [candidate] (313.215 ms) : 0, 313215
AppSec [baseline] (166.372 ms) : 0, 166372
AppSec [candidate] (165.866 ms) : 0, 165866
IAST [baseline] (18.687 ms) : 0, 18687
IAST [candidate] (19.849 ms) : 0, 19849
Remote Config [baseline] (628.728 µs) : 0, 629
Remote Config [candidate] (637.293 µs) : 0, 637
Telemetry [baseline] (8.133 ms) : 0, 8133
Telemetry [candidate] (8.093 ms) : 0, 8093
section iast
BytebuddyAgent [baseline] (800.168 ms) : 0, 800168
BytebuddyAgent [candidate] (803.362 ms) : 0, 803362
GlobalTracer [baseline] (304.358 ms) : 0, 304358
GlobalTracer [candidate] (305.084 ms) : 0, 305084
AppSec [baseline] (57.252 ms) : 0, 57252
AppSec [candidate] (56.683 ms) : 0, 56683
IAST [baseline] (20.501 ms) : 0, 20501
IAST [candidate] (21.301 ms) : 0, 21301
Remote Config [baseline] (606.746 µs) : 0, 607
Remote Config [candidate] (594.922 µs) : 0, 595
Telemetry [baseline] (7.467 ms) : 0, 7467
Telemetry [candidate] (7.395 ms) : 0, 7395
section profiling
BytebuddyAgent [baseline] (685.194 ms) : 0, 685194
BytebuddyAgent [candidate] (685.896 ms) : 0, 685896
GlobalTracer [baseline] (397.931 ms) : 0, 397931
GlobalTracer [candidate] (401.401 ms) : 0, 401401
AppSec [baseline] (54.452 ms) : 0, 54452
AppSec [candidate] (54.942 ms) : 0, 54942
Remote Config [baseline] (663.159 µs) : 0, 663
Remote Config [candidate] (675.868 µs) : 0, 676
Telemetry [baseline] (10.614 ms) : 0, 10614
Telemetry [candidate] (12.07 ms) : 0, 12070
ProfilingAgent [baseline] (92.824 ms) : 0, 92824
ProfilingAgent [candidate] (93.02 ms) : 0, 93020
Profiling [baseline] (92.848 ms) : 0, 92848
Profiling [candidate] (93.044 ms) : 0, 93044
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1079366
Total [baseline] (8.557 s) : 0, 8556878
Agent [candidate] (1.082 s) : 0, 1081588
Total [candidate] (8.525 s) : 0, 8524789
section iast
Agent [baseline] (1.203 s) : 0, 1203392
Total [baseline] (9.156 s) : 0, 9156227
Agent [candidate] (1.222 s) : 0, 1221776
Total [candidate] (9.122 s) : 0, 9122133
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.204 s) : 0, 1203619
Total [baseline] (9.089 s) : 0, 9088788
Agent [candidate] (1.21 s) : 0, 1210490
Total [candidate] (9.096 s) : 0, 9095673
section iast_TELEMETRY_OFF
Agent [baseline] (1.205 s) : 0, 1205245
Total [baseline] (9.103 s) : 0, 9103485
Agent [candidate] (1.2 s) : 0, 1200117
Total [candidate] (9.103 s) : 0, 9102502
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.203 s 124.026 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.204 s 124.253 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.205 s 125.879 ms (11.7%)
Total tracing 8.557 s -
Total iast 9.156 s 599.349 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.089 s 531.91 ms (6.2%)
Total iast_TELEMETRY_OFF 9.103 s 546.607 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent iast 1.222 s 140.188 ms (13.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.21 s 128.903 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.2 s 118.529 ms (11.0%)
Total tracing 8.525 s -
Total iast 9.122 s 597.344 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.096 s 570.884 ms (6.7%)
Total iast_TELEMETRY_OFF 9.103 s 577.714 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.441 ms) : 0, 686441
BytebuddyAgent [candidate] (685.855 ms) : 0, 685855
GlobalTracer [baseline] (315.181 ms) : 0, 315181
GlobalTracer [candidate] (315.518 ms) : 0, 315518
AppSec [baseline] (54.108 ms) : 0, 54108
AppSec [candidate] (53.951 ms) : 0, 53951
Remote Config [baseline] (679.751 µs) : 0, 680
Remote Config [candidate] (670.438 µs) : 0, 670
Telemetry [baseline] (9.274 ms) : 0, 9274
Telemetry [candidate] (11.878 ms) : 0, 11878
section iast
BytebuddyAgent [baseline] (799.939 ms) : 0, 799939
BytebuddyAgent [candidate] (815.933 ms) : 0, 815933
GlobalTracer [baseline] (303.83 ms) : 0, 303830
GlobalTracer [candidate] (306.515 ms) : 0, 306515
AppSec [baseline] (57.164 ms) : 0, 57164
AppSec [candidate] (56.103 ms) : 0, 56103
IAST [baseline] (20.632 ms) : 0, 20632
IAST [candidate] (21.203 ms) : 0, 21203
Remote Config [baseline] (618.005 µs) : 0, 618
Remote Config [candidate] (613.918 µs) : 0, 614
Telemetry [baseline] (7.55 ms) : 0, 7550
Telemetry [candidate] (7.445 ms) : 0, 7445
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (799.754 ms) : 0, 799754
BytebuddyAgent [candidate] (803.204 ms) : 0, 803204
GlobalTracer [baseline] (303.979 ms) : 0, 303979
GlobalTracer [candidate] (306.858 ms) : 0, 306858
AppSec [baseline] (56.627 ms) : 0, 56627
AppSec [candidate] (57.204 ms) : 0, 57204
IAST [baseline] (21.565 ms) : 0, 21565
IAST [candidate] (21.329 ms) : 0, 21329
Remote Config [baseline] (624.507 µs) : 0, 625
Remote Config [candidate] (614.738 µs) : 0, 615
Telemetry [baseline] (7.442 ms) : 0, 7442
Telemetry [candidate] (7.528 ms) : 0, 7528
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.801 ms) : 0, 801801
BytebuddyAgent [candidate] (796.523 ms) : 0, 796523
GlobalTracer [baseline] (304.134 ms) : 0, 304134
GlobalTracer [candidate] (304.033 ms) : 0, 304033
AppSec [baseline] (57.526 ms) : 0, 57526
AppSec [candidate] (57.571 ms) : 0, 57571
IAST [baseline] (20.094 ms) : 0, 20094
IAST [candidate] (20.317 ms) : 0, 20317
Remote Config [baseline] (595.893 µs) : 0, 596
Remote Config [candidate] (596.009 µs) : 0, 596
Telemetry [baseline] (7.367 ms) : 0, 7367
Telemetry [candidate] (7.407 ms) : 0, 7407
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-08T09:55:57 2024-11-08T10:02:53
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_date 1731059125 1731059112
git_commit_sha 864879a 2b90bed
release_version 1.43.0-SNAPSHOT~864879a988 1.43.0-SNAPSHOT~2b90bed8d6
start_time 2024-11-08T09:55:43 2024-11-08T10:02:40
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1731060525 1731060525
ci_job_id 700245321 700245321
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.68 µs) : 359, 398
.   : milestone, 379,
iast (495.721 µs) : 474, 517
.   : milestone, 496,
iast_FULL (651.647 µs) : 630, 673
.   : milestone, 652,
iast_GLOBAL (514.523 µs) : 493, 536
.   : milestone, 515,
iast_HARDCODED_SECRET_DISABLED (500.641 µs) : 479, 522
.   : milestone, 501,
iast_INACTIVE (461.256 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (488.934 µs) : 467, 511
.   : milestone, 489,
tracing (453.324 µs) : 432, 474
.   : milestone, 453,
section candidate
no_agent (380.108 µs) : 360, 400
.   : milestone, 380,
iast (493.378 µs) : 472, 514
.   : milestone, 493,
iast_FULL (651.527 µs) : 630, 673
.   : milestone, 652,
iast_GLOBAL (520.226 µs) : 499, 542
.   : milestone, 520,
iast_HARDCODED_SECRET_DISABLED (501.615 µs) : 480, 523
.   : milestone, 502,
iast_INACTIVE (457.452 µs) : 436, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (480.647 µs) : 459, 502
.   : milestone, 481,
tracing (453.727 µs) : 432, 475
.   : milestone, 454,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.68 µs [359.081 µs, 398.278 µs] -
iast 495.721 µs [474.267 µs, 517.176 µs] 117.041 µs (30.9%)
iast_FULL 651.647 µs [630.188 µs, 673.107 µs] 272.968 µs (72.1%)
iast_GLOBAL 514.523 µs [493.361 µs, 535.685 µs] 135.844 µs (35.9%)
iast_HARDCODED_SECRET_DISABLED 500.641 µs [479.14 µs, 522.142 µs] 121.961 µs (32.2%)
iast_INACTIVE 461.256 µs [439.512 µs, 482.999 µs] 82.576 µs (21.8%)
iast_TELEMETRY_OFF 488.934 µs [467.078 µs, 510.79 µs] 110.254 µs (29.1%)
tracing 453.324 µs [432.445 µs, 474.203 µs] 74.644 µs (19.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 380.108 µs [360.462 µs, 399.753 µs] -
iast 493.378 µs [472.387 µs, 514.37 µs] 113.271 µs (29.8%)
iast_FULL 651.527 µs [630.089 µs, 672.964 µs] 271.419 µs (71.4%)
iast_GLOBAL 520.226 µs [498.638 µs, 541.813 µs] 140.118 µs (36.9%)
iast_HARDCODED_SECRET_DISABLED 501.615 µs [479.878 µs, 523.353 µs] 121.508 µs (32.0%)
iast_INACTIVE 457.452 µs [435.944 µs, 478.961 µs] 77.345 µs (20.3%)
iast_TELEMETRY_OFF 480.647 µs [459.385 µs, 501.91 µs] 100.54 µs (26.5%)
tracing 453.727 µs [432.434 µs, 475.021 µs] 73.62 µs (19.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1365
.   : milestone, 1345,
appsec (1.752 ms) : 1729, 1775
.   : milestone, 1752,
appsec_no_iast (1.74 ms) : 1716, 1764
.   : milestone, 1740,
iast (1.47 ms) : 1448, 1493
.   : milestone, 1470,
profiling (1.479 ms) : 1456, 1502
.   : milestone, 1479,
tracing (1.475 ms) : 1451, 1499
.   : milestone, 1475,
section candidate
no_agent (1.352 ms) : 1332, 1371
.   : milestone, 1352,
appsec (1.741 ms) : 1718, 1765
.   : milestone, 1741,
appsec_no_iast (1.749 ms) : 1725, 1773
.   : milestone, 1749,
iast (1.505 ms) : 1482, 1527
.   : milestone, 1505,
profiling (1.495 ms) : 1471, 1518
.   : milestone, 1495,
tracing (1.469 ms) : 1445, 1494
.   : milestone, 1469,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.345 ms [1.326 ms, 1.365 ms] -
appsec 1.752 ms [1.729 ms, 1.775 ms] 406.809 µs (30.2%)
appsec_no_iast 1.74 ms [1.716 ms, 1.764 ms] 394.79 µs (29.3%)
iast 1.47 ms [1.448 ms, 1.493 ms] 124.891 µs (9.3%)
profiling 1.479 ms [1.456 ms, 1.502 ms] 133.599 µs (9.9%)
tracing 1.475 ms [1.451 ms, 1.499 ms] 129.651 µs (9.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.352 ms [1.332 ms, 1.371 ms] -
appsec 1.741 ms [1.718 ms, 1.765 ms] 389.67 µs (28.8%)
appsec_no_iast 1.749 ms [1.725 ms, 1.773 ms] 397.131 µs (29.4%)
iast 1.505 ms [1.482 ms, 1.527 ms] 152.829 µs (11.3%)
profiling 1.495 ms [1.471 ms, 1.518 ms] 143.011 µs (10.6%)
tracing 1.469 ms [1.445 ms, 1.494 ms] 117.709 µs (8.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jaroslav.bachorik/backport-pr-7915
git_commit_date 1731059125 1731059112
git_commit_sha 864879a 2b90bed
release_version 1.43.0-SNAPSHOT~864879a988 1.43.0-SNAPSHOT~2b90bed8d6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1731060940 1731060940
ci_job_id 700245322 700245322
ci_pipeline_id 48541954 48541954
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.35 ms) : 2308, 2392
.   : milestone, 2350,
iast (2.076 ms) : 2024, 2129
.   : milestone, 2076,
iast_GLOBAL (2.114 ms) : 2062, 2166
.   : milestone, 2114,
profiling (2.405 ms) : 2231, 2579
.   : milestone, 2405,
tracing (1.912 ms) : 1872, 1951
.   : milestone, 1912,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.346 ms) : 2305, 2388
.   : milestone, 2346,
iast (2.079 ms) : 2027, 2131
.   : milestone, 2079,
iast_GLOBAL (2.125 ms) : 2072, 2177
.   : milestone, 2125,
profiling (1.942 ms) : 1900, 1984
.   : milestone, 1942,
tracing (1.92 ms) : 1880, 1961
.   : milestone, 1920,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.35 ms [2.308 ms, 2.392 ms] 875.984 µs (59.4%)
iast 2.076 ms [2.024 ms, 2.129 ms] 602.064 µs (40.8%)
iast_GLOBAL 2.114 ms [2.062 ms, 2.166 ms] 639.797 µs (43.4%)
profiling 2.405 ms [2.231 ms, 2.579 ms] 930.428 µs (63.1%)
tracing 1.912 ms [1.872 ms, 1.951 ms] 437.452 µs (29.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.346 ms [2.305 ms, 2.388 ms] 877.16 µs (59.7%)
iast 2.079 ms [2.027 ms, 2.131 ms] 610.21 µs (41.5%)
iast_GLOBAL 2.125 ms [2.072 ms, 2.177 ms] 655.953 µs (44.7%)
profiling 1.942 ms [1.9 ms, 1.984 ms] 472.979 µs (32.2%)
tracing 1.92 ms [1.88 ms, 1.961 ms] 451.272 µs (30.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.43.0-SNAPSHOT~2b90bed8d6, baseline=1.43.0-SNAPSHOT~864879a988
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.37 s) : 15370000, 15370000
.   : milestone, 15370000,
appsec (15.467 s) : 15467000, 15467000
.   : milestone, 15467000,
iast (18.866 s) : 18866000, 18866000
.   : milestone, 18866000,
iast_GLOBAL (17.705 s) : 17705000, 17705000
.   : milestone, 17705000,
profiling (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
tracing (15.309 s) : 15309000, 15309000
.   : milestone, 15309000,
section candidate
no_agent (15.105 s) : 15105000, 15105000
.   : milestone, 15105000,
appsec (15.297 s) : 15297000, 15297000
.   : milestone, 15297000,
iast (18.529 s) : 18529000, 18529000
.   : milestone, 18529000,
iast_GLOBAL (18.473 s) : 18473000, 18473000
.   : milestone, 18473000,
profiling (15.214 s) : 15214000, 15214000
.   : milestone, 15214000,
tracing (15.384 s) : 15384000, 15384000
.   : milestone, 15384000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.37 s [15.37 s, 15.37 s] -
appsec 15.467 s [15.467 s, 15.467 s] 97.0 ms (0.6%)
iast 18.866 s [18.866 s, 18.866 s] 3.496 s (22.7%)
iast_GLOBAL 17.705 s [17.705 s, 17.705 s] 2.335 s (15.2%)
profiling 15.018 s [15.018 s, 15.018 s] -352.0 ms (-2.3%)
tracing 15.309 s [15.309 s, 15.309 s] -61.0 ms (-0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.105 s [15.105 s, 15.105 s] -
appsec 15.297 s [15.297 s, 15.297 s] 192.0 ms (1.3%)
iast 18.529 s [18.529 s, 18.529 s] 3.424 s (22.7%)
iast_GLOBAL 18.473 s [18.473 s, 18.473 s] 3.368 s (22.3%)
profiling 15.214 s [15.214 s, 15.214 s] 109.0 ms (0.7%)
tracing 15.384 s [15.384 s, 15.384 s] 279.0 ms (1.8%)

@jbachorik jbachorik merged commit df0ec27 into release/v1.42.x Nov 8, 2024
@jbachorik jbachorik deleted the jaroslav.bachorik/backport-pr-7915 branch November 8, 2024 13:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

@richardstartin richardstartin Awaiting requested review from richardstartin

Assignees

No one assigned

Labels

comp: profiling Profiling tag: dependencies Dependencies related changes type: bug Bug report and fix

Projects

None yet

Milestone

1.42.1

Development

Successfully merging this pull request may close these issues.

2 participants

@jbachorik @PerfectSlayer