Skip to content

Compile latest dep tests for Karate with Java 11#8249

Merged
nikita-tkachenko-datadog merged 1 commit intomasterfrom
nikita-tkachenko/fix-karate-latest-dep-test-compilation
Jan 20, 2025
Merged

Compile latest dep tests for Karate with Java 11#8249
nikita-tkachenko-datadog merged 1 commit intomasterfrom
nikita-tkachenko/fix-karate-latest-dep-test-compilation

Conversation

@nikita-tkachenko-datadog
Copy link
Copy Markdown
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Jan 20, 2025

What Does This Do

Updates Gradle task that compiles latest dependency tests for Karate to use Java 11.

Motivation

Karate 1.4.0+ is built with Java 11.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jan 20, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review January 20, 2025 10:12
@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner January 20, 2025 10:12
@nikita-tkachenko-datadog nikita-tkachenko-datadog enabled auto-merge (squash) January 20, 2025 10:12
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Jan 20, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/fix-karate-latest-dep-test-compilation
git_commit_date 1737359998 1737367851
git_commit_sha 0767e3c e7425eb
release_version 1.46.0-SNAPSHOT~0767e3c446 1.46.0-SNAPSHOT~e7425ebcc8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737370208 1737370208
ci_job_id 772395838 772395838
ci_pipeline_id 53456422 53456422
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 2 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055233
Total [baseline] (10.534 s) : 0, 10533748
Agent [candidate] (1.057 s) : 0, 1057365
Total [candidate] (10.521 s) : 0, 10520536
section appsec
Agent [baseline] (1.186 s) : 0, 1185651
Total [baseline] (10.751 s) : 0, 10750843
Agent [candidate] (1.194 s) : 0, 1194093
Total [candidate] (10.738 s) : 0, 10737687
section iast
Agent [baseline] (1.184 s) : 0, 1183871
Total [baseline] (11.004 s) : 0, 11004057
Agent [candidate] (1.186 s) : 0, 1185588
Total [candidate] (11.007 s) : 0, 11007108
section profiling
Agent [baseline] (1.265 s) : 0, 1265360
Total [baseline] (10.854 s) : 0, 10853868
Agent [candidate] (1.258 s) : 0, 1257656
Total [candidate] (10.837 s) : 0, 10836815
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.186 s 130.417 ms (12.4%)
Agent iast 1.184 s 128.638 ms (12.2%)
Agent profiling 1.265 s 210.127 ms (19.9%)
Total tracing 10.534 s -
Total appsec 10.751 s 217.094 ms (2.1%)
Total iast 11.004 s 470.308 ms (4.5%)
Total profiling 10.854 s 320.12 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.194 s 136.728 ms (12.9%)
Agent iast 1.186 s 128.223 ms (12.1%)
Agent profiling 1.258 s 200.291 ms (18.9%)
Total tracing 10.521 s -
Total appsec 10.738 s 217.151 ms (2.1%)
Total iast 11.007 s 486.573 ms (4.6%)
Total profiling 10.837 s 316.28 ms (3.0%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.224 ms) : 0, 714224
BytebuddyAgent [candidate] (714.258 ms) : 0, 714258
GlobalTracer [baseline] (255.329 ms) : 0, 255329
GlobalTracer [candidate] (255.383 ms) : 0, 255383
AppSec [baseline] (55.626 ms) : 0, 55626
AppSec [candidate] (56.335 ms) : 0, 56335
Remote Config [baseline] (731.865 µs) : 0, 732
Remote Config [candidate] (743.173 µs) : 0, 743
Telemetry [baseline] (14.326 ms) : 0, 14326
Telemetry [candidate] (15.685 ms) : 0, 15685
section appsec
BytebuddyAgent [baseline] (729.443 ms) : 0, 729443
BytebuddyAgent [candidate] (734.799 ms) : 0, 734799
GlobalTracer [baseline] (252.137 ms) : 0, 252137
GlobalTracer [candidate] (254.11 ms) : 0, 254110
AppSec [baseline] (170.659 ms) : 0, 170659
AppSec [candidate] (171.5 ms) : 0, 171500
Remote Config [baseline] (662.129 µs) : 0, 662
Remote Config [candidate] (664.389 µs) : 0, 664
Telemetry [baseline] (8.175 ms) : 0, 8175
Telemetry [candidate] (8.201 ms) : 0, 8201
IAST [baseline] (19.338 ms) : 0, 19338
IAST [candidate] (19.575 ms) : 0, 19575
section iast
BytebuddyAgent [baseline] (832.008 ms) : 0, 832008
BytebuddyAgent [candidate] (833.552 ms) : 0, 833552
GlobalTracer [baseline] (246.786 ms) : 0, 246786
GlobalTracer [candidate] (247.268 ms) : 0, 247268
AppSec [baseline] (58.691 ms) : 0, 58691
AppSec [candidate] (58.64 ms) : 0, 58640
Remote Config [baseline] (680.108 µs) : 0, 680
Remote Config [candidate] (658.864 µs) : 0, 659
Telemetry [baseline] (8.872 ms) : 0, 8872
Telemetry [candidate] (8.825 ms) : 0, 8825
IAST [baseline] (21.909 ms) : 0, 21909
IAST [candidate] (21.632 ms) : 0, 21632
section profiling
BytebuddyAgent [baseline] (709.904 ms) : 0, 709904
BytebuddyAgent [candidate] (703.917 ms) : 0, 703917
GlobalTracer [baseline] (352.565 ms) : 0, 352565
GlobalTracer [candidate] (351.365 ms) : 0, 351365
AppSec [baseline] (55.236 ms) : 0, 55236
AppSec [candidate] (54.572 ms) : 0, 54572
Remote Config [baseline] (708.743 µs) : 0, 709
Remote Config [candidate] (720.602 µs) : 0, 721
Telemetry [baseline] (8.844 ms) : 0, 8844
Telemetry [candidate] (8.94 ms) : 0, 8940
ProfilingAgent [baseline] (95.614 ms) : 0, 95614
ProfilingAgent [candidate] (96.246 ms) : 0, 96246
Profiling [baseline] (95.638 ms) : 0, 95638
Profiling [candidate] (96.27 ms) : 0, 96270
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062303
Total [baseline] (8.645 s) : 0, 8645351
Agent [candidate] (1.064 s) : 0, 1063555
Total [candidate] (8.654 s) : 0, 8653960
section iast
Agent [baseline] (1.192 s) : 0, 1191654
Total [baseline] (9.231 s) : 0, 9231371
Agent [candidate] (1.196 s) : 0, 1196461
Total [candidate] (9.262 s) : 0, 9261744
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.179 s) : 0, 1179334
Total [baseline] (9.204 s) : 0, 9203636
Agent [candidate] (1.188 s) : 0, 1188246
Total [candidate] (9.203 s) : 0, 9202784
section iast_TELEMETRY_OFF
Agent [baseline] (1.187 s) : 0, 1186662
Total [baseline] (9.194 s) : 0, 9193795
Agent [candidate] (1.179 s) : 0, 1178703
Total [candidate] (9.214 s) : 0, 9213733
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.192 s 129.351 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.179 s 117.031 ms (11.0%)
Agent iast_TELEMETRY_OFF 1.187 s 124.359 ms (11.7%)
Total tracing 8.645 s -
Total iast 9.231 s 586.02 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.204 s 558.285 ms (6.5%)
Total iast_TELEMETRY_OFF 9.194 s 548.445 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.196 s 132.907 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.188 s 124.691 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.179 s 115.148 ms (10.8%)
Total tracing 8.654 s -
Total iast 9.262 s 607.784 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.203 s 548.824 ms (6.3%)
Total iast_TELEMETRY_OFF 9.214 s 559.774 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.4 ms) : 0, 718400
BytebuddyAgent [candidate] (719.475 ms) : 0, 719475
GlobalTracer [baseline] (257.366 ms) : 0, 257366
GlobalTracer [candidate] (257.441 ms) : 0, 257441
AppSec [baseline] (56.554 ms) : 0, 56554
AppSec [candidate] (55.895 ms) : 0, 55895
Remote Config [baseline] (742.223 µs) : 0, 742
Remote Config [candidate] (732.345 µs) : 0, 732
Telemetry [baseline] (14.204 ms) : 0, 14204
Telemetry [candidate] (14.931 ms) : 0, 14931
section iast
BytebuddyAgent [baseline] (838.751 ms) : 0, 838751
BytebuddyAgent [candidate] (840.551 ms) : 0, 840551
GlobalTracer [baseline] (248.031 ms) : 0, 248031
GlobalTracer [candidate] (249.92 ms) : 0, 249920
AppSec [baseline] (58.612 ms) : 0, 58612
AppSec [candidate] (59.195 ms) : 0, 59195
IAST [baseline] (21.628 ms) : 0, 21628
IAST [candidate] (21.971 ms) : 0, 21971
Remote Config [baseline] (673.858 µs) : 0, 674
Remote Config [candidate] (687.242 µs) : 0, 687
Telemetry [baseline] (8.882 ms) : 0, 8882
Telemetry [candidate] (9.043 ms) : 0, 9043
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (829.259 ms) : 0, 829259
BytebuddyAgent [candidate] (835.195 ms) : 0, 835195
GlobalTracer [baseline] (246.01 ms) : 0, 246010
GlobalTracer [candidate] (247.69 ms) : 0, 247690
AppSec [baseline] (58.176 ms) : 0, 58176
AppSec [candidate] (58.727 ms) : 0, 58727
IAST [baseline] (21.549 ms) : 0, 21549
IAST [candidate] (21.909 ms) : 0, 21909
Remote Config [baseline] (664.816 µs) : 0, 665
Remote Config [candidate] (690.929 µs) : 0, 691
Telemetry [baseline] (8.737 ms) : 0, 8737
Telemetry [candidate] (9.023 ms) : 0, 9023
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.665 ms) : 0, 834665
BytebuddyAgent [candidate] (829.112 ms) : 0, 829112
GlobalTracer [baseline] (248.229 ms) : 0, 248229
GlobalTracer [candidate] (246.307 ms) : 0, 246307
AppSec [baseline] (58.218 ms) : 0, 58218
AppSec [candidate] (58.102 ms) : 0, 58102
IAST [baseline] (21.08 ms) : 0, 21080
IAST [candidate] (20.981 ms) : 0, 20981
Remote Config [baseline] (672.444 µs) : 0, 672
Remote Config [candidate] (652.682 µs) : 0, 653
Telemetry [baseline] (8.777 ms) : 0, 8777
Telemetry [candidate] (8.588 ms) : 0, 8588
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-20T10:24:44 2025-01-20T10:31:48
git_branch master nikita-tkachenko/fix-karate-latest-dep-test-compilation
git_commit_date 1737359998 1737367851
git_commit_sha 0767e3c e7425eb
release_version 1.46.0-SNAPSHOT~0767e3c446 1.46.0-SNAPSHOT~e7425ebcc8
start_time 2025-01-20T10:24:30 2025-01-20T10:31:34
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737369464 1737369464
ci_job_id 772395840 772395840
ci_pipeline_id 53456422 53456422
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.346 ms) : 1326, 1365
.   : milestone, 1346,
appsec (1.752 ms) : 1729, 1776
.   : milestone, 1752,
appsec_no_iast (1.746 ms) : 1722, 1769
.   : milestone, 1746,
iast (1.519 ms) : 1496, 1542
.   : milestone, 1519,
profiling (1.498 ms) : 1474, 1522
.   : milestone, 1498,
tracing (1.494 ms) : 1469, 1519
.   : milestone, 1494,
section candidate
no_agent (1.367 ms) : 1348, 1387
.   : milestone, 1367,
appsec (1.732 ms) : 1708, 1755
.   : milestone, 1732,
appsec_no_iast (1.744 ms) : 1721, 1767
.   : milestone, 1744,
iast (1.486 ms) : 1462, 1510
.   : milestone, 1486,
profiling (1.529 ms) : 1504, 1554
.   : milestone, 1529,
tracing (1.491 ms) : 1467, 1515
.   : milestone, 1491,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.346 ms [1.326 ms, 1.365 ms] -
appsec 1.752 ms [1.729 ms, 1.776 ms] 406.409 µs (30.2%)
appsec_no_iast 1.746 ms [1.722 ms, 1.769 ms] 400.143 µs (29.7%)
iast 1.519 ms [1.496 ms, 1.542 ms] 173.341 µs (12.9%)
profiling 1.498 ms [1.474 ms, 1.522 ms] 152.423 µs (11.3%)
tracing 1.494 ms [1.469 ms, 1.519 ms] 148.449 µs (11.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.348 ms, 1.387 ms] -
appsec 1.732 ms [1.708 ms, 1.755 ms] 364.197 µs (26.6%)
appsec_no_iast 1.744 ms [1.721 ms, 1.767 ms] 376.359 µs (27.5%)
iast 1.486 ms [1.462 ms, 1.51 ms] 118.483 µs (8.7%)
profiling 1.529 ms [1.504 ms, 1.554 ms] 161.654 µs (11.8%)
tracing 1.491 ms [1.467 ms, 1.515 ms] 123.633 µs (9.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446
    dateFormat X
    axisFormat %s
section baseline
no_agent (369.213 µs) : 349, 389
.   : milestone, 369,
iast (507.306 µs) : 486, 529
.   : milestone, 507,
iast_FULL (746.069 µs) : 724, 768
.   : milestone, 746,
iast_GLOBAL (557.696 µs) : 536, 580
.   : milestone, 558,
iast_HARDCODED_SECRET_DISABLED (505.205 µs) : 484, 527
.   : milestone, 505,
iast_INACTIVE (458.87 µs) : 438, 480
.   : milestone, 459,
iast_TELEMETRY_OFF (495.287 µs) : 474, 517
.   : milestone, 495,
tracing (451.961 µs) : 430, 474
.   : milestone, 452,
section candidate
no_agent (375.97 µs) : 356, 396
.   : milestone, 376,
iast (510.284 µs) : 487, 534
.   : milestone, 510,
iast_FULL (735.802 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (551.624 µs) : 530, 573
.   : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (512.14 µs) : 490, 534
.   : milestone, 512,
iast_INACTIVE (457.836 µs) : 437, 479
.   : milestone, 458,
iast_TELEMETRY_OFF (496.427 µs) : 474, 519
.   : milestone, 496,
tracing (452.214 µs) : 431, 473
.   : milestone, 452,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.213 µs [349.272 µs, 389.154 µs] -
iast 507.306 µs [485.578 µs, 529.035 µs] 138.094 µs (37.4%)
iast_FULL 746.069 µs [723.816 µs, 768.323 µs] 376.857 µs (102.1%)
iast_GLOBAL 557.696 µs [535.675 µs, 579.716 µs] 188.483 µs (51.1%)
iast_HARDCODED_SECRET_DISABLED 505.205 µs [483.62 µs, 526.789 µs] 135.992 µs (36.8%)
iast_INACTIVE 458.87 µs [437.738 µs, 480.002 µs] 89.657 µs (24.3%)
iast_TELEMETRY_OFF 495.287 µs [473.887 µs, 516.687 µs] 126.075 µs (34.1%)
tracing 451.961 µs [429.584 µs, 474.338 µs] 82.748 µs (22.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.97 µs [356.146 µs, 395.793 µs] -
iast 510.284 µs [486.789 µs, 533.778 µs] 134.314 µs (35.7%)
iast_FULL 735.802 µs [714.068 µs, 757.537 µs] 359.833 µs (95.7%)
iast_GLOBAL 551.624 µs [529.757 µs, 573.49 µs] 175.654 µs (46.7%)
iast_HARDCODED_SECRET_DISABLED 512.14 µs [490.233 µs, 534.047 µs] 136.171 µs (36.2%)
iast_INACTIVE 457.836 µs [436.565 µs, 479.106 µs] 81.866 µs (21.8%)
iast_TELEMETRY_OFF 496.427 µs [474.236 µs, 518.618 µs] 120.457 µs (32.0%)
tracing 452.214 µs [431.429 µs, 472.999 µs] 76.244 µs (20.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/fix-karate-latest-dep-test-compilation
git_commit_date 1737359998 1737367851
git_commit_sha 0767e3c e7425eb
release_version 1.46.0-SNAPSHOT~0767e3c446 1.46.0-SNAPSHOT~e7425ebcc8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737370046 1737370046
ci_job_id 772395843 772395843
ci_pipeline_id 53456422 53456422
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.443 s) : 15443000, 15443000
.   : milestone, 15443000,
appsec (14.908 s) : 14908000, 14908000
.   : milestone, 14908000,
iast (18.968 s) : 18968000, 18968000
.   : milestone, 18968000,
iast_GLOBAL (17.883 s) : 17883000, 17883000
.   : milestone, 17883000,
profiling (15.544 s) : 15544000, 15544000
.   : milestone, 15544000,
tracing (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
section candidate
no_agent (15.528 s) : 15528000, 15528000
.   : milestone, 15528000,
appsec (14.885 s) : 14885000, 14885000
.   : milestone, 14885000,
iast (18.841 s) : 18841000, 18841000
.   : milestone, 18841000,
iast_GLOBAL (18.019 s) : 18019000, 18019000
.   : milestone, 18019000,
profiling (15.114 s) : 15114000, 15114000
.   : milestone, 15114000,
tracing (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.443 s [15.443 s, 15.443 s] -
appsec 14.908 s [14.908 s, 14.908 s] -535.0 ms (-3.5%)
iast 18.968 s [18.968 s, 18.968 s] 3.525 s (22.8%)
iast_GLOBAL 17.883 s [17.883 s, 17.883 s] 2.44 s (15.8%)
profiling 15.544 s [15.544 s, 15.544 s] 101.0 ms (0.7%)
tracing 15.001 s [15.001 s, 15.001 s] -442.0 ms (-2.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.528 s [15.528 s, 15.528 s] -
appsec 14.885 s [14.885 s, 14.885 s] -643.0 ms (-4.1%)
iast 18.841 s [18.841 s, 18.841 s] 3.313 s (21.3%)
iast_GLOBAL 18.019 s [18.019 s, 18.019 s] 2.491 s (16.0%)
profiling 15.114 s [15.114 s, 15.114 s] -414.0 ms (-2.7%)
tracing 14.976 s [14.976 s, 14.976 s] -552.0 ms (-3.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~e7425ebcc8, baseline=1.46.0-SNAPSHOT~0767e3c446
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (2.352 ms) : 2309, 2395
.   : milestone, 2352,
iast (2.091 ms) : 2037, 2145
.   : milestone, 2091,
iast_GLOBAL (2.139 ms) : 2085, 2194
.   : milestone, 2139,
profiling (1.966 ms) : 1921, 2011
.   : milestone, 1966,
tracing (1.935 ms) : 1892, 1977
.   : milestone, 1935,
section candidate
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (2.334 ms) : 2292, 2377
.   : milestone, 2334,
iast (2.096 ms) : 2042, 2150
.   : milestone, 2096,
iast_GLOBAL (2.143 ms) : 2088, 2198
.   : milestone, 2143,
profiling (1.964 ms) : 1920, 2009
.   : milestone, 1964,
tracing (1.943 ms) : 1900, 1985
.   : milestone, 1943,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.455 ms, 1.478 ms] -
appsec 2.352 ms [2.309 ms, 2.395 ms] 885.514 µs (60.4%)
iast 2.091 ms [2.037 ms, 2.145 ms] 624.17 µs (42.6%)
iast_GLOBAL 2.139 ms [2.085 ms, 2.194 ms] 672.897 µs (45.9%)
profiling 1.966 ms [1.921 ms, 2.011 ms] 499.524 µs (34.1%)
tracing 1.935 ms [1.892 ms, 1.977 ms] 468.248 µs (31.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.455 ms, 1.478 ms] -
appsec 2.334 ms [2.292 ms, 2.377 ms] 867.773 µs (59.2%)
iast 2.096 ms [2.042 ms, 2.15 ms] 629.678 µs (42.9%)
iast_GLOBAL 2.143 ms [2.088 ms, 2.198 ms] 676.655 µs (46.1%)
profiling 1.964 ms [1.92 ms, 2.009 ms] 498.013 µs (34.0%)
tracing 1.943 ms [1.9 ms, 1.985 ms] 476.28 µs (32.5%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit 4ce36ea into master Jan 20, 2025
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/fix-karate-latest-dep-test-compilation branch January 20, 2025 11:05
@github-actions github-actions Bot added this to the 1.46.0 milestone Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@amarziali amarziali amarziali approved these changes

@juan-fernandez juan-fernandez Awaiting requested review from juan-fernandez juan-fernandez was automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility comp: testing Testing tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.46.0

Development

Successfully merging this pull request may close these issues.

3 participants

@nikita-tkachenko-datadog @mcculls @amarziali