Skip to content

Stable test names in Mongo instrumentation tests#7650

Merged
smola merged 1 commit intomasterfrom
smola/stable-test-mongo
Sep 20, 2024
Merged

Stable test names in Mongo instrumentation tests#7650
smola merged 1 commit intomasterfrom
smola/stable-test-mongo

Conversation

@smola
Copy link
Copy Markdown
Member

@smola smola commented Sep 20, 2024

What Does This Do

Motivation

Avoid unstable test names, such as test create collection [collectionName: testCollection-806d900f-caae-483d-ad69-df899f2169bc, renameService: false, #0]. These prevent flakiness detection.

Additional Notes

Contributor Checklist

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes inst: mongodb MongoDB instrumentation labels Sep 20, 2024
@smola smola requested a review from a team as a code owner September 20, 2024 06:43
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Sep 20, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/stable-test-mongo
git_commit_date 1726810927 1726814491
git_commit_sha 92a664b 3689e11
release_version 1.40.0-SNAPSHOT~92a664b5b9 1.40.0-SNAPSHOT~3689e11bcd
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1726817026 1726817026
ci_job_id 646004818 646004818
ci_pipeline_id 44764464 44764464
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1069828
Total [baseline] (8.556 s) : 0, 8555876
Agent [candidate] (1.068 s) : 0, 1068084
Total [candidate] (8.572 s) : 0, 8572385
section iast
Agent [baseline] (1.193 s) : 0, 1193122
Total [baseline] (9.025 s) : 0, 9025163
Agent [candidate] (1.193 s) : 0, 1192872
Total [candidate] (9.015 s) : 0, 9015432
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.202 s) : 0, 1201503
Total [baseline] (9.022 s) : 0, 9022450
Agent [candidate] (1.2 s) : 0, 1200274
Total [candidate] (9.011 s) : 0, 9011076
section iast_TELEMETRY_OFF
Agent [baseline] (1.189 s) : 0, 1188610
Total [baseline] (9.028 s) : 0, 9028086
Agent [candidate] (1.191 s) : 0, 1190738
Total [candidate] (9.107 s) : 0, 9106649
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.193 s 123.293 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.202 s 131.674 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.189 s 118.782 ms (11.1%)
Total tracing 8.556 s -
Total iast 9.025 s 469.287 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.022 s 466.574 ms (5.5%)
Total iast_TELEMETRY_OFF 9.028 s 472.21 ms (5.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.193 s 124.788 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.2 s 132.19 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.191 s 122.655 ms (11.5%)
Total tracing 8.572 s -
Total iast 9.015 s 443.047 ms (5.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.011 s 438.691 ms (5.1%)
Total iast_TELEMETRY_OFF 9.107 s 534.264 ms (6.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.778 ms) : 0, 681778
BytebuddyAgent [candidate] (680.468 ms) : 0, 680468
GlobalTracer [baseline] (311.711 ms) : 0, 311711
GlobalTracer [candidate] (311.629 ms) : 0, 311629
AppSec [baseline] (54.142 ms) : 0, 54142
AppSec [candidate] (53.916 ms) : 0, 53916
Remote Config [baseline] (674.723 µs) : 0, 675
Remote Config [candidate] (670.207 µs) : 0, 670
Telemetry [baseline] (7.723 ms) : 0, 7723
Telemetry [candidate] (7.628 ms) : 0, 7628
section iast
BytebuddyAgent [baseline] (792.87 ms) : 0, 792870
BytebuddyAgent [candidate] (793.293 ms) : 0, 793293
GlobalTracer [baseline] (300.135 ms) : 0, 300135
GlobalTracer [candidate] (300.087 ms) : 0, 300087
AppSec [baseline] (54.752 ms) : 0, 54752
AppSec [candidate] (55.319 ms) : 0, 55319
Remote Config [baseline] (609.301 µs) : 0, 609
Remote Config [candidate] (628.285 µs) : 0, 628
Telemetry [baseline] (7.365 ms) : 0, 7365
Telemetry [candidate] (7.49 ms) : 0, 7490
IAST [baseline] (23.601 ms) : 0, 23601
IAST [candidate] (22.206 ms) : 0, 22206
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (798.67 ms) : 0, 798670
BytebuddyAgent [candidate] (798.103 ms) : 0, 798103
GlobalTracer [baseline] (302.161 ms) : 0, 302161
GlobalTracer [candidate] (301.686 ms) : 0, 301686
AppSec [baseline] (56.53 ms) : 0, 56530
AppSec [candidate] (56.632 ms) : 0, 56632
Remote Config [baseline] (612.967 µs) : 0, 613
Remote Config [candidate] (650.564 µs) : 0, 651
Telemetry [baseline] (7.496 ms) : 0, 7496
Telemetry [candidate] (7.396 ms) : 0, 7396
IAST [baseline] (22.179 ms) : 0, 22179
IAST [candidate] (21.943 ms) : 0, 21943
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (788.245 ms) : 0, 788245
BytebuddyAgent [candidate] (789.852 ms) : 0, 789852
GlobalTracer [baseline] (300.178 ms) : 0, 300178
GlobalTracer [candidate] (300.44 ms) : 0, 300440
AppSec [baseline] (54.439 ms) : 0, 54439
AppSec [candidate] (53.88 ms) : 0, 53880
Remote Config [baseline] (1.448 ms) : 0, 1448
Remote Config [candidate] (609.553 µs) : 0, 610
Telemetry [baseline] (7.227 ms) : 0, 7227
Telemetry [candidate] (7.223 ms) : 0, 7223
IAST [baseline] (23.287 ms) : 0, 23287
IAST [candidate] (24.96 ms) : 0, 24960
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.073 s) : 0, 1072662
Total [baseline] (10.382 s) : 0, 10381702
Agent [candidate] (1.068 s) : 0, 1067557
Total [candidate] (10.421 s) : 0, 10420871
section appsec
Agent [baseline] (1.208 s) : 0, 1207832
Total [baseline] (10.702 s) : 0, 10702449
Agent [candidate] (1.205 s) : 0, 1205157
Total [candidate] (10.754 s) : 0, 10753730
section iast
Agent [baseline] (1.202 s) : 0, 1201582
Total [baseline] (10.902 s) : 0, 10901784
Agent [candidate] (1.209 s) : 0, 1208523
Total [candidate] (10.868 s) : 0, 10867627
section profiling
Agent [baseline] (1.278 s) : 0, 1277718
Total [baseline] (10.636 s) : 0, 10635529
Agent [candidate] (1.286 s) : 0, 1285681
Total [candidate] (10.681 s) : 0, 10680827
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.208 s 135.171 ms (12.6%)
Agent iast 1.202 s 128.92 ms (12.0%)
Agent profiling 1.278 s 205.056 ms (19.1%)
Total tracing 10.382 s -
Total appsec 10.702 s 320.747 ms (3.1%)
Total iast 10.902 s 520.082 ms (5.0%)
Total profiling 10.636 s 253.826 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.205 s 137.6 ms (12.9%)
Agent iast 1.209 s 140.966 ms (13.2%)
Agent profiling 1.286 s 218.124 ms (20.4%)
Total tracing 10.421 s -
Total appsec 10.754 s 332.859 ms (3.2%)
Total iast 10.868 s 446.756 ms (4.3%)
Total profiling 10.681 s 259.956 ms (2.5%) 
gantt
    title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.36 ms) : 0, 684360
BytebuddyAgent [candidate] (680.342 ms) : 0, 680342
GlobalTracer [baseline] (312.147 ms) : 0, 312147
GlobalTracer [candidate] (311.52 ms) : 0, 311520
AppSec [baseline] (54.021 ms) : 0, 54021
AppSec [candidate] (53.619 ms) : 0, 53619
Remote Config [baseline] (668.533 µs) : 0, 669
Remote Config [candidate] (667.837 µs) : 0, 668
Telemetry [baseline] (7.647 ms) : 0, 7647
Telemetry [candidate] (7.671 ms) : 0, 7671
section appsec
BytebuddyAgent [baseline] (705.44 ms) : 0, 705440
BytebuddyAgent [candidate] (703.052 ms) : 0, 703052
GlobalTracer [baseline] (305.862 ms) : 0, 305862
GlobalTracer [candidate] (304.512 ms) : 0, 304512
AppSec [baseline] (163.141 ms) : 0, 163141
AppSec [candidate] (162.573 ms) : 0, 162573
IAST [baseline] (20.128 ms) : 0, 20128
IAST [candidate] (22.968 ms) : 0, 22968
Remote Config [baseline] (649.457 µs) : 0, 649
Remote Config [candidate] (646.836 µs) : 0, 647
Telemetry [baseline] (8.898 ms) : 0, 8898
Telemetry [candidate] (9.149 ms) : 0, 9149
section iast
BytebuddyAgent [baseline] (798.956 ms) : 0, 798956
BytebuddyAgent [candidate] (802.465 ms) : 0, 802465
GlobalTracer [baseline] (302.065 ms) : 0, 302065
GlobalTracer [candidate] (304.518 ms) : 0, 304518
AppSec [baseline] (56.736 ms) : 0, 56736
AppSec [candidate] (55.62 ms) : 0, 55620
IAST [baseline] (21.986 ms) : 0, 21986
IAST [candidate] (23.927 ms) : 0, 23927
Remote Config [baseline] (614.189 µs) : 0, 614
Remote Config [candidate] (632.127 µs) : 0, 632
Telemetry [baseline] (7.358 ms) : 0, 7358
Telemetry [candidate] (7.48 ms) : 0, 7480
section profiling
BytebuddyAgent [baseline] (679.653 ms) : 0, 679653
BytebuddyAgent [candidate] (684.484 ms) : 0, 684484
GlobalTracer [baseline] (399.584 ms) : 0, 399584
GlobalTracer [candidate] (400.008 ms) : 0, 400008
AppSec [baseline] (54.824 ms) : 0, 54824
AppSec [candidate] (55.44 ms) : 0, 55440
Remote Config [baseline] (662.62 µs) : 0, 663
Remote Config [candidate] (672.927 µs) : 0, 673
Telemetry [baseline] (7.557 ms) : 0, 7557
Telemetry [candidate] (7.643 ms) : 0, 7643
ProfilingAgent [baseline] (96.784 ms) : 0, 96784
ProfilingAgent [candidate] (98.567 ms) : 0, 98567
Profiling [baseline] (96.809 ms) : 0, 96809
Profiling [candidate] (98.591 ms) : 0, 98591
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-20T06:54:15 2024-09-20T07:01:05
git_branch master smola/stable-test-mongo
git_commit_date 1726810927 1726814491
git_commit_sha 92a664b 3689e11
release_version 1.40.0-SNAPSHOT~92a664b5b9 1.40.0-SNAPSHOT~3689e11bcd
start_time 2024-09-20T06:54:02 2024-09-20T07:00:52
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1726816012 1726816012
ci_job_id 646004819 646004819
ci_pipeline_id 44764464 44764464
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1374
.   : milestone, 1354,
appsec (1.691 ms) : 1665, 1717
.   : milestone, 1691,
appsec_no_iast (1.723 ms) : 1700, 1747
.   : milestone, 1723,
iast (1.467 ms) : 1444, 1489
.   : milestone, 1467,
profiling (1.466 ms) : 1441, 1491
.   : milestone, 1466,
tracing (1.479 ms) : 1455, 1504
.   : milestone, 1479,
section candidate
no_agent (1.335 ms) : 1316, 1355
.   : milestone, 1335,
appsec (1.713 ms) : 1689, 1737
.   : milestone, 1713,
appsec_no_iast (1.718 ms) : 1695, 1741
.   : milestone, 1718,
iast (1.483 ms) : 1460, 1505
.   : milestone, 1483,
profiling (1.516 ms) : 1490, 1542
.   : milestone, 1516,
tracing (1.468 ms) : 1443, 1493
.   : milestone, 1468,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.374 ms] -
appsec 1.691 ms [1.665 ms, 1.717 ms] 337.516 µs (24.9%)
appsec_no_iast 1.723 ms [1.7 ms, 1.747 ms] 369.738 µs (27.3%)
iast 1.467 ms [1.444 ms, 1.489 ms] 112.859 µs (8.3%)
profiling 1.466 ms [1.441 ms, 1.491 ms] 112.697 µs (8.3%)
tracing 1.479 ms [1.455 ms, 1.504 ms] 125.679 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.335 ms [1.316 ms, 1.355 ms] -
appsec 1.713 ms [1.689 ms, 1.737 ms] 377.314 µs (28.3%)
appsec_no_iast 1.718 ms [1.695 ms, 1.741 ms] 382.563 µs (28.6%)
iast 1.483 ms [1.46 ms, 1.505 ms] 147.201 µs (11.0%)
profiling 1.516 ms [1.49 ms, 1.542 ms] 180.651 µs (13.5%)
tracing 1.468 ms [1.443 ms, 1.493 ms] 132.775 µs (9.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (373.039 µs) : 351, 395
.   : milestone, 373,
iast (483.128 µs) : 462, 505
.   : milestone, 483,
iast_FULL (554.828 µs) : 533, 576
.   : milestone, 555,
iast_GLOBAL (507.126 µs) : 485, 529
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (483.212 µs) : 462, 504
.   : milestone, 483,
iast_INACTIVE (448.495 µs) : 427, 470
.   : milestone, 448,
iast_TELEMETRY_OFF (472.215 µs) : 449, 495
.   : milestone, 472,
tracing (440.055 µs) : 419, 461
.   : milestone, 440,
section candidate
no_agent (368.351 µs) : 349, 388
.   : milestone, 368,
iast (484.724 µs) : 463, 506
.   : milestone, 485,
iast_FULL (551.134 µs) : 530, 572
.   : milestone, 551,
iast_GLOBAL (507.058 µs) : 485, 529
.   : milestone, 507,
iast_HARDCODED_SECRET_DISABLED (478.312 µs) : 457, 500
.   : milestone, 478,
iast_INACTIVE (451.697 µs) : 430, 473
.   : milestone, 452,
iast_TELEMETRY_OFF (471.391 µs) : 449, 494
.   : milestone, 471,
tracing (439.543 µs) : 419, 460
.   : milestone, 440,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.039 µs [350.672 µs, 395.406 µs] -
iast 483.128 µs [461.699 µs, 504.557 µs] 110.089 µs (29.5%)
iast_FULL 554.828 µs [533.302 µs, 576.353 µs] 181.789 µs (48.7%)
iast_GLOBAL 507.126 µs [485.42 µs, 528.832 µs] 134.087 µs (35.9%)
iast_HARDCODED_SECRET_DISABLED 483.212 µs [462.026 µs, 504.398 µs] 110.173 µs (29.5%)
iast_INACTIVE 448.495 µs [426.98 µs, 470.009 µs] 75.456 µs (20.2%)
iast_TELEMETRY_OFF 472.215 µs [449.381 µs, 495.049 µs] 99.176 µs (26.6%)
tracing 440.055 µs [419.239 µs, 460.871 µs] 67.016 µs (18.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 368.351 µs [348.572 µs, 388.13 µs] -
iast 484.724 µs [463.021 µs, 506.427 µs] 116.373 µs (31.6%)
iast_FULL 551.134 µs [529.943 µs, 572.324 µs] 182.783 µs (49.6%)
iast_GLOBAL 507.058 µs [485.482 µs, 528.633 µs] 138.707 µs (37.7%)
iast_HARDCODED_SECRET_DISABLED 478.312 µs [457.009 µs, 499.615 µs] 109.961 µs (29.9%)
iast_INACTIVE 451.697 µs [430.073 µs, 473.32 µs] 83.346 µs (22.6%)
iast_TELEMETRY_OFF 471.391 µs [448.941 µs, 493.84 µs] 103.04 µs (28.0%)
tracing 439.543 µs [419.209 µs, 459.876 µs] 71.192 µs (19.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/stable-test-mongo
git_commit_date 1726810927 1726814491
git_commit_sha 92a664b 3689e11
release_version 1.40.0-SNAPSHOT~92a664b5b9 1.40.0-SNAPSHOT~3689e11bcd
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1726816533 1726816533
ci_job_id 646004820 646004820
ci_pipeline_id 44764464 44764464
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1467, 1491
.   : milestone, 1479,
appsec (2.338 ms) : 2296, 2379
.   : milestone, 2338,
iast (2.084 ms) : 2033, 2136
.   : milestone, 2084,
iast_GLOBAL (2.118 ms) : 2066, 2169
.   : milestone, 2118,
profiling (1.95 ms) : 1909, 1991
.   : milestone, 1950,
tracing (1.926 ms) : 1887, 1964
.   : milestone, 1926,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.329 ms) : 2288, 2370
.   : milestone, 2329,
iast (2.059 ms) : 2010, 2109
.   : milestone, 2059,
iast_GLOBAL (2.108 ms) : 2058, 2158
.   : milestone, 2108,
profiling (1.935 ms) : 1895, 1974
.   : milestone, 1935,
tracing (1.913 ms) : 1874, 1951
.   : milestone, 1913,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.491 ms] -
appsec 2.338 ms [2.296 ms, 2.379 ms] 858.812 µs (58.1%)
iast 2.084 ms [2.033 ms, 2.136 ms] 605.459 µs (40.9%)
iast_GLOBAL 2.118 ms [2.066 ms, 2.169 ms] 638.814 µs (43.2%)
profiling 1.95 ms [1.909 ms, 1.991 ms] 470.954 µs (31.8%)
tracing 1.926 ms [1.887 ms, 1.964 ms] 446.548 µs (30.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.329 ms [2.288 ms, 2.37 ms] 859.953 µs (58.5%)
iast 2.059 ms [2.01 ms, 2.109 ms] 590.367 µs (40.2%)
iast_GLOBAL 2.108 ms [2.058 ms, 2.158 ms] 639.092 µs (43.5%)
profiling 1.935 ms [1.895 ms, 1.974 ms] 465.557 µs (31.7%)
tracing 1.913 ms [1.874 ms, 1.951 ms] 443.508 µs (30.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~3689e11bcd, baseline=1.40.0-SNAPSHOT~92a664b5b9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.455 s) : 15455000, 15455000
.   : milestone, 15455000,
appsec (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
iast (18.995 s) : 18995000, 18995000
.   : milestone, 18995000,
iast_GLOBAL (18.216 s) : 18216000, 18216000
.   : milestone, 18216000,
profiling (15.257 s) : 15257000, 15257000
.   : milestone, 15257000,
tracing (15.092 s) : 15092000, 15092000
.   : milestone, 15092000,
section candidate
no_agent (14.816 s) : 14816000, 14816000
.   : milestone, 14816000,
appsec (15.284 s) : 15284000, 15284000
.   : milestone, 15284000,
iast (18.811 s) : 18811000, 18811000
.   : milestone, 18811000,
iast_GLOBAL (18.025 s) : 18025000, 18025000
.   : milestone, 18025000,
profiling (15.712 s) : 15712000, 15712000
.   : milestone, 15712000,
tracing (15.105 s) : 15105000, 15105000
.   : milestone, 15105000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.455 s [15.455 s, 15.455 s] -
appsec 15.23 s [15.23 s, 15.23 s] -225.0 ms (-1.5%)
iast 18.995 s [18.995 s, 18.995 s] 3.54 s (22.9%)
iast_GLOBAL 18.216 s [18.216 s, 18.216 s] 2.761 s (17.9%)
profiling 15.257 s [15.257 s, 15.257 s] -198.0 ms (-1.3%)
tracing 15.092 s [15.092 s, 15.092 s] -363.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.816 s [14.816 s, 14.816 s] -
appsec 15.284 s [15.284 s, 15.284 s] 468.0 ms (3.2%)
iast 18.811 s [18.811 s, 18.811 s] 3.995 s (27.0%)
iast_GLOBAL 18.025 s [18.025 s, 18.025 s] 3.209 s (21.7%)
profiling 15.712 s [15.712 s, 15.712 s] 896.0 ms (6.0%)
tracing 15.105 s [15.105 s, 15.105 s] 289.0 ms (2.0%)

PerfectSlayer
PerfectSlayer approved these changes Sep 20, 2024
View reviewed changes
Copy link
Copy Markdown
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the improvement!

@smola smola merged commit f681000 into master Sep 20, 2024
@smola smola deleted the smola/stable-test-mongo branch September 20, 2024 14:41
@github-actions github-actions Bot added this to the 1.40.0 milestone Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@amarziali amarziali amarziali approved these changes

Assignees

No one assigned

Labels

comp: testing Testing inst: mongodb MongoDB instrumentation tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.40.0

Development

Successfully merging this pull request may close these issues.

3 participants

@smola @PerfectSlayer @amarziali