Datadog Report

Branch report: dani/iast/cookie_filter
Commit report: 37ec8db
Test service: dd-trace-dotnet

✅ 0 Failed, 300069 Passed, 1581 Skipped, 12h 50m 53.07s Total Time

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

• This PR (5947)
• master

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

• Welch test with statistical test for significance of 5%
• Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

Benchmarks Report for appsec 🐌

Benchmarks for #5947 compared to master:

• 2 benchmarks are faster, with geometric mean 1.179
• 2 benchmarks have fewer allocations

The following thresholds were used for comparing the benchmark speeds:

• Mann–Whitney U test with statistical test for significance of 5%
• Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks Report for tracer 🐌

Benchmarks for #5947 compared to master:

• 1 benchmarks are slower, with geometric mean 1.207
• All benchmarks have the same allocations

The following thresholds were used for comparing the benchmark speeds:

• Mann–Whitney U test with statistical test for significance of 5%
• Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Snapshots difference summary

The following differences have been observed in committed snapshots. It is meant to help the reviewer.
The diff is simplistic, so please check some files anyway while we improve it.

1 occurrences of :

+    },
+    {
+      "type": "NO_SAMESITE_COOKIE",
+      "hash": -1837181716,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.0"
+      }
+    },
+    {
+      "type": "NO_HTTPONLY_COOKIE",
+      "hash": 1990393425,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.0"
+      }
+    },
+    {
+      "type": "INSECURE_COOKIE",
+      "hash": 1170867602,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.0"
+      }
+    },
+    {
+      "type": "NO_SAMESITE_COOKIE",
+      "hash": -1837181716,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.1"
+      }
+    },
+    {
+      "type": "NO_HTTPONLY_COOKIE",
+      "hash": 1990393425,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.1"
+      }
+    },
+    {
+      "type": "INSECURE_COOKIE",
+      "hash": 1170867602,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.1"
+      }
+    },
+    {
+      "type": "NO_SAMESITE_COOKIE",
+      "hash": -1837181716,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.2"
+      }
+    },
+    {
+      "type": "NO_HTTPONLY_COOKIE",
+      "hash": 1990393425,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.2"
+      }
+    },
+    {
+      "type": "INSECURE_COOKIE",
+      "hash": 1170867602,
+      "evidence": {
+        "value": "LongCookie.abcdefghijklmnopqrstuvwxyz0123456789.2"
+      }

Throughput/Crank Report ⚡

Throughput results for AspNetCoreSimpleController comparing the following branches/commits:

• This PR (5947)
• master
• benchmarks/2.9.0

Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.

Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!

gantt
    title Throughput Linux x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (5947) (11.625M)   : 0, 11625170
    master (11.555M)   : 0, 11555237
    benchmarks/2.9.0 (11.711M)   : 0, 11710619

    section Automatic
    This PR (5947) (7.711M)   : 0, 7711225
    master (7.792M)   : 0, 7792363
    benchmarks/2.9.0 (8.265M)   : 0, 8264630

    section Trace stats
    master (8.104M)   : 0, 8103920

    section Manual
    master (11.572M)   : 0, 11572105

    section Manual + Automatic
    This PR (5947) (7.127M)   : 0, 7127442
    master (7.316M)   : 0, 7315600

    section DD_TRACE_ENABLED=0
    master (10.685M)   : 0, 10684738

gantt
    title Throughput Linux arm64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (5947) (9.776M)   : 0, 9775588
    master (9.687M)   : 0, 9687318
    benchmarks/2.9.0 (9.717M)   : 0, 9716586

    section Automatic
    This PR (5947) (6.594M)   : 0, 6593615
    master (6.541M)   : 0, 6541465

    section Trace stats
    master (6.901M)   : 0, 6900663

    section Manual
    master (9.548M)   : 0, 9548348

    section Manual + Automatic
    This PR (5947) (6.101M)   : 0, 6101405
    master (6.135M)   : 0, 6134999

    section DD_TRACE_ENABLED=0
    master (8.963M)   : 0, 8963423

gantt
    title Throughput Windows x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (5947) (10.279M)   : 0, 10278916
    master (10.302M)   : 0, 10301875

    section Automatic
    This PR (5947) (6.731M)   : 0, 6730592
    master (6.752M)   : 0, 6752127

    section Trace stats
    master (7.494M)   : 0, 7493970

    section Manual
    master (10.315M)   : 0, 10315116

    section Manual + Automatic
    This PR (5947) (6.250M)   : 0, 6250257
    master (6.251M)   : 0, 6251394

    section DD_TRACE_ENABLED=0
    master (9.586M)   : 0, 9585809