Skip to content

chore(ci): removes APPSEC_BLOCKING from system-tests#14690

Merged
jandro996 merged 2 commits into
mainfrom
alejandro.gonzalez/remove-APPSEC_REQUEST_BLOCKING
Sep 24, 2025
Merged

chore(ci): removes APPSEC_BLOCKING from system-tests#14690
jandro996 merged 2 commits into
mainfrom
alejandro.gonzalez/remove-APPSEC_REQUEST_BLOCKING

Conversation

@jandro996

@jandro996 jandro996 commented Sep 24, 2025 •
edited
Loading

Copy link
Copy Markdown
Member

Description

The scenario APPSEC_REQUEST_BLOCKING has been merged into APPSEC_BLOCKING_FULL_DENYLIST in the system-tests project. This means tests that were previously run under APPSEC_REQUEST_BLOCKING will now execute using APPSEC_BLOCKING_FULL_DENYLIST (DataDog/system-tests#5277)

This PR just cleans up the pipeline by removing the reference to the no-longer-existing scenario and updates ST version

Testing

Risks

Additional Notes

@jandro996
jandro996 requested review from a team as code owners September 24, 2025 08:51
@github-actions

github-actions Bot commented Sep 24, 2025 •
edited
Loading

Copy link
Copy Markdown
Contributor

CODEOWNERS have been resolved as:

.github/workflows/system-tests.yml                                      @DataDog/python-guild @DataDog/apm-core-python
.gitlab-ci.yml                                                          @DataDog/python-guild @DataDog/apm-core-python

@github-actions

github-actions Bot commented Sep 24, 2025 •
edited
Loading

Copy link
Copy Markdown
Contributor

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 273 ± 2 ms.

The average import time from base is: 275 ± 2 ms.

The import time difference between this PR and base is: -1.67 ± 0.08 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.961 ms (0.72%)
ddtrace.bootstrap.sitecustomize 1.286 ms (0.47%)
ddtrace.bootstrap.preload 1.286 ms (0.47%)
ddtrace.internal.remoteconfig.client 0.634 ms (0.23%)
ddtrace 0.675 ms (0.25%)
ddtrace.internal._unpatched 0.030 ms (0.01%)
json 0.030 ms (0.01%)
json.decoder 0.030 ms (0.01%)
re 0.030 ms (0.01%)
enum 0.030 ms (0.01%)
types 0.030 ms (0.01%)

@pr-commenter

pr-commenter Bot commented Sep 24, 2025 •
edited
Loading

Copy link
Copy Markdown

Performance SLOs

Comparing candidate alejandro.gonzalez/remove-APPSEC_REQUEST_BLOCKING (4aaadee) with baseline main (1815d40)

📈 Performance Regressions (2 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ add_inplace_aspect

Time: ✅ 0.411µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ add_inplace_noaspect

Time: ✅ 0.314µs (SLO: <10.000µs 📉 -96.9%) vs baseline: -0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ add_noaspect

Time: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +1.0%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ bytearray_aspect

Time: ✅ 1.326µs (SLO: <10.000µs 📉 -86.7%) vs baseline: -1.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ bytearray_extend_aspect

Time: ✅ 1.442µs (SLO: <10.000µs 📉 -85.6%) vs baseline: -0.8%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ bytearray_extend_noaspect

Time: ✅ 0.613µs (SLO: <10.000µs 📉 -93.9%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ bytearray_noaspect

Time: ✅ 0.487µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%

✅ bytes_aspect

Time: ✅ 1.443µs (SLO: <10.000µs 📉 -85.6%) vs baseline: 📈 +11.6%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.2%

✅ bytes_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ bytesio_aspect

Time: ✅ 1.385µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +4.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ bytesio_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ capitalize_aspect

Time: ✅ 0.736µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ capitalize_noaspect

Time: ✅ 0.436µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ casefold_aspect

Time: ✅ 0.736µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ casefold_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ decode_aspect

Time: ✅ 0.733µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ decode_noaspect

Time: ✅ 0.420µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ encode_aspect

Time: ✅ 0.709µs (SLO: <10.000µs 📉 -92.9%) vs baseline: +0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ encode_noaspect

Time: ✅ 0.396µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -1.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ format_aspect

Time: ✅ 3.432µs (SLO: <10.000µs 📉 -65.7%) vs baseline: -0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ format_map_aspect

Time: ✅ 3.678µs (SLO: <10.000µs 📉 -63.2%) vs baseline: +0.8%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ format_map_noaspect

Time: ✅ 0.781µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ format_noaspect

Time: ✅ 0.593µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ index_aspect

Time: ✅ 0.358µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ index_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -1.2%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ join_aspect

Time: ✅ 1.361µs (SLO: <10.000µs 📉 -86.4%) vs baseline: -0.8%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ join_noaspect

Time: ✅ 0.490µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%

✅ ljust_aspect

Time: ✅ 2.593µs (SLO: <20.000µs 📉 -87.0%) vs baseline: -0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ljust_noaspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ lower_aspect

Time: ✅ 2.218µs (SLO: <10.000µs 📉 -77.8%) vs baseline: +0.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ lower_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.9%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ lstrip_aspect

Time: ✅ 2.262µs (SLO: <20.000µs 📉 -88.7%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ lstrip_noaspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ modulo_aspect

Time: ✅ 0.994µs (SLO: <10.000µs 📉 -90.1%) vs baseline: -0.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.529µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ modulo_aspect_for_bytes

Time: ✅ 0.988µs (SLO: <10.000µs 📉 -90.1%) vs baseline: +1.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.202µs (SLO: <10.000µs 📉 -88.0%) vs baseline: +1.0%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%

✅ modulo_noaspect

Time: ✅ 0.631µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +1.0%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ replace_aspect

Time: ✅ 4.926µs (SLO: <10.000µs 📉 -50.7%) vs baseline: +0.2%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.9%

✅ replace_noaspect

Time: ✅ 0.464µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 0.903µs (SLO: <10.000µs 📉 -91.0%) vs baseline: -0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ repr_noaspect

Time: ✅ 0.418µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +1.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ rstrip_aspect

Time: ✅ 2.036µs (SLO: <20.000µs 📉 -89.8%) vs baseline: +4.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ rstrip_noaspect

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.8%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.5%

✅ slice_aspect

Time: ✅ 0.492µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ slice_noaspect

Time: ✅ 0.449µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ stringio_aspect

Time: ✅ 1.541µs (SLO: <10.000µs 📉 -84.6%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ stringio_noaspect

Time: ✅ 0.732µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +1.6%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ strip_aspect

Time: ✅ 2.598µs (SLO: <20.000µs 📉 -87.0%) vs baseline: 📈 +14.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ strip_noaspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ swapcase_aspect

Time: ✅ 2.538µs (SLO: <10.000µs 📉 -74.6%) vs baseline: +4.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ swapcase_noaspect

Time: ✅ 0.535µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -0.6%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ title_aspect

Time: ✅ 2.338µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ title_noaspect

Time: ✅ 0.502µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ translate_aspect

Time: ✅ 3.433µs (SLO: <10.000µs 📉 -65.7%) vs baseline: +5.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ translate_noaspect

Time: ✅ 1.045µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ upper_aspect

Time: ✅ 2.301µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +3.7%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.5%

✅ upper_noaspect

Time: ✅ 0.373µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.111µs (SLO: <20.000µs 📉 -84.4%) vs baseline: +0.4%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%

✅ 1-count-metrics-100-times

Time: ✅ 212.053µs (SLO: <250.000µs 📉 -15.2%) vs baseline: +0.1%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.1%

✅ 1-distribution-metric-1-times

Time: ✅ 3.301µs (SLO: <20.000µs 📉 -83.5%) vs baseline: 📈 +13.5%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.0%

✅ 1-distribution-metrics-100-times

Time: ✅ 190.112µs (SLO: <220.000µs 📉 -13.6%) vs baseline: +0.2%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.7%

✅ 1-gauge-metric-1-times

Time: ✅ 2.096µs (SLO: <20.000µs 📉 -89.5%) vs baseline: +2.0%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ 1-gauge-metrics-100-times

Time: ✅ 124.465µs (SLO: <150.000µs 📉 -17.0%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.3%

✅ 1-rate-metric-1-times

Time: ✅ 3.191µs (SLO: <20.000µs 📉 -84.0%) vs baseline: +2.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%

✅ 1-rate-metrics-100-times

Time: ✅ 212.078µs (SLO: <250.000µs 📉 -15.2%) vs baseline: +0.5%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.7%

✅ 100-count-metrics-100-times

Time: ✅ 21.378ms (SLO: <23.500ms -9.0%) vs baseline: +0.5%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%

✅ 100-distribution-metrics-100-times

Time: ✅ 1.966ms (SLO: <2.250ms 📉 -12.6%) vs baseline: -0.4%

Memory: ✅ 31.988MB (SLO: <34.000MB -5.9%) vs baseline: +4.4%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.289ms (SLO: <1.550ms 📉 -16.9%) vs baseline: +0.7%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%

✅ 100-rate-metrics-100-times

Time: ✅ 2.187ms (SLO: <2.550ms 📉 -14.2%) vs baseline: +0.2%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ flush-1-metric

Time: ✅ 4.186µs (SLO: <20.000µs 📉 -79.1%) vs baseline: +0.7%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ flush-100-metrics

Time: ✅ 181.369µs (SLO: <250.000µs 📉 -27.5%) vs baseline: +0.7%

Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.7%

✅ flush-1000-metrics

Time: ✅ 2.201ms (SLO: <2.500ms 📉 -11.9%) vs baseline: +0.8%

Memory: ✅ 32.912MB (SLO: <34.500MB -4.6%) vs baseline: +4.9%

🟡 Near SLO Breach (4 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.436ms (SLO: <22.300ms -8.4%) vs baseline: -0.4%

Memory: ✅ 65.369MB (SLO: <67.000MB -2.4%) vs baseline: +4.9%

✅ exception-replay-enabled

Time: ✅ 1.348ms (SLO: <1.450ms -7.0%) vs baseline: -0.6%

Memory: ✅ 64.136MB (SLO: <67.000MB -4.3%) vs baseline: +4.8%

✅ iast

Time: ✅ 20.472ms (SLO: <22.250ms -8.0%) vs baseline: -0.3%

Memory: ✅ 65.409MB (SLO: <67.000MB -2.4%) vs baseline: +4.9%

✅ profiler

Time: ✅ 15.283ms (SLO: <16.550ms -7.7%) vs baseline: +0.2%

Memory: ✅ 53.625MB (SLO: <54.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 20.557ms (SLO: <21.750ms -5.5%) vs baseline: ~same

Memory: ✅ 65.313MB (SLO: <67.000MB -2.5%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 26.235ms (SLO: <28.200ms -7.0%) vs baseline: ~same

Memory: ✅ 67.374MB (SLO: <69.500MB -3.1%) vs baseline: +4.7%

✅ tracer

Time: ✅ 20.454ms (SLO: <21.750ms -6.0%) vs baseline: -0.3%

Memory: ✅ 65.352MB (SLO: <67.000MB -2.5%) vs baseline: +5.0%

✅ tracer-and-profiler

Time: ✅ 22.016ms (SLO: <23.500ms -6.3%) vs baseline: -0.6%

Memory: ✅ 66.279MB (SLO: <67.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ tracer-dont-create-db-spans

Time: ✅ 19.339ms (SLO: <21.500ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 65.391MB (SLO: <66.000MB 🟡 -0.9%) vs baseline: +4.9%

✅ tracer-minimal

Time: ✅ 16.681ms (SLO: <17.500ms -4.7%) vs baseline: +0.4%

Memory: ✅ 65.017MB (SLO: <66.000MB 🟡 -1.5%) vs baseline: +5.0%

✅ tracer-native

Time: ✅ 20.454ms (SLO: <21.750ms -6.0%) vs baseline: -0.2%

Memory: ✅ 71.103MB (SLO: <72.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 18.478ms (SLO: <19.650ms -6.0%) vs baseline: ~same

Memory: ✅ 65.332MB (SLO: <67.000MB -2.5%) vs baseline: +4.9%

✅ tracer-no-databases

Time: ✅ 18.804ms (SLO: <20.100ms -6.4%) vs baseline: -0.2%

Memory: ✅ 64.916MB (SLO: <67.000MB -3.1%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 20.152ms (SLO: <21.500ms -6.3%) vs baseline: -0.3%

Memory: ✅ 65.347MB (SLO: <67.000MB -2.5%) vs baseline: +4.8%

✅ tracer-no-templates

Time: ✅ 20.281ms (SLO: <22.000ms -7.8%) vs baseline: -0.2%

Memory: ✅ 65.351MB (SLO: <67.000MB -2.5%) vs baseline: +4.9%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.023ms (SLO: <19.850ms -9.2%) vs baseline: -0.4%

Memory: ✅ 65.241MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 18.118ms (SLO: <19.400ms -6.6%) vs baseline: +0.2%

Memory: ✅ 65.231MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 18.105ms (SLO: <19.450ms -6.9%) vs baseline: +0.3%

Memory: ✅ 65.119MB (SLO: <66.500MB -2.1%) vs baseline: +4.7%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.951ms (SLO: <4.200ms -5.9%) vs baseline: +0.2%

Memory: ✅ 63.292MB (SLO: <66.000MB -4.1%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.448ms (SLO: <2.800ms 📉 -12.6%) vs baseline: +0.2%

Memory: ✅ 58.864MB (SLO: <60.000MB 🟡 -1.9%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.086ms (SLO: <2.250ms -7.3%) vs baseline: ~same

Memory: ✅ 52.074MB (SLO: <54.500MB -4.5%) vs baseline: +5.0%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 45.203ms (SLO: <47.150ms -4.1%) vs baseline: ~same

Memory: ✅ 45.124MB (SLO: <47.000MB -4.0%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 321.266ms (SLO: <344.800ms -6.8%) vs baseline: +0.9%

Memory: ✅ 552.604MB (SLO: <562.000MB 🟡 -1.7%) vs baseline: +4.6%

✅ add-tags

Time: ✅ 291.987ms (SLO: <314.000ms -7.0%) vs baseline: ~same

Memory: ✅ 554.795MB (SLO: <563.500MB 🟡 -1.5%) vs baseline: +4.8%

✅ get-context

Time: ✅ 82.942ms (SLO: <92.350ms 📉 -10.2%) vs baseline: +0.4%

Memory: ✅ 40.103MB (SLO: <46.500MB 📉 -13.8%) vs baseline: +4.6%

✅ is-recording

Time: ✅ 43.088ms (SLO: <44.500ms -3.2%) vs baseline: +0.8%

Memory: ✅ 44.584MB (SLO: <47.500MB -6.1%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 62.015ms (SLO: <67.650ms -8.3%) vs baseline: +0.4%

Memory: ✅ 40.514MB (SLO: <47.000MB 📉 -13.8%) vs baseline: +4.9%

✅ set-status

Time: ✅ 48.967ms (SLO: <50.400ms -2.8%) vs baseline: +0.3%

Memory: ✅ 44.583MB (SLO: <47.000MB -5.1%) vs baseline: +4.9%

✅ start

Time: ✅ 42.307ms (SLO: <43.450ms -2.6%) vs baseline: -0.3%

Memory: ✅ 44.548MB (SLO: <47.000MB -5.2%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 83.025ms (SLO: <88.000ms -5.7%) vs baseline: -0.3%

Memory: ✅ 34.564MB (SLO: <46.500MB 📉 -25.7%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 84.671ms (SLO: <89.000ms -4.9%) vs baseline: +0.1%

Memory: ✅ 34.583MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.9%

✅ update-name

Time: ✅ 44.147ms (SLO: <45.150ms -2.2%) vs baseline: ~same

Memory: ✅ 44.793MB (SLO: <47.000MB -4.7%) vs baseline: +5.0%

⚠️ Unstable Tests (1 suite)
⚠️ coreapiscenario - 12/12 (2 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.398µs (SLO: <20.000µs 📉 -33.0%) vs baseline: +0.2%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.9%

✅ context_with_data_no_listeners

Time: ✅ 3.389µs (SLO: <10.000µs 📉 -66.1%) vs baseline: +1.3%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.9%

⚠️ context_with_data_only_all_listeners

Time: ⚠️ 13.380µs (SLO: <20.000µs 📉 -33.1%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%

✅ get_item_exists

Time: ✅ 0.590µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +1.8%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +5.1%

✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.8%

Memory: ✅ 32.086MB (SLO: <33.500MB -4.2%) vs baseline: +4.9%

✅ set_item

Time: ✅ 24.493µs (SLO: <30.000µs 📉 -18.4%) vs baseline: +1.4%

Memory: ✅ 32.027MB (SLO: <33.500MB -4.4%) vs baseline: +4.4%

✅ All Tests Passing (17 suites)
✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.092ms (SLO: <2.300ms -9.0%) vs baseline: ~same

Memory: ✅ 52.056MB (SLO: <53.500MB -2.7%) vs baseline: +5.0%

✅ errortracking-enabled-user

Time: ✅ 2.107ms (SLO: <2.250ms -6.3%) vs baseline: +0.9%

Memory: ✅ 52.070MB (SLO: <53.500MB -2.7%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.091ms (SLO: <2.300ms -9.1%) vs baseline: -0.2%

Memory: ✅ 52.080MB (SLO: <53.500MB -2.7%) vs baseline: +4.9%

✅ flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.586ms (SLO: <4.750ms -3.5%) vs baseline: +0.3%

Memory: ✅ 63.082MB (SLO: <65.000MB -3.0%) vs baseline: +4.8%

✅ appsec-post

Time: ✅ 6.572ms (SLO: <6.750ms -2.6%) vs baseline: -0.1%

Memory: ✅ 63.141MB (SLO: <65.000MB -2.9%) vs baseline: +4.9%

✅ appsec-telemetry

Time: ✅ 4.581ms (SLO: <4.750ms -3.6%) vs baseline: -0.4%

Memory: ✅ 63.138MB (SLO: <65.000MB -2.9%) vs baseline: +4.9%

✅ debugger

Time: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: -0.4%

Memory: ✅ 45.272MB (SLO: <47.000MB -3.7%) vs baseline: +4.9%

✅ iast-get

Time: ✅ 1.860ms (SLO: <2.000ms -7.0%) vs baseline: +0.6%

Memory: ✅ 42.248MB (SLO: <49.000MB 📉 -13.8%) vs baseline: +4.9%

✅ profiler

Time: ✅ 1.917ms (SLO: <2.100ms -8.7%) vs baseline: -0.1%

Memory: ✅ 45.190MB (SLO: <47.000MB -3.9%) vs baseline: +5.1%

✅ resource-renaming

Time: ✅ 3.383ms (SLO: <3.650ms -7.3%) vs baseline: -0.1%

Memory: ✅ 52.175MB (SLO: <53.500MB -2.5%) vs baseline: +5.2%

✅ tracer

Time: ✅ 3.373ms (SLO: <3.650ms -7.6%) vs baseline: ~same

Memory: ✅ 52.116MB (SLO: <53.500MB -2.6%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 3.370ms (SLO: <3.650ms -7.7%) vs baseline: -0.4%

Memory: ✅ 58.019MB (SLO: <60.000MB -3.3%) vs baseline: +5.0%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.402µs (SLO: <100.000µs 📉 -18.6%) vs baseline: +0.6%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ b3_headers

Time: ✅ 14.295µs (SLO: <20.000µs 📉 -28.5%) vs baseline: +0.7%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ b3_single_headers

Time: ✅ 13.423µs (SLO: <20.000µs 📉 -32.9%) vs baseline: +0.8%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.966µs (SLO: <80.000µs 📉 -20.0%) vs baseline: +0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.003µs (SLO: <80.000µs 📉 -17.5%) vs baseline: +0.1%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ empty_headers

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ full_t_id_datadog_headers

Time: ✅ 22.667µs (SLO: <30.000µs 📉 -24.4%) vs baseline: -0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ invalid_priority_header

Time: ✅ 6.560µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ invalid_span_id_header

Time: ✅ 6.531µs (SLO: <10.000µs 📉 -34.7%) vs baseline: -0.5%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ invalid_tags_header

Time: ✅ 6.543µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.1%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.6%

✅ invalid_trace_id_header

Time: ✅ 6.592µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +1.0%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.5%

✅ large_header_no_matches

Time: ✅ 27.664µs (SLO: <30.000µs -7.8%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ large_valid_headers_all

Time: ✅ 28.638µs (SLO: <40.000µs 📉 -28.4%) vs baseline: -0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ medium_header_no_matches

Time: ✅ 9.928µs (SLO: <20.000µs 📉 -50.4%) vs baseline: +0.5%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.7%

✅ medium_valid_headers_all

Time: ✅ 11.372µs (SLO: <20.000µs 📉 -43.1%) vs baseline: -0.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ none_propagation_style

Time: ✅ 1.690µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -0.3%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.5%

✅ tracecontext_headers

Time: ✅ 34.480µs (SLO: <40.000µs 📉 -13.8%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.590µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +1.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ valid_headers_basic

Time: ✅ 6.137µs (SLO: <10.000µs 📉 -38.6%) vs baseline: +0.5%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ wsgi_empty_headers

Time: ✅ 1.605µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ wsgi_invalid_priority_header

Time: ✅ 6.579µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.1%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.589µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ wsgi_invalid_tags_header

Time: ✅ 6.586µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.6%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.565µs (SLO: <10.000µs 📉 -34.4%) vs baseline: ~same

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ wsgi_large_header_no_matches

Time: ✅ 28.699µs (SLO: <40.000µs 📉 -28.3%) vs baseline: +0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.902µs (SLO: <40.000µs 📉 -25.2%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.095µs (SLO: <20.000µs 📉 -49.5%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.489µs (SLO: <20.000µs 📉 -42.6%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ wsgi_valid_headers_all

Time: ✅ 6.572µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.6%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.6%

✅ wsgi_valid_headers_basic

Time: ✅ 6.183µs (SLO: <10.000µs 📉 -38.2%) vs baseline: +0.7%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.6%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.122µs (SLO: <30.000µs 📉 -26.3%) vs baseline: +1.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ with_all

Time: ✅ 29.321µs (SLO: <40.000µs 📉 -26.7%) vs baseline: +0.9%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ with_dd_origin

Time: ✅ 25.541µs (SLO: <30.000µs 📉 -14.9%) vs baseline: +0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ with_priority_and_origin

Time: ✅ 24.865µs (SLO: <40.000µs 📉 -37.8%) vs baseline: -0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_sampling_priority

Time: ✅ 21.898µs (SLO: <30.000µs 📉 -27.0%) vs baseline: +1.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ with_tags

Time: ✅ 27.164µs (SLO: <40.000µs 📉 -32.1%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ with_tags_invalid

Time: ✅ 28.811µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_tags_max_size

Time: ✅ 28.738µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +4.0%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.986µs (SLO: <40.000µs 📉 -20.0%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_expand_noaspect

Time: ✅ 28.641µs (SLO: <40.000µs 📉 -28.4%) vs baseline: +0.2%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%

✅ re_findall_aspect

Time: ✅ 2.905µs (SLO: <10.000µs 📉 -70.9%) vs baseline: -0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_findall_noaspect

Time: ✅ 1.412µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ re_finditer_aspect

Time: ✅ 4.521µs (SLO: <10.000µs 📉 -54.8%) vs baseline: -0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ re_finditer_noaspect

Time: ✅ 1.407µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ re_fullmatch_aspect

Time: ✅ 2.778µs (SLO: <10.000µs 📉 -72.2%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%

✅ re_fullmatch_noaspect

Time: ✅ 1.299µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%

✅ re_group_aspect

Time: ✅ 3.020µs (SLO: <10.000µs 📉 -69.8%) vs baseline: ~same

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ re_group_noaspect

Time: ✅ 1.610µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.5%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_groups_aspect

Time: ✅ 3.163µs (SLO: <10.000µs 📉 -68.4%) vs baseline: -0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ re_groups_noaspect

Time: ✅ 1.705µs (SLO: <10.000µs 📉 -82.9%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_match_aspect

Time: ✅ 2.836µs (SLO: <10.000µs 📉 -71.6%) vs baseline: -0.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ re_match_noaspect

Time: ✅ 1.299µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_search_aspect

Time: ✅ 2.693µs (SLO: <10.000µs 📉 -73.1%) vs baseline: +3.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_search_noaspect

Time: ✅ 1.209µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_sub_aspect

Time: ✅ 3.475µs (SLO: <10.000µs 📉 -65.2%) vs baseline: +0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_sub_noaspect

Time: ✅ 1.532µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_subn_aspect

Time: ✅ 3.685µs (SLO: <10.000µs 📉 -63.2%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ re_subn_noaspect

Time: ✅ 1.627µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.370µs (SLO: <10.000µs 📉 -56.3%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ ospathbasename_noaspect

Time: ✅ 1.075µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathjoin_aspect

Time: ✅ 6.115µs (SLO: <10.000µs 📉 -38.8%) vs baseline: +0.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathjoin_noaspect

Time: ✅ 2.299µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ ospathnormcase_aspect

Time: ✅ 3.487µs (SLO: <10.000µs 📉 -65.1%) vs baseline: -0.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathnormcase_noaspect

Time: ✅ 0.572µs (SLO: <10.000µs 📉 -94.3%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ ospathsplit_aspect

Time: ✅ 4.950µs (SLO: <10.000µs 📉 -50.5%) vs baseline: -0.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ospathsplit_noaspect

Time: ✅ 1.593µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathsplitdrive_aspect

Time: ✅ 3.698µs (SLO: <10.000µs 📉 -63.0%) vs baseline: -0.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.695µs (SLO: <10.000µs 📉 -93.1%) vs baseline: +0.9%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ ospathsplitext_aspect

Time: ✅ 4.581µs (SLO: <10.000µs 📉 -54.2%) vs baseline: ~same

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +5.2%

✅ ospathsplitext_noaspect

Time: ✅ 1.370µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -1.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.473µs (SLO: <10.000µs 📉 -85.3%) vs baseline: -0.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ rsplit_noaspect

Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -1.0%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.1%

✅ split_aspect

Time: ✅ 1.447µs (SLO: <10.000µs 📉 -85.5%) vs baseline: +0.1%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.8%

✅ split_noaspect

Time: ✅ 0.567µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ splitlines_aspect

Time: ✅ 1.448µs (SLO: <10.000µs 📉 -85.5%) vs baseline: +0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ splitlines_noaspect

Time: ✅ 0.584µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.284µs (SLO: <60.000µs 📉 -17.9%) vs baseline: -0.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ propagation_enabled

Time: ✅ 176.706µs (SLO: <190.000µs -7.0%) vs baseline: +3.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ propagation_enabled_100

Time: ✅ 1.896ms (SLO: <2.300ms 📉 -17.5%) vs baseline: -0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ propagation_enabled_1000

Time: ✅ 32.470ms (SLO: <34.550ms -6.0%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.606ms (SLO: <42.000ms -3.3%) vs baseline: +0.5%

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.2%

✅ add-link

Time: ✅ 36.400ms (SLO: <38.550ms -5.6%) vs baseline: +0.2%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 219.575ms (SLO: <232.000ms -5.4%) vs baseline: ~same

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 214.975ms (SLO: <221.600ms -3.0%) vs baseline: +1.5%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.9%

✅ get-context

Time: ✅ 29.005ms (SLO: <31.300ms -7.3%) vs baseline: ~same

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 29.272ms (SLO: <31.000ms -5.6%) vs baseline: +0.3%

Memory: ✅ 34.603MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.2%

✅ record-exception

Time: ✅ 63.142ms (SLO: <65.850ms -4.1%) vs baseline: -0.5%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%

✅ set-status

Time: ✅ 32.181ms (SLO: <34.150ms -5.8%) vs baseline: +0.7%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +5.0%

✅ start

Time: ✅ 28.822ms (SLO: <30.150ms -4.4%) vs baseline: +0.3%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 34.470ms (SLO: <35.350ms -2.5%) vs baseline: +1.7%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 34.121ms (SLO: <35.450ms -3.8%) vs baseline: +1.0%

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.0%

✅ update-name

Time: ✅ 31.158ms (SLO: <33.400ms -6.7%) vs baseline: +0.4%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.498ms (SLO: <354.300ms -3.3%) vs baseline: -0.2%

Memory: ✅ 37.337MB (SLO: <40.000MB -6.7%) vs baseline: +1.1%

✅ cache_on

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.9%

Memory: ✅ 36.131MB (SLO: <39.000MB -7.4%) vs baseline: +3.6%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.638µs (SLO: <170.000µs -8.4%) vs baseline: +0.3%

Memory: ✅ 36.454MB (SLO: <38.500MB -5.3%) vs baseline: +5.4%

✅ import_many_cached

Time: ✅ 120.650µs (SLO: <130.000µs -7.2%) vs baseline: -1.3%

Memory: ✅ 36.462MB (SLO: <38.500MB -5.3%) vs baseline: +5.5%

✅ import_many_stdlib

Time: ✅ 1.620ms (SLO: <1.750ms -7.4%) vs baseline: ~same

Memory: ✅ 36.570MB (SLO: <38.500MB -5.0%) vs baseline: +4.7%

✅ import_many_stdlib_cached

Time: ✅ 0.968ms (SLO: <1.100ms 📉 -12.0%) vs baseline: ~same

Memory: ✅ 36.508MB (SLO: <38.500MB -5.2%) vs baseline: +4.3%

✅ import_many_unknown

Time: ✅ 837.233µs (SLO: <890.000µs -5.9%) vs baseline: +0.9%

Memory: ✅ 36.494MB (SLO: <38.500MB -5.2%) vs baseline: +4.5%

✅ import_many_unknown_cached

Time: ✅ 788.860µs (SLO: <870.000µs -9.3%) vs baseline: -0.9%

Memory: ✅ 36.463MB (SLO: <38.500MB -5.3%) vs baseline: +4.9%

✅ import_one

Time: ✅ 19.875µs (SLO: <30.000µs 📉 -33.7%) vs baseline: +0.7%

Memory: ✅ 36.188MB (SLO: <39.000MB -7.2%) vs baseline: +4.6%

✅ import_one_cache

Time: ✅ 6.258µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -0.8%

Memory: ✅ 36.236MB (SLO: <38.500MB -5.9%) vs baseline: +4.8%

✅ import_one_stdlib

Time: ✅ 18.712µs (SLO: <20.000µs -6.4%) vs baseline: +0.4%

Memory: ✅ 36.173MB (SLO: <38.500MB -6.0%) vs baseline: +4.6%

✅ import_one_stdlib_cache

Time: ✅ 6.300µs (SLO: <10.000µs 📉 -37.0%) vs baseline: +0.7%

Memory: ✅ 36.328MB (SLO: <38.500MB -5.6%) vs baseline: +4.4%

✅ import_one_unknown

Time: ✅ 45.415µs (SLO: <50.000µs -9.2%) vs baseline: -0.2%

Memory: ✅ 36.277MB (SLO: <38.500MB -5.8%) vs baseline: +4.6%

✅ import_one_unknown_cache

Time: ✅ 6.281µs (SLO: <10.000µs 📉 -37.2%) vs baseline: -0.5%

Memory: ✅ 36.311MB (SLO: <38.500MB -5.7%) vs baseline: +3.8%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.350µs (SLO: <10.000µs 📉 -76.5%) vs baseline: +0.2%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +5.1%

✅ high_rate_limit

Time: ✅ 2.397µs (SLO: <10.000µs 📉 -76.0%) vs baseline: -0.6%

Memory: ✅ 31.713MB (SLO: <34.000MB -6.7%) vs baseline: +4.9%

✅ long_window

Time: ✅ 2.348µs (SLO: <10.000µs 📉 -76.5%) vs baseline: ~same

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.9%

✅ low_rate_limit

Time: ✅ 2.373µs (SLO: <10.000µs 📉 -76.3%) vs baseline: -0.4%

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +5.1%

✅ no_rate_limit

Time: ✅ 0.835µs (SLO: <10.000µs 📉 -91.6%) vs baseline: ~same

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +5.0%

✅ short_window

Time: ✅ 2.475µs (SLO: <10.000µs 📉 -75.2%) vs baseline: -1.0%

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +5.1%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 310.357ms (SLO: <320.950ms -3.3%) vs baseline: +0.4%

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +5.0%

✅ deep-profiled

Time: ✅ 327.619ms (SLO: <359.150ms -8.8%) vs baseline: +0.1%

Memory: ✅ 36.078MB (SLO: <39.000MB -7.5%) vs baseline: +5.1%

✅ medium

Time: ✅ 7.075ms (SLO: <7.400ms -4.4%) vs baseline: ~same

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%

✅ shallow

Time: ✅ 0.958ms (SLO: <1.050ms -8.8%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.1%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 148.729µs (SLO: <290.000µs 📉 -48.7%) vs baseline: -0.3%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +5.0%

✅ high_match

Time: ✅ 195.406µs (SLO: <480.000µs 📉 -59.3%) vs baseline: +0.5%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ low_match

Time: ✅ 99.186µs (SLO: <120.000µs 📉 -17.3%) vs baseline: -0.6%

Memory: ✅ 632.518MB (SLO: <700.000MB -9.6%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.889ms (SLO: <8.500ms 📉 -66.0%) vs baseline: -0.3%

Memory: ✅ 70.192MB (SLO: <75.000MB -6.4%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.857µs (SLO: <20.000µs 📉 -45.7%) vs baseline: +2.4%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +5.0%

✅ all-enabled

Time: ✅ 40.309µs (SLO: <50.000µs 📉 -19.4%) vs baseline: +1.2%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.8%

✅ collectipvariant_exists

Time: ✅ 40.790µs (SLO: <50.000µs 📉 -18.4%) vs baseline: +0.4%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +5.0%

✅ no-collectipvariant

Time: ✅ 40.593µs (SLO: <50.000µs 📉 -18.8%) vs baseline: +1.6%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ no-useragentvariant

Time: ✅ 38.799µs (SLO: <50.000µs 📉 -22.4%) vs baseline: +0.2%

Memory: ✅ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.6%

✅ obfuscation-no-query

Time: ✅ 40.619µs (SLO: <50.000µs 📉 -18.8%) vs baseline: +0.5%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.7%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 77.019µs (SLO: <90.000µs 📉 -14.4%) vs baseline: +1.2%

Memory: ✅ 32.971MB (SLO: <34.000MB -3.0%) vs baseline: +4.8%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.732µs (SLO: <90.000µs 📉 -14.7%) vs baseline: +0.3%

Memory: ✅ 32.971MB (SLO: <34.000MB -3.0%) vs baseline: +5.0%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.369µs (SLO: <170.000µs -9.2%) vs baseline: +0.1%

Memory: ✅ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.322µs (SLO: <160.000µs -7.3%) vs baseline: ~same

Memory: ✅ 33.010MB (SLO: <34.500MB -4.3%) vs baseline: +5.1%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.287µs (SLO: <170.000µs -8.7%) vs baseline: +0.7%

Memory: ✅ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +5.0%

✅ useragentvariant_exists_1

Time: ✅ 39.542µs (SLO: <50.000µs 📉 -20.9%) vs baseline: ~same

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ useragentvariant_exists_2

Time: ✅ 41.229µs (SLO: <50.000µs 📉 -17.5%) vs baseline: +1.8%

Memory: ✅ 32.637MB (SLO: <34.000MB -4.0%) vs baseline: +5.1%

✅ useragentvariant_exists_3

Time: ✅ 40.284µs (SLO: <50.000µs 📉 -19.4%) vs baseline: +0.2%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ useragentvariant_not_exists_1

Time: ✅ 39.492µs (SLO: <50.000µs 📉 -21.0%) vs baseline: +0.2%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ useragentvariant_not_exists_2

Time: ✅ 39.460µs (SLO: <50.000µs 📉 -21.1%) vs baseline: +0.4%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ span - 26/26

✅ add-event

Time: ✅ 24.119ms (SLO: <26.200ms -7.9%) vs baseline: +0.3%

Memory: ✅ 51.573MB (SLO: <53.000MB -2.7%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 91.433ms (SLO: <98.350ms -7.0%) vs baseline: -1.4%

Memory: ✅ 607.444MB (SLO: <961.000MB 📉 -36.8%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 151.190ms (SLO: <168.550ms 📉 -10.3%) vs baseline: +0.3%

Memory: ✅ 606.210MB (SLO: <962.500MB 📉 -37.0%) vs baseline: +4.8%

✅ get-context

Time: ✅ 22.216ms (SLO: <23.700ms -6.3%) vs baseline: +0.3%

Memory: ✅ 50.381MB (SLO: <53.000MB -4.9%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 22.673ms (SLO: <23.900ms -5.1%) vs baseline: ~same

Memory: ✅ 50.405MB (SLO: <53.000MB -4.9%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 42.372ms (SLO: <44.500ms -4.8%) vs baseline: -0.5%

Memory: ✅ 43.324MB (SLO: <53.000MB 📉 -18.3%) vs baseline: +4.7%

✅ set-status

Time: ✅ 24.563ms (SLO: <26.000ms -5.5%) vs baseline: +0.7%

Memory: ✅ 50.448MB (SLO: <53.000MB -4.8%) vs baseline: +4.9%

✅ start

Time: ✅ 22.158ms (SLO: <23.500ms -5.7%) vs baseline: +0.2%

Memory: ✅ 50.384MB (SLO: <53.000MB -4.9%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 52.255ms (SLO: <55.500ms -5.8%) vs baseline: +0.3%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ start-finish-telemetry

Time: ✅ 53.610ms (SLO: <58.300ms -8.0%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

✅ start-finish-traceid128

Time: ✅ 56.119ms (SLO: <60.050ms -6.5%) vs baseline: +1.2%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.6%

✅ start-traceid128

Time: ✅ 22.586ms (SLO: <24.600ms -8.2%) vs baseline: -0.6%

Memory: ✅ 50.332MB (SLO: <53.000MB -5.0%) vs baseline: +4.8%

✅ update-name

Time: ✅ 23.166ms (SLO: <24.100ms -3.9%) vs baseline: -0.5%

Memory: ✅ 51.049MB (SLO: <53.000MB -3.7%) vs baseline: +4.7%

✅ tracer - 6/6

✅ large

Time: ✅ 30.595ms (SLO: <32.950ms -7.1%) vs baseline: +0.6%

Memory: ✅ 33.286MB (SLO: <34.500MB -3.5%) vs baseline: +4.8%

✅ medium

Time: ✅ 2.990ms (SLO: <3.200ms -6.6%) vs baseline: +0.4%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.8%

✅ small

Time: ✅ 338.721µs (SLO: <370.000µs -8.5%) vs baseline: +0.3%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.8%

ℹ️ Scenarios Missing SLO Configuration (14 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-context_with_data_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_only_all_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_listeners_and_all_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • coreapiscenario-core_dispatch_with_results_only_all_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline

@jandro996 jandro996 changed the title Remove APPSEC_REQUEST_BLOCKING as was merged into APPSEC_BLOCKING_FULL_DENYLIST chore(ci): removes APPSEC_BLOCKING from system-tests Sep 24, 2025
@jandro996 jandro996 added the changelog/no-changelog A changelog entry is not required for this PR. label Sep 24, 2025
@jandro996
jandro996 requested a review from avara1986 September 24, 2025 10:47
@jandro996
jandro996 enabled auto-merge (squash) September 24, 2025 11:44
@jandro996
jandro996 merged commit 12f39b7 into main Sep 24, 2025
922 of 923 checks passed
@jandro996
jandro996 deleted the alejandro.gonzalez/remove-APPSEC_REQUEST_BLOCKING branch September 24, 2025 11:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@avara1986 avara1986 avara1986 approved these changes
@christophe-papazian christophe-papazian Awaiting requested review from christophe-papazian christophe-papazian is a code owner automatically assigned from DataDog/python-guild
@emmettbutler emmettbutler Awaiting requested review from emmettbutler emmettbutler is a code owner automatically assigned from DataDog/apm-core-python

Assignees

No one assigned

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@jandro996 @avara1986