Skip to content

chore: upgrade to latest system-tests#16229

Merged
wantsui merged 2 commits into
mainfrom
bump-system-tests2
Jan 27, 2026
Merged

chore: upgrade to latest system-tests#16229
wantsui merged 2 commits into
mainfrom
bump-system-tests2

Conversation

@wantsui

@wantsui wantsui commented Jan 27, 2026

Copy link
Copy Markdown
Collaborator

Description

I'm trying to get #16174 merged, but it's failing a test called trace completeness because the new env var didn't get registered: https://github.com/DataDog/dd-trace-py/actions/runs/21412462731/job/61653888559?pr=16174.

                        "(NOT A FLAKE) Read this quick runbook to update allowed configs: https://github.com/DataDog/system-tests/blob/main/docs/edit/runbook.md#test_config_telemetry_completeness"
                    )
E                   ValueError: (NOT A FLAKE) Read this quick runbook to update allowed configs: https://github.com/DataDog/system-tests/blob/main/docs/edit/runbook.md#test_config_telemetry_completeness

tests/test_telemetry.py:771: ValueError
------------------------------ Captured log call -------------------------------
20:26:33.619 ERROR    [
  "DD_TRACE_LOG_LEVEL"
]

However, I just got the system test PR to pick up this env var merged in: DataDog/system-tests#6117, and since it's still failing, I believe this means I need to update the system tests reference in dd-trace-py.

Testing

Risks

Additional Notes

@wantsui
wantsui requested review from a team as code owners January 27, 2026 20:52
@wantsui wantsui added the changelog/no-changelog A changelog entry is not required for this PR. label Jan 27, 2026
@wantsui
wantsui requested a review from brettlangdon January 27, 2026 20:52
@wantsui
wantsui enabled auto-merge (squash) January 27, 2026 21:21
@pr-commenter

pr-commenter Bot commented Jan 27, 2026

Copy link
Copy Markdown

Performance SLOs

Comparing candidate bump-system-tests2 (757cfef) with baseline main (9343c91)

📈 Performance Regressions (2 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 104.235µs (SLO: <130.000µs 📉 -19.8%) vs baseline: +3.0%

Memory: ✅ 42.880MB (SLO: <43.250MB 🟡 -0.9%) vs baseline: +4.9%


✅ add_inplace_aspect

Time: ✅ 102.621µs (SLO: <130.000µs 📉 -21.1%) vs baseline: +0.1%

Memory: ✅ 42.939MB (SLO: <43.250MB 🟡 -0.7%) vs baseline: +4.8%


✅ add_inplace_noaspect

Time: ✅ 28.206µs (SLO: <40.000µs 📉 -29.5%) vs baseline: +0.2%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.5%


✅ add_noaspect

Time: ✅ 49.114µs (SLO: <70.000µs 📉 -29.8%) vs baseline: +0.9%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.5%


✅ bytearray_aspect

Time: ✅ 250.072µs (SLO: <400.000µs 📉 -37.5%) vs baseline: +0.3%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ bytearray_extend_aspect

Time: ✅ 650.823µs (SLO: <800.000µs 📉 -18.6%) vs baseline: +1.2%

Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8%


✅ bytearray_extend_noaspect

Time: ✅ 262.947µs (SLO: <400.000µs 📉 -34.3%) vs baseline: -0.3%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ bytearray_noaspect

Time: ✅ 139.030µs (SLO: <300.000µs 📉 -53.7%) vs baseline: +1.3%

Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.7%


✅ bytes_aspect

Time: ✅ 218.498µs (SLO: <300.000µs 📉 -27.2%) vs baseline: +0.9%

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.6%


✅ bytes_noaspect

Time: ✅ 135.055µs (SLO: <200.000µs 📉 -32.5%) vs baseline: +0.5%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.5%


✅ bytesio_aspect

Time: ✅ 3.836ms (SLO: <5.000ms 📉 -23.3%) vs baseline: +0.1%

Memory: ✅ 42.979MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +4.8%


✅ bytesio_noaspect

Time: ✅ 315.571µs (SLO: <420.000µs 📉 -24.9%) vs baseline: +0.5%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8%


✅ capitalize_aspect

Time: ✅ 89.124µs (SLO: <300.000µs 📉 -70.3%) vs baseline: +0.8%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ capitalize_noaspect

Time: ✅ 247.212µs (SLO: <300.000µs 📉 -17.6%) vs baseline: +0.8%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ casefold_aspect

Time: ✅ 88.793µs (SLO: <500.000µs 📉 -82.2%) vs baseline: -0.4%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ casefold_noaspect

Time: ✅ 306.591µs (SLO: <500.000µs 📉 -38.7%) vs baseline: +2.8%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ decode_aspect

Time: ✅ 87.466µs (SLO: <100.000µs 📉 -12.5%) vs baseline: +0.4%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ decode_noaspect

Time: ✅ 154.557µs (SLO: <210.000µs 📉 -26.4%) vs baseline: +1.5%

Memory: ✅ 42.841MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.5%


✅ encode_aspect

Time: ✅ 85.682µs (SLO: <200.000µs 📉 -57.2%) vs baseline: +0.8%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.4%


✅ encode_noaspect

Time: ✅ 141.231µs (SLO: <200.000µs 📉 -29.4%) vs baseline: -0.5%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ format_aspect

Time: ✅ 14.724ms (SLO: <19.200ms 📉 -23.3%) vs baseline: +0.5%

Memory: ✅ 43.077MB (SLO: <43.250MB 🟡 -0.4%) vs baseline: +4.9%


✅ format_map_aspect

Time: ✅ 16.462ms (SLO: <21.500ms 📉 -23.4%) vs baseline: ~same

Memory: ✅ 43.037MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +5.0%


✅ format_map_noaspect

Time: ✅ 370.135µs (SLO: <500.000µs 📉 -26.0%) vs baseline: ~same

Memory: ✅ 42.900MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.5%


✅ format_noaspect

Time: ✅ 304.456µs (SLO: <500.000µs 📉 -39.1%) vs baseline: +1.3%

Memory: ✅ 42.920MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.6%


✅ index_aspect

Time: ✅ 130.784µs (SLO: <300.000µs 📉 -56.4%) vs baseline: +7.8%

Memory: ✅ 42.920MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.6%


✅ index_noaspect

Time: ✅ 40.372µs (SLO: <300.000µs 📉 -86.5%) vs baseline: +0.4%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.2%


✅ join_aspect

Time: ✅ 216.506µs (SLO: <300.000µs 📉 -27.8%) vs baseline: +0.7%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ join_noaspect

Time: ✅ 142.992µs (SLO: <300.000µs 📉 -52.3%) vs baseline: +0.1%

Memory: ✅ 42.959MB (SLO: <43.250MB 🟡 -0.7%) vs baseline: +5.0%


✅ ljust_aspect

Time: ✅ 600.684µs (SLO: <700.000µs 📉 -14.2%) vs baseline: 📈 +18.7%

Memory: ✅ 42.998MB (SLO: <43.250MB 🟡 -0.6%) vs baseline: +4.9%


✅ ljust_noaspect

Time: ✅ 255.555µs (SLO: <300.000µs 📉 -14.8%) vs baseline: -1.2%

Memory: ✅ 42.920MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.7%


✅ lower_aspect

Time: ✅ 294.112µs (SLO: <500.000µs 📉 -41.2%) vs baseline: +2.0%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.6%


✅ lower_noaspect

Time: ✅ 228.835µs (SLO: <300.000µs 📉 -23.7%) vs baseline: +0.7%

Memory: ✅ 42.920MB (SLO: <43.250MB 🟡 -0.8%) vs baseline: +4.6%


✅ lstrip_aspect

Time: ✅ 0.271ms (SLO: <3.000ms 📉 -91.0%) vs baseline: -1.6%

Memory: ✅ 42.939MB (SLO: <43.250MB 🟡 -0.7%) vs baseline: +4.7%


✅ lstrip_noaspect

Time: ✅ 0.178ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -0.4%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.7%


✅ modulo_aspect

Time: ✅ 14.366ms (SLO: <18.750ms 📉 -23.4%) vs baseline: ~same

Memory: ✅ 43.018MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +4.8%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.874ms (SLO: <19.350ms 📉 -23.1%) vs baseline: +0.4%

Memory: ✅ 43.037MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +5.0%


✅ modulo_aspect_for_bytes

Time: ✅ 14.460ms (SLO: <18.900ms 📉 -23.5%) vs baseline: +0.3%

Memory: ✅ 43.057MB (SLO: <43.500MB 🟡 -1.0%) vs baseline: +5.0%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.672ms (SLO: <19.150ms 📉 -23.4%) vs baseline: -0.2%

Memory: ✅ 43.037MB (SLO: <43.500MB 🟡 -1.1%) vs baseline: +5.0%


✅ modulo_noaspect

Time: ✅ 0.355ms (SLO: <3.000ms 📉 -88.2%) vs baseline: -0.2%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.8%


✅ replace_aspect

Time: ✅ 18.406ms (SLO: <24.000ms 📉 -23.3%) vs baseline: -0.1%

Memory: ✅ 43.136MB (SLO: <44.000MB 🟡 -2.0%) vs baseline: +5.4%


✅ replace_noaspect

Time: ✅ 282.930µs (SLO: <300.000µs -5.7%) vs baseline: +0.6%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ repr_aspect

Time: ✅ 320.029µs (SLO: <420.000µs 📉 -23.8%) vs baseline: +1.0%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.6%


✅ repr_noaspect

Time: ✅ 46.739µs (SLO: <90.000µs 📉 -48.1%) vs baseline: +0.2%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ rstrip_aspect

Time: ✅ 390.100µs (SLO: <500.000µs 📉 -22.0%) vs baseline: -0.4%

Memory: ✅ 42.998MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0%


✅ rstrip_noaspect

Time: ✅ 182.826µs (SLO: <300.000µs 📉 -39.1%) vs baseline: +0.7%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ slice_aspect

Time: ✅ 182.529µs (SLO: <300.000µs 📉 -39.2%) vs baseline: +0.6%

Memory: ✅ 42.861MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.6%


✅ slice_noaspect

Time: ✅ 54.001µs (SLO: <90.000µs 📉 -40.0%) vs baseline: +0.2%

Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ stringio_aspect

Time: ✅ 4.456ms (SLO: <5.000ms 📉 -10.9%) vs baseline: 📈 +14.8%

Memory: ✅ 42.841MB (SLO: <43.500MB 🟡 -1.5%) vs baseline: +4.5%


✅ stringio_noaspect

Time: ✅ 348.242µs (SLO: <500.000µs 📉 -30.4%) vs baseline: +0.8%

Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ strip_aspect

Time: ✅ 275.976µs (SLO: <350.000µs 📉 -21.1%) vs baseline: +0.4%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ strip_noaspect

Time: ✅ 176.524µs (SLO: <240.000µs 📉 -26.4%) vs baseline: -0.2%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ swapcase_aspect

Time: ✅ 327.940µs (SLO: <500.000µs 📉 -34.4%) vs baseline: +1.1%

Memory: ✅ 42.900MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.7%


✅ swapcase_noaspect

Time: ✅ 263.795µs (SLO: <400.000µs 📉 -34.1%) vs baseline: -0.2%

Memory: ✅ 42.880MB (SLO: <43.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ title_aspect

Time: ✅ 319.169µs (SLO: <500.000µs 📉 -36.2%) vs baseline: +0.4%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ title_noaspect

Time: ✅ 251.305µs (SLO: <400.000µs 📉 -37.2%) vs baseline: -0.3%

Memory: ✅ 42.959MB (SLO: <43.500MB 🟡 -1.2%) vs baseline: +5.0%


✅ translate_aspect

Time: ✅ 488.134µs (SLO: <700.000µs 📉 -30.3%) vs baseline: +1.0%

Memory: ✅ 42.821MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.5%


✅ translate_noaspect

Time: ✅ 421.995µs (SLO: <500.000µs 📉 -15.6%) vs baseline: -1.3%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ upper_aspect

Time: ✅ 292.654µs (SLO: <500.000µs 📉 -41.5%) vs baseline: +0.5%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ upper_noaspect

Time: ✅ 229.420µs (SLO: <400.000µs 📉 -42.6%) vs baseline: +1.1%

Memory: ✅ 42.920MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +4.8%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 516.869µs (SLO: <700.000µs 📉 -26.2%) vs baseline: 📈 +24.4%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ ospathbasename_noaspect

Time: ✅ 427.015µs (SLO: <700.000µs 📉 -39.0%) vs baseline: +0.6%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9%


✅ ospathjoin_aspect

Time: ✅ 610.654µs (SLO: <700.000µs 📉 -12.8%) vs baseline: -0.9%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.3%


✅ ospathjoin_noaspect

Time: ✅ 617.574µs (SLO: <700.000µs 📉 -11.8%) vs baseline: ~same

Memory: ✅ 42.487MB (SLO: <43.500MB -2.3%) vs baseline: +4.5%


✅ ospathnormcase_aspect

Time: ✅ 346.730µs (SLO: <700.000µs 📉 -50.5%) vs baseline: +0.4%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.7%


✅ ospathnormcase_noaspect

Time: ✅ 353.985µs (SLO: <700.000µs 📉 -49.4%) vs baseline: +0.5%

Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +4.5%


✅ ospathsplit_aspect

Time: ✅ 478.513µs (SLO: <700.000µs 📉 -31.6%) vs baseline: -0.6%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ ospathsplit_noaspect

Time: ✅ 487.610µs (SLO: <700.000µs 📉 -30.3%) vs baseline: +0.4%

Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +4.8%


✅ ospathsplitdrive_aspect

Time: ✅ 370.794µs (SLO: <700.000µs 📉 -47.0%) vs baseline: +1.1%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.5%


✅ ospathsplitdrive_noaspect

Time: ✅ 73.343µs (SLO: <700.000µs 📉 -89.5%) vs baseline: +0.3%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ ospathsplitext_aspect

Time: ✅ 460.445µs (SLO: <700.000µs 📉 -34.2%) vs baseline: +1.4%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ ospathsplitext_noaspect

Time: ✅ 467.894µs (SLO: <700.000µs 📉 -33.2%) vs baseline: +1.1%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.3%

🟡 Near SLO Breach (13 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.638ms (SLO: <22.300ms 📉 -11.9%) vs baseline: +0.2%

Memory: ✅ 68.754MB (SLO: <70.500MB -2.5%) vs baseline: +4.9%


✅ exception-replay-enabled

Time: ✅ 1.383ms (SLO: <1.450ms -4.6%) vs baseline: -0.5%

Memory: ✅ 66.858MB (SLO: <67.500MB 🟡 -1.0%) vs baseline: +4.8%


✅ iast

Time: ✅ 19.680ms (SLO: <22.250ms 📉 -11.6%) vs baseline: -0.3%

Memory: ✅ 68.832MB (SLO: <71.000MB -3.1%) vs baseline: +5.1%


✅ profiler

Time: ✅ 15.223ms (SLO: <16.550ms -8.0%) vs baseline: -0.7%

Memory: ✅ 57.016MB (SLO: <57.500MB 🟡 -0.8%) vs baseline: +5.2%


✅ resource-renaming

Time: ✅ 19.572ms (SLO: <21.750ms 📉 -10.0%) vs baseline: ~same

Memory: ✅ 68.764MB (SLO: <70.500MB -2.5%) vs baseline: +4.8%


✅ span-code-origin

Time: ✅ 20.050ms (SLO: <28.200ms 📉 -28.9%) vs baseline: +1.0%

Memory: ✅ 68.659MB (SLO: <71.000MB -3.3%) vs baseline: +5.0%


✅ tracer

Time: ✅ 19.604ms (SLO: <21.750ms -9.9%) vs baseline: -0.3%

Memory: ✅ 68.790MB (SLO: <71.000MB -3.1%) vs baseline: +5.0%


✅ tracer-and-profiler

Time: ✅ 21.638ms (SLO: <23.500ms -7.9%) vs baseline: -0.5%

Memory: ✅ 70.307MB (SLO: <71.000MB 🟡 -1.0%) vs baseline: +4.8%


✅ tracer-dont-create-db-spans

Time: ✅ 19.660ms (SLO: <21.500ms -8.6%) vs baseline: -0.6%

Memory: ✅ 68.808MB (SLO: <71.000MB -3.1%) vs baseline: +4.9%


✅ tracer-minimal

Time: ✅ 16.775ms (SLO: <17.500ms -4.1%) vs baseline: -0.2%

Memory: ✅ 68.763MB (SLO: <71.000MB -3.2%) vs baseline: +5.0%


✅ tracer-native

Time: ✅ 19.649ms (SLO: <21.750ms -9.7%) vs baseline: +0.4%

Memory: ✅ 68.734MB (SLO: <72.500MB -5.2%) vs baseline: +4.9%


✅ tracer-no-caches

Time: ✅ 17.602ms (SLO: <19.650ms 📉 -10.4%) vs baseline: -0.2%

Memory: ✅ 68.754MB (SLO: <71.000MB -3.2%) vs baseline: +5.1%


✅ tracer-no-databases

Time: ✅ 19.140ms (SLO: <20.100ms -4.8%) vs baseline: -0.6%

Memory: ✅ 68.695MB (SLO: <71.000MB -3.2%) vs baseline: +5.0%


✅ tracer-no-middleware

Time: ✅ 19.300ms (SLO: <21.500ms 📉 -10.2%) vs baseline: -0.2%

Memory: ✅ 68.714MB (SLO: <71.000MB -3.2%) vs baseline: +4.9%


✅ tracer-no-templates

Time: ✅ 19.548ms (SLO: <22.000ms 📉 -11.1%) vs baseline: +0.7%

Memory: ✅ 68.766MB (SLO: <70.500MB -2.5%) vs baseline: +5.0%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.257ms (SLO: <19.850ms 📉 -18.1%) vs baseline: -0.5%

Memory: ✅ 70.325MB (SLO: <71.000MB 🟡 -1.0%) vs baseline: +5.1%


✅ errortracking-enabled-user

Time: ✅ 16.340ms (SLO: <19.400ms 📉 -15.8%) vs baseline: ~same

Memory: ✅ 70.346MB (SLO: <71.000MB 🟡 -0.9%) vs baseline: +5.1%


✅ tracer-enabled

Time: ✅ 16.299ms (SLO: <19.450ms 📉 -16.2%) vs baseline: ~same

Memory: ✅ 70.404MB (SLO: <71.000MB 🟡 -0.8%) vs baseline: +5.1%


🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.091ms (SLO: <2.300ms -9.1%) vs baseline: +0.1%

Memory: ✅ 56.250MB (SLO: <56.500MB 🟡 -0.4%) vs baseline: +5.0%


✅ errortracking-enabled-user

Time: ✅ 2.095ms (SLO: <2.250ms -6.9%) vs baseline: ~same

Memory: ✅ 56.289MB (SLO: <56.500MB 🟡 -0.4%) vs baseline: +5.2%


✅ tracer-enabled

Time: ✅ 2.084ms (SLO: <2.300ms -9.4%) vs baseline: ~same

Memory: ✅ 56.250MB (SLO: <56.500MB 🟡 -0.4%) vs baseline: +5.2%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.419ms (SLO: <4.750ms 📉 -28.0%) vs baseline: +0.2%

Memory: ✅ 56.364MB (SLO: <66.500MB 📉 -15.2%) vs baseline: +5.4%


✅ appsec-post

Time: ✅ 2.878ms (SLO: <6.750ms 📉 -57.4%) vs baseline: +0.1%

Memory: ✅ 56.364MB (SLO: <66.500MB 📉 -15.2%) vs baseline: +5.4%


✅ appsec-telemetry

Time: ✅ 3.435ms (SLO: <4.750ms 📉 -27.7%) vs baseline: +1.2%

Memory: ✅ 56.324MB (SLO: <66.500MB 📉 -15.3%) vs baseline: +5.3%


✅ debugger

Time: ✅ 1.872ms (SLO: <2.000ms -6.4%) vs baseline: +0.3%

Memory: ✅ 48.273MB (SLO: <49.500MB -2.5%) vs baseline: +5.3%


✅ iast-get

Time: ✅ 1.860ms (SLO: <2.000ms -7.0%) vs baseline: +0.2%

Memory: ✅ 45.344MB (SLO: <49.000MB -7.5%) vs baseline: +5.4%


✅ profiler

Time: ✅ 1.910ms (SLO: <2.100ms -9.0%) vs baseline: -0.1%

Memory: ✅ 49.232MB (SLO: <50.000MB 🟡 -1.5%) vs baseline: +4.9%


✅ resource-renaming

Time: ✅ 3.375ms (SLO: <3.650ms -7.5%) vs baseline: ~same

Memory: ✅ 56.344MB (SLO: <57.000MB 🟡 -1.2%) vs baseline: +5.4%


✅ tracer

Time: ✅ 3.389ms (SLO: <3.650ms -7.2%) vs baseline: -0.1%

Memory: ✅ 56.330MB (SLO: <56.500MB 🟡 -0.3%) vs baseline: +5.4%


✅ tracer-native

Time: ✅ 3.401ms (SLO: <3.650ms -6.8%) vs baseline: +0.2%

Memory: ✅ 56.386MB (SLO: <60.000MB -6.0%) vs baseline: +5.5%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.078ms (SLO: <4.200ms 📉 -50.5%) vs baseline: -0.2%

Memory: ✅ 56.269MB (SLO: <66.000MB 📉 -14.7%) vs baseline: +5.2%


✅ iast-enabled

Time: ✅ 2.079ms (SLO: <2.800ms 📉 -25.7%) vs baseline: -0.3%

Memory: ✅ 56.348MB (SLO: <62.500MB -9.8%) vs baseline: +5.3%


✅ tracer-enabled

Time: ✅ 2.075ms (SLO: <2.250ms -7.8%) vs baseline: -0.2%

Memory: ✅ 56.309MB (SLO: <56.500MB 🟡 -0.3%) vs baseline: +5.2%


🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 80.601µs (SLO: <100.000µs 📉 -19.4%) vs baseline: -0.1%

Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.6%


✅ b3_headers

Time: ✅ 14.153µs (SLO: <20.000µs 📉 -29.2%) vs baseline: +0.4%

Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.8%


✅ b3_single_headers

Time: ✅ 13.270µs (SLO: <20.000µs 📉 -33.7%) vs baseline: ~same

Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.964µs (SLO: <80.000µs 📉 -20.0%) vs baseline: ~same

Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +4.8%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 69.137µs (SLO: <80.000µs 📉 -13.6%) vs baseline: +5.2%

Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.8%


✅ empty_headers

Time: ✅ 1.604µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.9%

Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +5.1%


✅ full_t_id_datadog_headers

Time: ✅ 22.224µs (SLO: <30.000µs 📉 -25.9%) vs baseline: -0.5%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +5.1%


✅ invalid_priority_header

Time: ✅ 6.521µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.2%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +5.2%


✅ invalid_span_id_header

Time: ✅ 6.499µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.5%

Memory: ✅ 35.311MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.9%


✅ invalid_tags_header

Time: ✅ 6.529µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.4%

Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.8%


✅ invalid_trace_id_header

Time: ✅ 6.521µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.2%

Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +4.9%


✅ large_header_no_matches

Time: ✅ 27.742µs (SLO: <30.000µs -7.5%) vs baseline: -0.3%

Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +4.6%


✅ large_valid_headers_all

Time: ✅ 28.890µs (SLO: <40.000µs 📉 -27.8%) vs baseline: ~same

Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +4.7%


✅ medium_header_no_matches

Time: ✅ 9.882µs (SLO: <20.000µs 📉 -50.6%) vs baseline: -0.5%

Memory: ✅ 35.114MB (SLO: <36.000MB -2.5%) vs baseline: +4.3%


✅ medium_valid_headers_all

Time: ✅ 11.299µs (SLO: <20.000µs 📉 -43.5%) vs baseline: -0.1%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +5.5%


✅ none_propagation_style

Time: ✅ 1.702µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -1.5%

Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.7%


✅ tracecontext_headers

Time: ✅ 34.604µs (SLO: <40.000µs 📉 -13.5%) vs baseline: +0.5%

Memory: ✅ 35.311MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +5.0%


✅ valid_headers_all

Time: ✅ 6.526µs (SLO: <10.000µs 📉 -34.7%) vs baseline: -0.5%

Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +5.0%


✅ valid_headers_basic

Time: ✅ 6.118µs (SLO: <10.000µs 📉 -38.8%) vs baseline: ~same

Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.8%


✅ wsgi_empty_headers

Time: ✅ 1.595µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.3%

Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +5.0%


✅ wsgi_invalid_priority_header

Time: ✅ 6.591µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.7%

Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +5.2%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.590µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.5%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +5.2%


✅ wsgi_invalid_tags_header

Time: ✅ 6.571µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.2%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +5.1%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.636µs (SLO: <10.000µs 📉 -33.6%) vs baseline: +0.7%

Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +4.8%


✅ wsgi_large_header_no_matches

Time: ✅ 28.809µs (SLO: <40.000µs 📉 -28.0%) vs baseline: ~same

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +5.9%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.977µs (SLO: <40.000µs 📉 -25.1%) vs baseline: ~same

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +6.2%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.214µs (SLO: <20.000µs 📉 -48.9%) vs baseline: -0.2%

Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +5.2%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.789µs (SLO: <20.000µs 📉 -41.1%) vs baseline: +0.9%

Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.2%


✅ wsgi_valid_headers_all

Time: ✅ 6.577µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.5%

Memory: ✅ 35.409MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.3%


✅ wsgi_valid_headers_basic

Time: ✅ 6.147µs (SLO: <10.000µs 📉 -38.5%) vs baseline: ~same

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.2%


🟡 iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 3.724ms (SLO: <4.880ms 📉 -23.7%) vs baseline: +6.9%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ re_expand_noaspect

Time: ✅ 3.470ms (SLO: <4.620ms 📉 -24.9%) vs baseline: -0.3%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ re_findall_aspect

Time: ✅ 338.592µs (SLO: <450.000µs 📉 -24.8%) vs baseline: +0.5%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ re_findall_noaspect

Time: ✅ 325.194µs (SLO: <430.000µs 📉 -24.4%) vs baseline: +1.0%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0%


✅ re_finditer_aspect

Time: ✅ 454.353µs (SLO: <590.000µs 📉 -23.0%) vs baseline: +0.2%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ re_finditer_noaspect

Time: ✅ 325.581µs (SLO: <440.000µs 📉 -26.0%) vs baseline: +0.6%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.6%


✅ re_fullmatch_aspect

Time: ✅ 281.783µs (SLO: <360.000µs 📉 -21.7%) vs baseline: +0.2%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%


✅ re_fullmatch_noaspect

Time: ✅ 308.954µs (SLO: <400.000µs 📉 -22.8%) vs baseline: +1.6%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ re_group_aspect

Time: ✅ 479.462µs (SLO: <630.000µs 📉 -23.9%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.5%


✅ re_group_noaspect

Time: ✅ 485.759µs (SLO: <640.000µs 📉 -24.1%) vs baseline: -0.6%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.6%


✅ re_groups_aspect

Time: ✅ 494.297µs (SLO: <650.000µs 📉 -24.0%) vs baseline: ~same

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%


✅ re_groups_noaspect

Time: ✅ 500.682µs (SLO: <650.000µs 📉 -23.0%) vs baseline: +0.6%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ re_match_aspect

Time: ✅ 287.907µs (SLO: <370.000µs 📉 -22.2%) vs baseline: +0.8%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ re_match_noaspect

Time: ✅ 311.901µs (SLO: <410.000µs 📉 -23.9%) vs baseline: +0.6%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ re_search_aspect

Time: ✅ 275.832µs (SLO: <350.000µs 📉 -21.2%) vs baseline: +4.7%

Memory: ✅ 42.448MB (SLO: <43.500MB -2.4%) vs baseline: +4.3%


✅ re_search_noaspect

Time: ✅ 288.635µs (SLO: <380.000µs 📉 -24.0%) vs baseline: +0.5%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.5%


✅ re_sub_aspect

Time: ✅ 353.092µs (SLO: <460.000µs 📉 -23.2%) vs baseline: -1.0%

Memory: ✅ 42.939MB (SLO: <43.500MB 🟡 -1.3%) vs baseline: +5.6%


✅ re_sub_noaspect

Time: ✅ 391.536µs (SLO: <520.000µs 📉 -24.7%) vs baseline: -0.6%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.3%


✅ re_subn_aspect

Time: ✅ 372.182µs (SLO: <490.000µs 📉 -24.0%) vs baseline: -0.4%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.6%


✅ re_subn_noaspect

Time: ✅ 402.364µs (SLO: <530.000µs 📉 -24.1%) vs baseline: -0.5%

Memory: ✅ 42.723MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1%


🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.385µs (SLO: <10.000µs 📉 -76.1%) vs baseline: -0.1%

Memory: ✅ 35.488MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.6%


✅ high_rate_limit

Time: ✅ 2.449µs (SLO: <10.000µs 📉 -75.5%) vs baseline: ~same

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +4.5%


✅ long_window

Time: ✅ 2.379µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +0.3%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.0%


✅ low_rate_limit

Time: ✅ 2.378µs (SLO: <10.000µs 📉 -76.2%) vs baseline: -0.2%

Memory: ✅ 35.566MB (SLO: <36.000MB 🟡 -1.2%) vs baseline: +4.9%


✅ no_rate_limit

Time: ✅ 0.822µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -0.6%

Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.7%


✅ short_window

Time: ✅ 2.517µs (SLO: <10.000µs 📉 -74.8%) vs baseline: +0.5%

Memory: ✅ 35.409MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.0%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 309.513ms (SLO: <320.950ms -3.6%) vs baseline: ~same

Memory: ✅ 36.490MB (SLO: <36.500MB 🟡 ~same) vs baseline: +5.3%


✅ deep-profiled

Time: ✅ 325.557ms (SLO: <359.150ms -9.4%) vs baseline: -0.1%

Memory: ✅ 40.265MB (SLO: <40.500MB 🟡 -0.6%) vs baseline: +4.8%


✅ medium

Time: ✅ 7.080ms (SLO: <7.400ms -4.3%) vs baseline: +0.3%

Memory: ✅ 35.625MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +6.3%


✅ shallow

Time: ✅ 0.968ms (SLO: <1.050ms -7.8%) vs baseline: +1.5%

Memory: ✅ 35.566MB (SLO: <36.000MB 🟡 -1.2%) vs baseline: +6.2%


🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.593µs (SLO: <20.000µs 📉 -47.0%) vs baseline: +0.2%

Memory: ✅ 36.019MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +4.7%


✅ all-enabled

Time: ✅ 41.058µs (SLO: <50.000µs 📉 -17.9%) vs baseline: +2.8%

Memory: ✅ 35.979MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ collectipvariant_exists

Time: ✅ 41.027µs (SLO: <50.000µs 📉 -17.9%) vs baseline: +0.4%

Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.6%


✅ no-collectipvariant

Time: ✅ 40.228µs (SLO: <50.000µs 📉 -19.5%) vs baseline: +0.8%

Memory: ✅ 36.117MB (SLO: <36.500MB 🟡 -1.0%) vs baseline: +5.1%


✅ no-useragentvariant

Time: ✅ 39.108µs (SLO: <50.000µs 📉 -21.8%) vs baseline: +1.1%

Memory: ✅ 35.960MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.6%


✅ obfuscation-no-query

Time: ✅ 40.947µs (SLO: <50.000µs 📉 -18.1%) vs baseline: +0.9%

Memory: ✅ 36.038MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +5.0%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.074µs (SLO: <90.000µs 📉 -15.5%) vs baseline: ~same

Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +4.8%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.419µs (SLO: <90.000µs 📉 -15.1%) vs baseline: -0.2%

Memory: ✅ 36.097MB (SLO: <36.500MB 🟡 -1.1%) vs baseline: +5.0%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.287µs (SLO: <170.000µs -9.2%) vs baseline: ~same

Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.598µs (SLO: <160.000µs -7.1%) vs baseline: -0.2%

Memory: ✅ 36.038MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +5.1%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.938µs (SLO: <170.000µs -8.9%) vs baseline: -0.3%

Memory: ✅ 36.156MB (SLO: <36.500MB 🟡 -0.9%) vs baseline: +5.3%


✅ useragentvariant_exists_1

Time: ✅ 39.744µs (SLO: <50.000µs 📉 -20.5%) vs baseline: +0.7%

Memory: ✅ 36.019MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +5.0%


✅ useragentvariant_exists_2

Time: ✅ 40.902µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +0.8%

Memory: ✅ 36.038MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ useragentvariant_exists_3

Time: ✅ 40.248µs (SLO: <50.000µs 📉 -19.5%) vs baseline: +0.4%

Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.0%


✅ useragentvariant_not_exists_1

Time: ✅ 39.733µs (SLO: <50.000µs 📉 -20.5%) vs baseline: +0.3%

Memory: ✅ 36.038MB (SLO: <36.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ useragentvariant_not_exists_2

Time: ✅ 39.755µs (SLO: <50.000µs 📉 -20.5%) vs baseline: +0.5%

Memory: ✅ 36.038MB (SLO: <36.000MB +0.1%) vs baseline: +4.9%


🟡 span - 26/26

✅ add-event

Time: ✅ 19.757ms (SLO: <22.500ms 📉 -12.2%) vs baseline: -0.1%

Memory: ✅ 37.332MB (SLO: <53.000MB 📉 -29.6%) vs baseline: +4.7%


✅ add-metrics

Time: ✅ 89.204ms (SLO: <93.500ms -4.6%) vs baseline: -0.8%

Memory: ✅ 41.481MB (SLO: <53.000MB 📉 -21.7%) vs baseline: +4.6%


✅ add-tags

Time: ✅ 142.258ms (SLO: <155.000ms -8.2%) vs baseline: -0.1%

Memory: ✅ 41.354MB (SLO: <53.000MB 📉 -22.0%) vs baseline: +4.6%


✅ get-context

Time: ✅ 17.768ms (SLO: <20.500ms 📉 -13.3%) vs baseline: -0.6%

Memory: ✅ 37.080MB (SLO: <53.000MB 📉 -30.0%) vs baseline: +4.2%


✅ is-recording

Time: ✅ 18.042ms (SLO: <20.500ms 📉 -12.0%) vs baseline: -0.7%

Memory: ✅ 37.080MB (SLO: <53.000MB 📉 -30.0%) vs baseline: +4.2%


✅ record-exception

Time: ✅ 39.078ms (SLO: <41.000ms -4.7%) vs baseline: -0.6%

Memory: ✅ 37.699MB (SLO: <53.000MB 📉 -28.9%) vs baseline: +4.8%


✅ set-status

Time: ✅ 19.573ms (SLO: <22.000ms 📉 -11.0%) vs baseline: +0.3%

Memory: ✅ 37.238MB (SLO: <53.000MB 📉 -29.7%) vs baseline: +4.9%


✅ start

Time: ✅ 18.498ms (SLO: <20.500ms -9.8%) vs baseline: +4.6%

Memory: ✅ 37.100MB (SLO: <53.000MB 📉 -30.0%) vs baseline: +4.4%


✅ start-finish

Time: ✅ 53.365ms (SLO: <54.000ms 🟡 -1.2%) vs baseline: ~same

Memory: ✅ 35.291MB (SLO: <36.000MB 🟡 -2.0%) vs baseline: +5.2%


✅ start-finish-telemetry

Time: ✅ 54.477ms (SLO: <56.000ms -2.7%) vs baseline: -0.4%

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.3%


✅ start-finish-traceid128

Time: ✅ 56.527ms (SLO: <57.000ms 🟡 -0.8%) vs baseline: -0.8%

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.3%


✅ start-traceid128

Time: ✅ 18.078ms (SLO: <22.500ms 📉 -19.7%) vs baseline: -0.8%

Memory: ✅ 37.080MB (SLO: <53.000MB 📉 -30.0%) vs baseline: +4.7%


✅ update-name

Time: ✅ 18.150ms (SLO: <22.000ms 📉 -17.5%) vs baseline: ~same

Memory: ✅ 37.340MB (SLO: <53.000MB 📉 -29.5%) vs baseline: +4.9%


🟡 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.295µs (SLO: <20.000µs 📉 -83.5%) vs baseline: +8.0%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.6%


✅ 1-count-metrics-100-times

Time: ✅ 200.401µs (SLO: <220.000µs -8.9%) vs baseline: +0.5%

Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.7%


✅ 1-distribution-metric-1-times

Time: ✅ 3.379µs (SLO: <20.000µs 📉 -83.1%) vs baseline: -0.3%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.7%


✅ 1-distribution-metrics-100-times

Time: ✅ 214.748µs (SLO: <230.000µs -6.6%) vs baseline: -0.5%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.7%


✅ 1-gauge-metric-1-times

Time: ✅ 2.222µs (SLO: <20.000µs 📉 -88.9%) vs baseline: -0.2%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.7%


✅ 1-gauge-metrics-100-times

Time: ✅ 136.466µs (SLO: <150.000µs -9.0%) vs baseline: -0.2%

Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +5.9%


✅ 1-rate-metric-1-times

Time: ✅ 3.167µs (SLO: <20.000µs 📉 -84.2%) vs baseline: -0.2%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.9%


✅ 1-rate-metrics-100-times

Time: ✅ 214.771µs (SLO: <250.000µs 📉 -14.1%) vs baseline: +0.9%

Memory: ✅ 35.409MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.5%


✅ 100-count-metrics-100-times

Time: ✅ 20.434ms (SLO: <22.000ms -7.1%) vs baseline: +1.3%

Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.6%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.266ms (SLO: <2.550ms 📉 -11.1%) vs baseline: ~same

Memory: ✅ 35.488MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.7%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.431ms (SLO: <1.550ms -7.7%) vs baseline: +1.3%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.6%


✅ 100-rate-metrics-100-times

Time: ✅ 2.218ms (SLO: <2.550ms 📉 -13.0%) vs baseline: +0.3%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +5.6%


✅ flush-1-metric

Time: ✅ 4.721µs (SLO: <20.000µs 📉 -76.4%) vs baseline: +0.2%

Memory: ✅ 35.527MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +5.0%


✅ flush-100-metrics

Time: ✅ 175.528µs (SLO: <250.000µs 📉 -29.8%) vs baseline: -0.8%

Memory: ✅ 35.507MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +4.6%


✅ flush-1000-metrics

Time: ✅ 2.182ms (SLO: <2.500ms 📉 -12.7%) vs baseline: -1.1%

Memory: ✅ 36.353MB (SLO: <36.500MB 🟡 -0.4%) vs baseline: +4.8%


🟡 tracer - 6/6

✅ large

Time: ✅ 30.469ms (SLO: <32.950ms -7.5%) vs baseline: +0.6%

Memory: ✅ 36.313MB (SLO: <36.500MB 🟡 -0.5%) vs baseline: +4.6%


✅ medium

Time: ✅ 2.996ms (SLO: <3.200ms -6.4%) vs baseline: ~same

Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +4.8%


✅ small

Time: ✅ 347.467µs (SLO: <370.000µs -6.1%) vs baseline: +2.2%

Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +5.0%

⚠️ Unstable Tests (2 suites)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.259µs (SLO: <20.000µs 📉 -33.7%) vs baseline: -0.1%

Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +5.0%


✅ context_with_data_no_listeners

Time: ✅ 3.249µs (SLO: <10.000µs 📉 -67.5%) vs baseline: -0.5%

Memory: ✅ 35.193MB (SLO: <36.000MB -2.2%) vs baseline: +4.6%


✅ get_item_exists

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -1.4%

Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +5.0%


✅ get_item_missing

Time: ✅ 0.634µs (SLO: <10.000µs 📉 -93.7%) vs baseline: ~same

Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +5.1%


✅ set_item

Time: ✅ 23.959µs (SLO: <30.000µs 📉 -20.1%) vs baseline: -1.2%

Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +4.9%


⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 154.996µs (SLO: <170.000µs -8.8%) vs baseline: ~same

Memory: ✅ 40.486MB (SLO: <43.500MB -6.9%) vs baseline: +5.9%


✅ import_many_cached

Time: ✅ 120.875µs (SLO: <130.000µs -7.0%) vs baseline: ~same

Memory: ✅ 40.064MB (SLO: <43.500MB -7.9%) vs baseline: +4.8%


✅ import_many_stdlib

Time: ✅ 0.756ms (SLO: <1.750ms 📉 -56.8%) vs baseline: -0.4%

Memory: ✅ 40.308MB (SLO: <43.500MB -7.3%) vs baseline: +5.3%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.173ms (SLO: <1.100ms 📉 -84.3%) vs baseline: +0.4%

Memory: ✅ 40.229MB (SLO: <43.500MB -7.5%) vs baseline: +5.4%


✅ import_many_unknown

Time: ✅ 840.456µs (SLO: <890.000µs -5.6%) vs baseline: +1.2%

Memory: ✅ 40.277MB (SLO: <43.500MB -7.4%) vs baseline: +4.8%


✅ import_many_unknown_cached

Time: ✅ 793.520µs (SLO: <870.000µs -8.8%) vs baseline: -0.2%

Memory: ✅ 40.102MB (SLO: <43.500MB -7.8%) vs baseline: +4.0%


✅ import_one

Time: ✅ 20.053µs (SLO: <30.000µs 📉 -33.2%) vs baseline: +1.2%

Memory: ✅ 40.418MB (SLO: <43.500MB -7.1%) vs baseline: +5.4%


✅ import_one_cache

Time: ✅ 6.292µs (SLO: <10.000µs 📉 -37.1%) vs baseline: ~same

Memory: ✅ 40.372MB (SLO: <43.500MB -7.2%) vs baseline: +4.9%


✅ import_one_stdlib

Time: ✅ 18.766µs (SLO: <20.000µs -6.2%) vs baseline: -0.2%

Memory: ✅ 40.336MB (SLO: <43.500MB -7.3%) vs baseline: +4.9%


✅ import_one_stdlib_cache

Time: ✅ 6.295µs (SLO: <10.000µs 📉 -37.1%) vs baseline: +0.8%

Memory: ✅ 40.327MB (SLO: <43.500MB -7.3%) vs baseline: +5.4%


✅ import_one_unknown

Time: ✅ 45.716µs (SLO: <50.000µs -8.6%) vs baseline: -0.2%

Memory: ✅ 40.119MB (SLO: <43.500MB -7.8%) vs baseline: +4.4%


✅ import_one_unknown_cache

Time: ✅ 6.287µs (SLO: <10.000µs 📉 -37.1%) vs baseline: +0.1%

Memory: ✅ 40.447MB (SLO: <43.000MB -5.9%) vs baseline: +5.6%

✅ All Tests Passing (7 suites)
httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.081µs (SLO: <30.000µs 📉 -26.4%) vs baseline: +3.7%

Memory: ✅ 35.114MB (SLO: <36.000MB -2.5%) vs baseline: +4.8%


✅ with_all

Time: ✅ 27.949µs (SLO: <40.000µs 📉 -30.1%) vs baseline: -0.4%

Memory: ✅ 35.134MB (SLO: <36.000MB -2.4%) vs baseline: +4.4%


✅ with_dd_origin

Time: ✅ 24.973µs (SLO: <30.000µs 📉 -16.8%) vs baseline: -0.7%

Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +5.0%


✅ with_priority_and_origin

Time: ✅ 24.441µs (SLO: <40.000µs 📉 -38.9%) vs baseline: -0.2%

Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +4.6%


✅ with_sampling_priority

Time: ✅ 21.246µs (SLO: <30.000µs 📉 -29.2%) vs baseline: ~same

Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +4.7%


✅ with_tags

Time: ✅ 25.955µs (SLO: <40.000µs 📉 -35.1%) vs baseline: -0.5%

Memory: ✅ 35.075MB (SLO: <36.000MB -2.6%) vs baseline: +4.3%


✅ with_tags_invalid

Time: ✅ 27.475µs (SLO: <40.000µs 📉 -31.3%) vs baseline: -0.1%

Memory: ✅ 35.173MB (SLO: <36.000MB -2.3%) vs baseline: +5.0%


✅ with_tags_max_size

Time: ✅ 26.663µs (SLO: <40.000µs 📉 -33.3%) vs baseline: +0.2%

Memory: ✅ 35.134MB (SLO: <36.000MB -2.4%) vs baseline: +4.4%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 145.393µs (SLO: <250.000µs 📉 -41.8%) vs baseline: +0.5%

Memory: ✅ 42.566MB (SLO: <44.000MB -3.3%) vs baseline: +4.9%


✅ rsplit_noaspect

Time: ✅ 154.611µs (SLO: <250.000µs 📉 -38.2%) vs baseline: +1.9%

Memory: ✅ 42.644MB (SLO: <44.000MB -3.1%) vs baseline: +4.8%


✅ split_aspect

Time: ✅ 144.815µs (SLO: <250.000µs 📉 -42.1%) vs baseline: +0.3%

Memory: ✅ 42.585MB (SLO: <44.000MB -3.2%) vs baseline: +4.6%


✅ split_noaspect

Time: ✅ 151.415µs (SLO: <250.000µs 📉 -39.4%) vs baseline: -0.8%

Memory: ✅ 42.585MB (SLO: <44.000MB -3.2%) vs baseline: +4.6%


✅ splitlines_aspect

Time: ✅ 146.431µs (SLO: <250.000µs 📉 -41.4%) vs baseline: +0.2%

Memory: ✅ 42.605MB (SLO: <44.000MB -3.2%) vs baseline: +4.6%


✅ splitlines_noaspect

Time: ✅ 151.405µs (SLO: <250.000µs 📉 -39.4%) vs baseline: -1.2%

Memory: ✅ 42.644MB (SLO: <44.000MB -3.1%) vs baseline: +4.8%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.688µs (SLO: <60.000µs 📉 -18.9%) vs baseline: ~same

Memory: ✅ 38.869MB (SLO: <42.000MB -7.5%) vs baseline: +5.2%


✅ propagation_enabled

Time: ✅ 136.126µs (SLO: <190.000µs 📉 -28.4%) vs baseline: +0.1%

Memory: ✅ 38.653MB (SLO: <42.000MB -8.0%) vs baseline: +4.5%


✅ propagation_enabled_100

Time: ✅ 1.617ms (SLO: <2.300ms 📉 -29.7%) vs baseline: +1.5%

Memory: ✅ 38.653MB (SLO: <42.000MB -8.0%) vs baseline: +4.9%


✅ propagation_enabled_1000

Time: ✅ 29.391ms (SLO: <34.550ms 📉 -14.9%) vs baseline: ~same

Memory: ✅ 38.968MB (SLO: <42.000MB -7.2%) vs baseline: +4.4%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.247ms (SLO: <42.000ms -4.2%) vs baseline: -0.2%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.5%


✅ add-link

Time: ✅ 36.334ms (SLO: <38.550ms -5.7%) vs baseline: -0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.1%


✅ add-metrics

Time: ✅ 220.150ms (SLO: <232.000ms -5.1%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.1%


✅ add-tags

Time: ✅ 214.424ms (SLO: <221.600ms -3.2%) vs baseline: +1.6%

Memory: ✅ 37.906MB (SLO: <39.000MB -2.8%) vs baseline: +4.4%


✅ get-context

Time: ✅ 29.123ms (SLO: <31.300ms -7.0%) vs baseline: -0.6%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%


✅ is-recording

Time: ✅ 29.290ms (SLO: <31.000ms -5.5%) vs baseline: -0.4%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.5%


✅ record-exception

Time: ✅ 63.203ms (SLO: <65.850ms -4.0%) vs baseline: -0.3%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%


✅ set-status

Time: ✅ 32.059ms (SLO: <34.150ms -6.1%) vs baseline: +0.5%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%


✅ start

Time: ✅ 29.479ms (SLO: <30.150ms -2.2%) vs baseline: +1.9%

Memory: ✅ 37.867MB (SLO: <39.000MB -2.9%) vs baseline: +4.4%


✅ start-finish

Time: ✅ 33.983ms (SLO: <35.350ms -3.9%) vs baseline: -0.7%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.8%


✅ start-finish-telemetry

Time: ✅ 33.798ms (SLO: <35.450ms -4.7%) vs baseline: -1.1%

Memory: ✅ 37.906MB (SLO: <39.000MB -2.8%) vs baseline: +4.2%


✅ update-name

Time: ✅ 31.131ms (SLO: <33.400ms -6.8%) vs baseline: -0.1%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%


otelspan - 22/22

✅ add-event

Time: ✅ 42.908ms (SLO: <47.150ms -9.0%) vs baseline: +0.1%

Memory: ✅ 39.965MB (SLO: <47.000MB 📉 -15.0%) vs baseline: +5.0%


✅ add-metrics

Time: ✅ 263.884ms (SLO: <344.800ms 📉 -23.5%) vs baseline: +1.1%

Memory: ✅ 44.128MB (SLO: <47.500MB -7.1%) vs baseline: +4.7%


✅ add-tags

Time: ✅ 319.899ms (SLO: <330.000ms -3.1%) vs baseline: +0.5%

Memory: ✅ 44.218MB (SLO: <47.500MB -6.9%) vs baseline: +4.7%


✅ get-context

Time: ✅ 82.520ms (SLO: <92.350ms 📉 -10.6%) vs baseline: -0.1%

Memory: ✅ 40.271MB (SLO: <46.500MB 📉 -13.4%) vs baseline: +4.6%


✅ is-recording

Time: ✅ 39.497ms (SLO: <44.500ms 📉 -11.2%) vs baseline: ~same

Memory: ✅ 39.800MB (SLO: <47.500MB 📉 -16.2%) vs baseline: +4.6%


✅ record-exception

Time: ✅ 61.761ms (SLO: <67.650ms -8.7%) vs baseline: ~same

Memory: ✅ 40.468MB (SLO: <47.000MB 📉 -13.9%) vs baseline: +5.1%


✅ set-status

Time: ✅ 45.982ms (SLO: <50.400ms -8.8%) vs baseline: +0.1%

Memory: ✅ 39.753MB (SLO: <47.000MB 📉 -15.4%) vs baseline: +4.4%


✅ start

Time: ✅ 40.057ms (SLO: <43.450ms -7.8%) vs baseline: +3.0%

Memory: ✅ 39.907MB (SLO: <47.000MB 📉 -15.1%) vs baseline: +4.8%


✅ start-finish

Time: ✅ 85.806ms (SLO: <88.000ms -2.5%) vs baseline: +0.2%

Memory: ✅ 37.631MB (SLO: <46.500MB 📉 -19.1%) vs baseline: +4.6%


✅ start-finish-telemetry

Time: ✅ 87.020ms (SLO: <89.000ms -2.2%) vs baseline: -0.2%

Memory: ✅ 37.690MB (SLO: <46.500MB 📉 -18.9%) vs baseline: +5.0%


✅ update-name

Time: ✅ 40.154ms (SLO: <45.150ms 📉 -11.1%) vs baseline: -0.4%

Memory: ✅ 39.923MB (SLO: <47.000MB 📉 -15.1%) vs baseline: +4.7%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.045ms (SLO: <354.300ms -3.5%) vs baseline: -1.4%

Memory: ✅ 40.803MB (SLO: <43.500MB -6.2%) vs baseline: +4.3%


✅ cache_on

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.9%

Memory: ✅ 40.317MB (SLO: <43.500MB -7.3%) vs baseline: +5.8%


samplingrules - 8/8

✅ average_match

Time: ✅ 137.042µs (SLO: <290.000µs 📉 -52.7%) vs baseline: -0.2%

Memory: ✅ 35.055MB (SLO: <36.000MB -2.6%) vs baseline: +4.4%


✅ high_match

Time: ✅ 173.420µs (SLO: <480.000µs 📉 -63.9%) vs baseline: -0.7%

Memory: ✅ 35.114MB (SLO: <36.000MB -2.5%) vs baseline: +4.4%


✅ low_match

Time: ✅ 99.317µs (SLO: <120.000µs 📉 -17.2%) vs baseline: +1.3%

Memory: ✅ 604.013MB (SLO: <700.000MB 📉 -13.7%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.675ms (SLO: <8.500ms 📉 -68.5%) vs baseline: +0.9%

Memory: ✅ 71.546MB (SLO: <75.000MB -4.6%) vs baseline: +5.0%

ℹ️ Scenarios Missing SLO Configuration (26 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

@wantsui
wantsui merged commit 9fd7359 into main Jan 27, 2026
1015 checks passed
@wantsui
wantsui deleted the bump-system-tests2 branch January 27, 2026 22:09
@cit-pr-commenter-54b7da

Copy link
Copy Markdown

Codeowners resolved as

.github/workflows/system-tests.yml                                      @DataDog/python-guild @DataDog/apm-core-python
.gitlab-ci.yml                                                          @DataDog/python-guild @DataDog/apm-core-python

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants