Skip to content

docs(serverless): add serverless integrations skill#9188

Merged
crysmags merged 4 commits into
masterfrom
crysmags/serverless-integrations-skill
Jul 9, 2026
Merged

docs(serverless): add serverless integrations skill#9188
crysmags merged 4 commits into
masterfrom
crysmags/serverless-integrations-skill

Conversation

@crysmags

@crysmags crysmags commented Jul 2, 2026

Copy link
Copy Markdown
Collaborator

What does this PR do?

Adds a repo-local Codex skill for serverless integrations in dd-trace-js. The skill routes platform invocation work apart from normal library instrumentation and includes references for architecture, implementation, testing, deployed probes, and existing reference integrations.

Motivation

We need serverless-specific guidance discoverable directly from dd-trace-js before wiring toolkit workflow support. The skill captures current dd-trace-js conventions for root serverless spans, lifecycle ownership, context extraction, and manual/deployed testing expectations.

Additional Notes

Validated with:

PYTHONPATH=/private/tmp/codex-pyyaml python3 /Users/crystal.magloire/.codex/skills/.system/skill-creator/scripts/quick_validate.py .agents/skills/serverless-integrations

Result: Skill is valid!

No runtime code changes.

@dd-octo-sts

dd-octo-sts Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Overall package size

Self size: 6.7 MB
Deduped: 7.36 MB
No deduping: 7.36 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 3.3.1 | 122.62 kB | 437.94 kB | | opentracing | 0.14.7 | 194.81 kB | 194.81 kB | | dc-polyfill | 0.1.11 | 25.74 kB | 25.74 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@datadog-datadog-prod-us1-2

datadog-datadog-prod-us1-2 Bot commented Jul 2, 2026

Copy link
Copy Markdown

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 96.52% (+0.00%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 70caa14 | Docs | Datadog PR Page | Give us feedback!

@codecov

codecov Bot commented Jul 2, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 96.56%. Comparing base (7589a18) to head (70caa14).

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #9188   +/-   ##
=======================================
  Coverage   96.56%   96.56%           
=======================================
  Files         918      918           
  Lines      121396   121396           
  Branches    20894    20867   -27     
=======================================
  Hits       117225   117225           
  Misses       4171     4171           
Flag Coverage Δ
aiguard 53.62% <ø> (-0.05%) ⬇️
aiguard-integration 57.05% <ø> (ø)
apm-bucket-0 53.84% <ø> (-0.05%) ⬇️
apm-bucket-1 58.15% <ø> (-0.05%) ⬇️
apm-bucket-2 56.17% <ø> (-0.05%) ⬇️
apm-capabilities-tracing 60.27% <ø> (ø)
apm-integrations-aerospike 53.01% <ø> (-0.05%) ⬇️
apm-integrations-confluentinc-kafka-javascript 57.05% <ø> (-0.12%) ⬇️
apm-integrations-couchbase 53.33% <ø> (-0.04%) ⬇️
apm-integrations-http 58.03% <ø> (-0.05%) ⬇️
apm-integrations-kafkajs 57.77% <ø> (-0.05%) ⬇️
apm-integrations-next 54.30% <ø> (-0.05%) ⬇️
apm-integrations-prisma 54.23% <ø> (-0.05%) ⬇️
apm-integrations-tedious 53.10% <ø> (-0.05%) ⬇️
appsec 69.06% <ø> (-0.10%) ⬇️
appsec-express_fastify_graphql 65.68% <ø> (-0.05%) ⬇️
appsec-integration 45.59% <ø> (ø)
appsec-kafka_ldapjs_lodash 59.16% <ø> (-0.04%) ⬇️
appsec-mongodb-core_mongoose_mysql 62.31% <ø> (-0.04%) ⬇️
appsec-next 52.90% <ø> (-0.04%) ⬇️
appsec-node-serialize_passport_postgres 61.95% <ø> (-0.04%) ⬇️
appsec-sourcing_stripe_template 60.30% <ø> (-0.04%) ⬇️
debugger 65.74% <ø> (ø)
instrumentations-bucket-0 48.81% <ø> (-0.05%) ⬇️
instrumentations-bucket-1 55.02% <ø> (-0.05%) ⬇️
instrumentations-bucket-10 56.68% <ø> (-0.05%) ⬇️
instrumentations-bucket-11 48.80% <ø> (-0.05%) ⬇️
instrumentations-bucket-12 48.90% <ø> (-0.05%) ⬇️
instrumentations-bucket-13 48.73% <ø> (-0.05%) ⬇️
instrumentations-bucket-2 49.79% <ø> (-0.05%) ⬇️
instrumentations-bucket-3 53.89% <ø> (-0.05%) ⬇️
instrumentations-bucket-4 49.22% <ø> (-0.05%) ⬇️
instrumentations-bucket-5 53.06% <ø> (-0.05%) ⬇️
instrumentations-bucket-6 55.67% <ø> (-0.05%) ⬇️
instrumentations-bucket-7 53.65% <ø> (-0.05%) ⬇️
instrumentations-bucket-8 54.69% <ø> (-0.05%) ⬇️
instrumentations-bucket-9 56.16% <ø> (-0.04%) ⬇️
instrumentations-instrumentation-couchbase 48.23% <ø> (-0.05%) ⬇️
instrumentations-integration-esbuild 33.97% <ø> (ø)
llmobs-ai_anthropic_bedrock 57.79% <ø> (-0.04%) ⬇️
llmobs-bucket-1 57.04% <ø> (-0.04%) ⬇️
llmobs-openai 57.63% <ø> (-0.04%) ⬇️
llmobs-sdk 60.03% <ø> (-0.05%) ⬇️
llmobs-vertex-ai 54.27% <ø> (-0.05%) ⬇️
master-coverage 96.56% <ø> (?)
openfeature 54.66% <ø> (+<0.01%) ⬆️
openfeature-unit 49.88% <ø> (-0.05%) ⬇️
platform-core_esbuild_instrumentations-misc 38.44% <ø> (-0.03%) ⬇️
platform-integration 62.24% <ø> (ø)
platform-shimmer_unit-guardrails_webpack 37.24% <ø> (-0.03%) ⬇️
plugins-bucket-0 53.23% <ø> (-0.05%) ⬇️
plugins-bucket-1 55.13% <ø> (ø)
plugins-bucket-11 55.63% <ø> (-0.05%) ⬇️
plugins-bucket-18 57.12% <ø> (-0.05%) ⬇️
plugins-bucket-19 55.42% <ø> (-0.05%) ⬇️
plugins-bucket-20 57.51% <ø> (-0.05%) ⬇️
plugins-bucket-4 53.91% <ø> (-0.05%) ⬇️
plugins-bullmq_cassandra_cookie 57.46% <ø> (-0.05%) ⬇️
plugins-cookie-parser_crypto_dd-trace-api 52.37% <ø> (-0.05%) ⬇️
plugins-fetch_fs_generic-pool 54.52% <ø> (-0.05%) ⬇️
plugins-google-cloud-pubsub_grpc_handlebars 59.93% <ø> (-0.05%) ⬇️
plugins-hapi_hono_ioredis 55.92% <ø> (-0.05%) ⬇️
plugins-jest_knex_langgraph 51.72% <ø> (-0.05%) ⬇️
plugins-ldapjs_light-my-request_limitd-client 53.47% <ø> (-0.08%) ⬇️
plugins-lodash_mariadb_memcached 54.27% <ø> (-0.05%) ⬇️
plugins-moleculer_mongodb_mongodb-core 57.35% <ø> (-0.05%) ⬇️
plugins-mongoose_multer_mysql 54.77% <ø> (-0.05%) ⬇️
plugins-mysql2_nats_node-serialize 56.27% <ø> (-0.05%) ⬇️
plugins-opensearch_passport-http_pino 55.12% <ø> (-0.05%) ⬇️
plugins-postgres_process_pug 54.35% <ø> (-0.05%) ⬇️
plugins-redis_router_sequelize 57.08% <ø> (-0.05%) ⬇️
plugins-test-and-upstream-rhea_undici_url 57.09% <ø> (-0.05%) ⬇️
plugins-valkey_vm_winston 53.90% <ø> (-0.05%) ⬇️
plugins-ws 54.86% <ø> (-0.05%) ⬇️
profiling 58.25% <ø> (-0.05%) ⬇️
serverless-aws-sdk-aws-sdk 50.71% <ø> (-0.04%) ⬇️
serverless-aws-sdk-bedrockruntime 50.73% <ø> (-0.05%) ⬇️
serverless-aws-sdk-client 52.01% <ø> (-0.05%) ⬇️
serverless-aws-sdk-dynamodb 51.80% <ø> (-0.05%) ⬇️
serverless-aws-sdk-eventbridge 46.27% <ø> (-0.05%) ⬇️
serverless-aws-sdk-kinesis 54.76% <ø> (-0.05%) ⬇️
serverless-aws-sdk-lambda 52.84% <ø> (-0.05%) ⬇️
serverless-aws-sdk-s3 51.58% <ø> (-0.05%) ⬇️
serverless-aws-sdk-serverless-peer-service 54.78% <ø> (-0.05%) ⬇️
serverless-aws-sdk-sns 55.53% <ø> (-0.05%) ⬇️
serverless-aws-sdk-sqs 55.96% <ø> (-0.10%) ⬇️
serverless-aws-sdk-stepfunctions 51.30% <ø> (-0.05%) ⬇️
serverless-aws-sdk-util 48.52% <ø> (-0.05%) ⬇️
serverless-bucket-0 55.28% <ø> (ø)
serverless-bucket-1 56.06% <ø> (-0.05%) ⬇️
test-optimization-cucumber 73.00% <ø> (+0.02%) ⬆️
test-optimization-cypress 66.46% <ø> (+0.10%) ⬆️
test-optimization-jest 73.91% <ø> (-0.03%) ⬇️
test-optimization-mocha 74.33% <ø> (+0.06%) ⬆️
test-optimization-playwright-playwright-atr 61.64% <ø> (+0.02%) ⬆️
test-optimization-playwright-playwright-efd 61.83% <ø> (+0.03%) ⬆️
test-optimization-playwright-playwright-final-status 61.78% <ø> (+0.02%) ⬆️
test-optimization-playwright-playwright-impacted-tests 61.50% <ø> (+0.19%) ⬆️
test-optimization-playwright-playwright-reporting 61.41% <ø> (+0.02%) ⬆️
test-optimization-playwright-playwright-test-management 62.32% <ø> (-0.03%) ⬇️
test-optimization-playwright-playwright-test-span 61.55% <ø> (-0.03%) ⬇️
test-optimization-selenium 60.72% <ø> (-0.14%) ⬇️
test-optimization-testopt 59.20% <ø> (+0.08%) ⬆️
test-optimization-vitest 72.58% <ø> (+0.06%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter

pr-commenter Bot commented Jul 2, 2026

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2026-07-09 14:41:09

Comparing candidate commit 70caa14 in PR branch crysmags/serverless-integrations-skill with baseline commit 7589a18 in branch master.

📊 Benchmarking dashboard

Found 0 performance improvements and 0 performance regressions! Performance is the same for 2313 metrics, 45 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Unstable benchmarks

These benchmarks have a confidence interval too wide to call a change; treat them as noise rather than signal.

scenario:appsec-appsec-enabled-24

  • unstable execution_time [-211.886ms; +196.313ms] or [-7.999%; +7.411%]

scenario:appsec-appsec-enabled-26

  • unstable execution_time [-230924.542µs; +231007.476µs] or [-9.063%; +9.066%]

scenario:appsec-appsec-enabled-with-attacks-24

  • unstable execution_time [-160.360ms; +155.304ms] or [-5.185%; +5.022%]

scenario:appsec-appsec-enabled-with-attacks-26

  • unstable execution_time [-169.017ms; +206.602ms] or [-5.866%; +7.171%]

scenario:appsec-control-20

  • unstable execution_time [-123.519ms; +120.759ms] or [-7.494%; +7.326%]

scenario:appsec-control-24

  • unstable execution_time [-103.253ms; +125.703ms] or [-8.400%; +10.226%]

scenario:appsec-control-26

  • unstable execution_time [-115.610ms; +146.661ms] or [-9.420%; +11.950%]

scenario:appsec-iast-no-vulnerability-iast-enabled-always-active-20

  • unstable execution_time [-10.647ms; +18.276ms] or [-4.071%; +6.988%]

scenario:appsec-iast-no-vulnerability-iast-enabled-default-config-20

  • unstable execution_time [-16.310ms; +13.000ms] or [-6.428%; +5.124%]

scenario:appsec-iast-with-vulnerability-iast-enabled-always-active-20

  • unstable execution_time [-31.545ms; +38.673ms] or [-5.666%; +6.947%]

scenario:child_process-shell-string-24

  • unstable execution_time [-19.780ms; +14.866ms] or [-6.128%; +4.606%]

scenario:debugger-line-probe-with-snapshot-default-24

  • unstable cpu_user_time [-2.510s; +0.343s] or [-28.214%; +3.860%]
  • unstable execution_time [-2.536s; +0.374s] or [-26.385%; +3.888%]
  • unstable instructions [-21.2G instructions; +2.8G instructions] or [-29.043%; +3.880%]
  • unstable throughput [-116.713op/s; +698.510op/s] or [-3.359%; +20.103%]

scenario:debugger-line-probe-with-snapshot-default-26

  • unstable cpu_user_time [-2133.925ms; +3291.481ms] or [-22.826%; +35.207%]
  • unstable execution_time [-2143.237ms; +3285.788ms] or [-21.291%; +32.641%]
  • unstable instructions [-18.9G instructions; +29.3G instructions] or [-24.284%; +37.599%]
  • unstable max_rss_usage [-6.804MB; +10.500MB] or [-4.286%; +6.614%]
  • unstable throughput [-716.403op/s; +481.210op/s] or [-21.965%; +14.754%]

scenario:debugger-line-probe-with-snapshot-minimal-26

  • unstable cpu_user_time [-2042.330ms; +3274.938ms] or [-21.770%; +34.909%]
  • unstable execution_time [-2051.189ms; +3278.108ms] or [-20.309%; +32.458%]
  • unstable instructions [-18.2G instructions; +29.4G instructions] or [-23.289%; +37.606%]
  • unstable max_rss_usage [-6.605MB; +10.019MB] or [-4.135%; +6.273%]
  • unstable throughput [-714.216op/s; +445.514op/s] or [-21.990%; +13.717%]

scenario:debugger-line-probe-without-snapshot-24

  • unstable cpu_user_time [-2123.551ms; +2397.904ms] or [-23.589%; +26.637%]
  • unstable execution_time [-2135.317ms; +2368.218ms] or [-21.939%; +24.332%]
  • unstable instructions [-17.8G instructions; +20.0G instructions] or [-24.268%; +27.230%]
  • unstable max_rss_usage [-9642.124KB; +9194.124KB] or [-6.073%; +5.790%]
  • unstable throughput [-685.959op/s; +545.809op/s] or [-20.060%; +15.961%]

scenario:debugger-line-probe-without-snapshot-26

  • unstable cpu_user_time [-2059.618ms; +3338.588ms] or [-21.987%; +35.640%]
  • unstable execution_time [-2068.900ms; +3353.283ms] or [-20.546%; +33.302%]
  • unstable instructions [-18.5G instructions; +29.5G instructions] or [-23.648%; +37.727%]
  • unstable max_rss_usage [-6.690MB; +10.802MB] or [-4.208%; +6.795%]
  • unstable throughput [-731.637op/s; +446.602op/s] or [-22.440%; +13.698%]

scenario:dogstatsd-with-tags-20

  • unstable cpu_user_time [-296.334ms; +448.034ms] or [-6.081%; +9.194%]
  • unstable execution_time [-296.755ms; +451.364ms] or [-5.992%; +9.114%]
  • unstable throughput [-154762.534op/s; +103689.659op/s] or [-9.118%; +6.109%]

scenario:plugin-claude-agent-sdk-compact-stream-scan-24

  • unstable cpu_usage_percentage [-4.074%; +6.155%]

scenario:plugin-claude-agent-sdk-compact-stream-scan-26

  • unstable cpu_usage_percentage [-6.164%; +5.234%]

scenario:plugin-graphql-long-with-depth-off-20

  • unstable max_rss_usage [-7655.727KB; +7275.727KB] or [-5.971%; +5.674%]

scenario:plugin-graphql-long-with-depth-on-max-20

  • unstable cpu_user_time [-742.148ms; +736.484ms] or [-5.786%; +5.742%]
  • unstable execution_time [-752.130ms; +734.984ms] or [-5.737%; +5.606%]
  • unstable throughput [-3.330op/s; +3.462op/s] or [-5.423%; +5.637%]

scenario:test-optimization-large-suite-20

  • unstable max_rss_usage [-5066.282KB; +3508.616KB] or [-6.379%; +4.418%]

ojproductions
ojproductions previously approved these changes Jul 2, 2026

@ojproductions ojproductions left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs look thorough, though I'm new to probes. Might also want to get some input from @rithikanarayan and @joeyzhao2018 in case I missed anything.

@@ -0,0 +1,57 @@
# Deployed Serverless Probe

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

concept of a probe is new to me. Is this a dd-trace-js thing? or is it specific for this skill? Sounds to me like its a way to deploy real apps for testing. If that's the case would it make more sense for this to be under the testing-guide skill?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ojproductions good point. Moved the deployed verification guidance under references/testing-guide.md and added a short definition there: a probe is a temporary deployed sample function/app for provider + Datadog ingestion checks, not a dd-trace-js runtime feature.

rithikanarayan
rithikanarayan previously approved these changes Jul 6, 2026
- add span links when multiple upstream contexts are present;
- tag trigger type, resource, region/account/project identifiers, and runtime metadata with existing tag naming
patterns where possible;
- avoid high-cardinality resource names unless existing serverless integrations already use that shape.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there an example of a high cardinality resource name that should be reused/replicated? because I think "avoid high cardinality resource names" by itself would be ok

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rithikanarayan yea, agreed. Removed the "unless existing integrations" caveat and made this a direct low-cardinality rule, with examples of values that should never land in resource names: request IDs, message IDs, object keys, event IDs, and payload values.

@crysmags
crysmags dismissed stale reviews from rithikanarayan and ojproductions via 3bf216e July 8, 2026 15:10
@crysmags
crysmags force-pushed the crysmags/serverless-integrations-skill branch from 3bf216e to 7214826 Compare July 8, 2026 18:56
@crysmags
crysmags force-pushed the crysmags/serverless-integrations-skill branch from 7214826 to 70c9ffd Compare July 8, 2026 19:04

@rithikanarayan rithikanarayan left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updates looks good to me

@crysmags
crysmags merged commit da45431 into master Jul 9, 2026
655 checks passed
@crysmags
crysmags deleted the crysmags/serverless-integrations-skill branch July 9, 2026 20:52
@dd-octo-sts dd-octo-sts Bot mentioned this pull request Jul 10, 2026
@dd-octo-sts dd-octo-sts Bot mentioned this pull request Jul 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants