Skip to content

bench(integrations): tune dns/graphql/http/net/aws-sdk/propagation; drop bluebird and q#8734

Merged
BridgeAR merged 1 commit into
masterfrom
BridgeAR/2026-05-31-bench-integrations
Jun 3, 2026
Merged

bench(integrations): tune dns/graphql/http/net/aws-sdk/propagation; drop bluebird and q#8734
BridgeAR merged 1 commit into
masterfrom
BridgeAR/2026-05-31-bench-integrations

Conversation

@BridgeAR

Copy link
Copy Markdown
Member

Summary

Tunes the dns, graphql-long, http, net, aws-sdk, and propagation benches (loop counts, HTTP keep-alive, env-driven iterations), and removes the bluebird and q benches -- redundant userland-promise hops that don't catch tracer regressions.

Test plan

  • The microbenchmark shard(s) containing these benches run green.

@dd-octo-sts

dd-octo-sts Bot commented May 31, 2026

Copy link
Copy Markdown
Contributor

Overall package size

Self size: 6.09 MB
Deduped: 7.13 MB
No deduping: 7.13 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 3.0.1 | 82.56 kB | 817.39 kB | | opentracing | 0.14.7 | 194.81 kB | 194.81 kB | | dc-polyfill | 0.1.11 | 25.74 kB | 25.74 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@datadog-prod-us1-4

datadog-prod-us1-4 Bot commented May 31, 2026

Copy link
Copy Markdown

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 86.50% (-0.00%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 35b66fc | Docs | Datadog PR Page | Give us feedback!

@BridgeAR
BridgeAR force-pushed the BridgeAR/2026-05-31-bench-integrations branch from 71d6519 to f0066f4 Compare May 31, 2026 19:21
@codecov

codecov Bot commented May 31, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 93.28%. Comparing base (92e814b) to head (35b66fc).
⚠️ Report is 7 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff             @@
##           master    #8734       +/-   ##
===========================================
+ Coverage   35.66%   93.28%   +57.62%     
===========================================
  Files         263      862      +599     
  Lines       14799    49320    +34521     
  Branches        0     9329     +9329     
===========================================
+ Hits         5278    46009    +40731     
+ Misses       9521     3311     -6210     
Flag Coverage Δ
aiguard-integration-active 41.33% <ø> (?)
aiguard-integration-latest 41.35% <ø> (?)
aiguard-integration-maintenance 41.38% <ø> (?)
aiguard-macos 33.37% <ø> (-0.09%) ⬇️
aiguard-ubuntu 33.45% <ø> (?)
aiguard-windows 33.18% <ø> (?)
apm-capabilities-tracing-macos 48.51% <ø> (?)
apm-capabilities-tracing-ubuntu-active 48.55% <ø> (?)
apm-capabilities-tracing-ubuntu-latest 48.55% <ø> (?)
apm-capabilities-tracing-ubuntu-maintenance 48.57% <ø> (?)
apm-capabilities-tracing-ubuntu-oldest 48.57% <ø> (?)
apm-capabilities-tracing-windows 48.53% <ø> (?)
apm-integrations-aerospike-18-gte.5.2.0 33.22% <ø> (?)
apm-integrations-aerospike-20-gte.5.5.0 33.24% <ø> (?)
apm-integrations-aerospike-22-gte.5.12.1 33.25% <ø> (?)
apm-integrations-aerospike-22-gte.6.0.0 33.25% <ø> (?)
apm-integrations-aerospike-eol- 33.15% <ø> (?)
apm-integrations-child-process 34.16% <ø> (?)
apm-integrations-confluentinc-kafka-javascript-18 40.27% <ø> (?)
apm-integrations-confluentinc-kafka-javascript-20 40.29% <ø> (?)
apm-integrations-confluentinc-kafka-javascript-22 40.29% <ø> (?)
apm-integrations-confluentinc-kafka-javascript-24 40.24% <ø> (?)
apm-integrations-couchbase-18 33.41% <ø> (?)
apm-integrations-couchbase-eol 33.57% <ø> (?)
apm-integrations-dns 33.16% <ø> (?)
apm-integrations-elasticsearch 34.27% <ø> (?)
apm-integrations-http-latest 41.46% <ø> (?)
apm-integrations-http-maintenance 41.51% <ø> (?)
apm-integrations-http-oldest 41.43% <ø> (?)
apm-integrations-http2 38.71% <ø> (?)
apm-integrations-kafkajs-latest 40.44% <ø> (?)
apm-integrations-kafkajs-oldest 40.37% <ø> (?)
apm-integrations-net 33.86% <ø> (?)
apm-integrations-next-11.1.4 36.54% <ø> (?)
apm-integrations-next-12.3.7 36.54% <ø> (?)
apm-integrations-next-13.0.0 29.25% <ø> (?)
apm-integrations-next-13.2.0 29.21% <ø> (?)
apm-integrations-next-13.5.11 29.36% <ø> (?)
apm-integrations-next-14.0.0 29.28% <ø> (?)
apm-integrations-next-14.2.35 29.29% <ø> (?)
apm-integrations-next-14.2.6 29.28% <ø> (?)
apm-integrations-next-14.2.7 29.28% <ø> (?)
apm-integrations-next-15.0.0 29.28% <ø> (?)
apm-integrations-next-15.4.0 29.36% <ø> (?)
apm-integrations-oracledb 34.10% <ø> (?)
apm-integrations-prisma-18-gte.6.16.0.and.lt.7.0.0 34.60% <ø> (?)
apm-integrations-prisma-latest-all 34.36% <ø> (?)
apm-integrations-restify 35.28% <ø> (?)
apm-integrations-sharedb 32.63% <ø> (?)
apm-integrations-tedious 33.56% <ø> (?)
appsec-express 51.34% <ø> (?)
appsec-fastify 48.06% <ø> (?)
appsec-graphql 48.04% <ø> (?)
appsec-integration-active 36.15% <ø> (?)
appsec-integration-latest 36.15% <ø> (?)
appsec-integration-maintenance 36.19% <ø> (?)
appsec-integration-oldest 36.18% <ø> (?)
appsec-kafka 40.53% <ø> (?)
appsec-ldapjs 39.90% <ø> (?)
appsec-lodash 39.92% <ø> (?)
appsec-macos 57.35% <ø> (?)
appsec-mongodb-core 44.16% <ø> (?)
appsec-mongoose 45.01% <ø> (?)
appsec-mysql 47.24% <ø> (?)
appsec-next-latest-11.1.4 27.47% <ø> (?)
appsec-next-latest-12.3.7 27.60% <ø> (-0.03%) ⬇️
appsec-next-latest-13.0.0 29.27% <ø> (?)
appsec-next-latest-13.2.0 29.30% <ø> (?)
appsec-next-latest-13.5.11 29.40% <ø> (?)
appsec-next-latest-14.0.0 29.32% <ø> (?)
appsec-next-latest-14.2.35 29.32% <ø> (?)
appsec-next-latest-14.2.6 29.32% <ø> (?)
appsec-next-latest-14.2.7 29.32% <ø> (?)
appsec-next-latest-15.0.0 29.32% <ø> (?)
appsec-next-latest-latest 29.33% <ø> (?)
appsec-next-oldest-11.1.4 27.47% <ø> (?)
appsec-next-oldest-12.3.7 29.27% <ø> (?)
appsec-next-oldest-13.0.0 29.27% <ø> (?)
appsec-next-oldest-13.2.0 29.54% <ø> (?)
appsec-next-oldest-13.5.11 29.65% <ø> (?)
appsec-next-oldest-14.0.0 29.58% <ø> (?)
appsec-next-oldest-14.2.35 29.58% <ø> (?)
appsec-next-oldest-14.2.6 29.58% <ø> (?)
appsec-next-oldest-14.2.7 29.58% <ø> (?)
appsec-next-oldest-15.0.0 29.58% <ø> (?)
appsec-next-oldest-latest 27.71% <ø> (?)
appsec-node-serialize 39.22% <ø> (?)
appsec-passport 42.85% <ø> (?)
appsec-postgres 46.97% <ø> (?)
appsec-sourcing 38.64% <ø> (?)
appsec-stripe 40.59% <ø> (?)
appsec-template 39.46% <ø> (?)
appsec-ubuntu 57.41% <ø> (?)
appsec-windows 57.19% <ø> (?)
debugger-ubuntu-active 43.84% <ø> (?)
debugger-ubuntu-latest 43.84% <ø> (?)
debugger-ubuntu-maintenance 43.92% <ø> (?)
debugger-ubuntu-oldest 44.23% <ø> (?)
instrumentations-instrumentation-ai 42.23% <ø> (?)
instrumentations-instrumentation-aws-sdk 44.55% <ø> (?)
instrumentations-instrumentation-bluebird 27.59% <ø> (?)
instrumentations-instrumentation-body-parser 35.79% <ø> (?)
instrumentations-instrumentation-child_process 33.53% <ø> (?)
instrumentations-instrumentation-cookie-parser 29.52% <ø> (?)
instrumentations-instrumentation-couchbase-18 45.67% <ø> (?)
instrumentations-instrumentation-couchbase-eol 45.67% <ø> (?)
instrumentations-instrumentation-crypto 27.67% <ø> (?)
instrumentations-instrumentation-express 29.71% <ø> (?)
instrumentations-instrumentation-express-mongo-sanitize 29.63% <ø> (?)
instrumentations-instrumentation-express-multi-version 41.31% <ø> (?)
instrumentations-instrumentation-express-session 35.56% <ø> (?)
instrumentations-instrumentation-fastify 46.31% <ø> (?)
instrumentations-instrumentation-fetch 44.71% <ø> (?)
instrumentations-instrumentation-fs 27.31% <ø> (?)
instrumentations-instrumentation-generic-pool 27.13% <ø> (?)
instrumentations-instrumentation-hono 28.82% <ø> (?)
instrumentations-instrumentation-http 35.22% <ø> (?)
instrumentations-instrumentation-http-client-options 37.73% <ø> (?)
instrumentations-instrumentation-kafkajs 48.66% <ø> (?)
instrumentations-instrumentation-knex 27.58% <ø> (?)
instrumentations-instrumentation-light-my-request 35.42% <ø> (?)
instrumentations-instrumentation-mongoose 28.70% <ø> (?)
instrumentations-instrumentation-multer 35.46% <ø> (?)
instrumentations-instrumentation-mysql2 33.50% <ø> (?)
instrumentations-instrumentation-openai-aiguard 47.26% <ø> (?)
instrumentations-instrumentation-otel-sdk-trace 25.24% <ø> (?)
instrumentations-instrumentation-passport 39.30% <ø> (?)
instrumentations-instrumentation-passport-http 38.99% <ø> (?)
instrumentations-instrumentation-passport-local 39.46% <ø> (?)
instrumentations-instrumentation-pg 33.22% <ø> (?)
instrumentations-instrumentation-promise 27.54% <ø> (?)
instrumentations-instrumentation-promise-js 27.54% <ø> (?)
instrumentations-instrumentation-q 27.57% <ø> (?)
instrumentations-instrumentation-router 42.81% <ø> (?)
instrumentations-instrumentation-stripe 28.08% <ø> (?)
instrumentations-instrumentation-url 27.50% <ø> (?)
instrumentations-instrumentation-when 27.55% <ø> (?)
instrumentations-instrumentation-zlib 27.55% <ø> (?)
instrumentations-integration-esbuild-0.16.12-active 18.45% <ø> (?)
instrumentations-integration-esbuild-0.16.12-latest 18.45% <ø> (?)
instrumentations-integration-esbuild-0.16.12-maintenance 18.46% <ø> (?)
instrumentations-integration-esbuild-0.16.12-oldest 18.45% <ø> (?)
instrumentations-integration-esbuild-latest-active 18.45% <ø> (?)
instrumentations-integration-esbuild-latest-latest 18.45% <ø> (?)
instrumentations-integration-esbuild-latest-oldest 18.45% <ø> (?)
llmobs-ai 34.98% <ø> (?)
llmobs-anthropic 36.71% <ø> (?)
llmobs-bedrock 36.17% <ø> (?)
llmobs-google-genai 35.76% <ø> (?)
llmobs-langchain 34.61% <ø> (?)
llmobs-openai-latest 39.20% <ø> (?)
llmobs-openai-oldest 39.23% <ø> (?)
llmobs-sdk-active 43.58% <ø> (?)
llmobs-sdk-latest 43.58% <ø> (?)
llmobs-sdk-maintenance 43.62% <ø> (?)
llmobs-sdk-oldest 43.61% <ø> (?)
llmobs-vertex-ai 35.75% <ø> (?)
master-coverage 93.28% <ø> (?)
openfeature-macos 37.68% <ø> (?)
openfeature-ubuntu 37.75% <ø> (?)
openfeature-unit-active 50.48% <ø> (-0.09%) ⬇️
openfeature-unit-latest 50.48% <ø> (?)
openfeature-unit-maintenance 50.60% <ø> (-0.09%) ⬇️
openfeature-unit-oldest 50.60% <ø> (-0.09%) ⬇️
openfeature-windows 37.50% <ø> (?)
platform-core 45.68% <ø> (+13.83%) ⬆️
platform-esbuild 46.59% <ø> (?)
platform-instrumentations-misc 30.58% <ø> (?)
platform-integration-latest 46.93% <ø> (?)
platform-integration-maintenance 46.95% <ø> (?)
platform-integration-oldest 47.16% <ø> (?)
platform-shimmer 47.03% <ø> (+7.14%) ⬆️
platform-unit-guardrails 44.45% <ø> (+11.98%) ⬆️
platform-webpack 17.98% <ø> (?)
plugins-axios 35.56% <ø> (?)
plugins-azure-cosmos 36.00% <ø> (?)
plugins-azure-event-hubs 34.85% <ø> (?)
plugins-azure-service-bus 35.34% <ø> (?)
plugins-body-parser 36.54% <ø> (?)
plugins-bullmq 39.06% <ø> (?)
plugins-cassandra 33.71% <ø> (?)
plugins-cookie 40.21% <ø> (?)
plugins-cookie-parser 40.04% <ø> (?)
plugins-crypto 42.28% <ø> (?)
plugins-dd-trace-api 33.40% <ø> (?)
plugins-express-mongo-sanitize 40.12% <ø> (?)
plugins-express-session 39.98% <ø> (?)
plugins-fastify 37.85% <ø> (?)
plugins-fetch 34.15% <ø> (?)
plugins-fs 33.79% <ø> (?)
plugins-generic-pool 39.52% <ø> (?)
plugins-google-cloud-pubsub 41.55% <ø> (?)
plugins-grpc 36.64% <ø> (?)
plugins-handlebars 40.09% <ø> (?)
plugins-hapi 35.67% <ø> (?)
plugins-hono 36.02% <ø> (?)
plugins-ioredis 34.25% <ø> (?)
plugins-jest 27.07% <ø> (?)
plugins-knex 39.57% <ø> (?)
plugins-langgraph 32.40% <ø> (?)
plugins-ldapjs 38.53% <ø> (?)
plugins-light-my-request 39.66% <ø> (?)
plugins-limitd-client 27.90% <ø> (?)
plugins-lodash 39.70% <ø> (?)
plugins-mariadb 35.22% <ø> (?)
plugins-memcached 33.77% <ø> (?)
plugins-microgateway-core 34.77% <ø> (?)
plugins-modelcontextprotocol-sdk 32.36% <ø> (?)
plugins-moleculer 36.70% <ø> (?)
plugins-mongodb-core 35.51% <ø> (?)
plugins-mongoose 34.42% <ø> (?)
plugins-multer 40.01% <ø> (?)
plugins-mysql 34.70% <ø> (?)
plugins-mysql2 34.97% <ø> (?)
plugins-nats 36.43% <ø> (?)
plugins-node-serialize 40.24% <ø> (?)
plugins-opensearch 33.65% <ø> (?)
plugins-passport-http 39.83% <ø> (?)
plugins-pino 29.81% <ø> (?)
plugins-postgres 34.53% <ø> (?)
plugins-process 42.28% <ø> (?)
plugins-pug 40.21% <ø> (?)
plugins-redis 34.30% <ø> (?)
plugins-router 38.28% <ø> (?)
plugins-sequelize 39.48% <ø> (?)
plugins-test-and-upstream-amqp10 33.91% <ø> (?)
plugins-test-and-upstream-amqplib 39.31% <ø> (?)
plugins-test-and-upstream-apollo 34.88% <ø> (?)
plugins-test-and-upstream-avsc 33.80% <ø> (?)
plugins-test-and-upstream-bunyan 29.02% <ø> (?)
plugins-test-and-upstream-connect 36.32% <ø> (?)
plugins-test-and-upstream-graphql 36.10% <ø> (?)
plugins-test-and-upstream-koa 35.85% <ø> (?)
plugins-test-and-upstream-protobufjs 34.04% <ø> (?)
plugins-test-and-upstream-rhea 39.27% <ø> (?)
plugins-undici 34.65% <ø> (?)
plugins-url 42.28% <ø> (?)
plugins-valkey 33.87% <ø> (?)
plugins-vm 42.28% <ø> (?)
plugins-winston 29.69% <ø> (?)
plugins-ws 37.16% <ø> (?)
profiling-macos 43.31% <ø> (?)
profiling-ubuntu 43.70% <ø> (?)
profiling-windows 41.06% <ø> (?)
serverless-aws-sdk-latest-aws-sdk 33.31% <ø> (?)
serverless-aws-sdk-latest-bedrockruntime 31.92% <ø> (?)
serverless-aws-sdk-latest-client 36.30% <ø> (?)
serverless-aws-sdk-latest-dynamodb 34.06% <ø> (?)
serverless-aws-sdk-latest-eventbridge 27.10% <ø> (?)
serverless-aws-sdk-latest-kinesis 37.24% <ø> (?)
serverless-aws-sdk-latest-lambda 34.60% <ø> (?)
serverless-aws-sdk-latest-s3 32.46% <ø> (?)
serverless-aws-sdk-latest-serverless-peer-service 39.52% <ø> (?)
serverless-aws-sdk-latest-sns 38.37% <ø> (?)
serverless-aws-sdk-latest-sqs 37.86% <ø> (?)
serverless-aws-sdk-latest-stepfunctions 33.16% <ø> (?)
serverless-aws-sdk-latest-util 46.85% <ø> (?)
serverless-aws-sdk-oldest-aws-sdk 33.38% <ø> (?)
serverless-aws-sdk-oldest-bedrockruntime 32.18% <ø> (?)
serverless-aws-sdk-oldest-client 36.49% <ø> (?)
serverless-aws-sdk-oldest-dynamodb 34.16% <ø> (?)
serverless-aws-sdk-oldest-eventbridge 27.14% <ø> (?)
serverless-aws-sdk-oldest-kinesis 37.36% <ø> (?)
serverless-aws-sdk-oldest-lambda 34.65% <ø> (?)
serverless-aws-sdk-oldest-s3 32.55% <ø> (?)
serverless-aws-sdk-oldest-serverless-peer-service 39.55% <ø> (?)
serverless-aws-sdk-oldest-sns 38.42% <ø> (?)
serverless-aws-sdk-oldest-sqs 37.70% <ø> (?)
serverless-aws-sdk-oldest-stepfunctions 33.22% <ø> (?)
serverless-aws-sdk-oldest-util 47.10% <ø> (?)
serverless-azure-durable-functions 36.85% <ø> (?)
serverless-azure-functions-eventhubs 38.47% <ø> (?)
serverless-azure-functions-servicebus 38.52% <ø> (?)
serverless-lambda 34.59% <ø> (?)
test-optimization-cucumber-latest-latest 52.89% <ø> (?)
test-optimization-cucumber-oldest-7.0.0 50.26% <ø> (?)
test-optimization-cypress-latest-12.0.0-commonJS 49.61% <ø> (?)
test-optimization-cypress-latest-12.0.0-esm 49.64% <ø> (?)
test-optimization-cypress-latest-14.5.4-commonJS 49.46% <ø> (?)
test-optimization-cypress-latest-14.5.4-esm 49.30% <ø> (?)
test-optimization-cypress-latest-latest-commonJS 46.41% <ø> (?)
test-optimization-cypress-latest-latest-esm 49.62% <ø> (?)
test-optimization-cypress-oldest-12.0.0-commonJS 49.65% <ø> (?)
test-optimization-cypress-oldest-12.0.0-esm 49.68% <ø> (?)
test-optimization-cypress-oldest-14.5.4-commonJS 49.50% <ø> (?)
test-optimization-cypress-oldest-14.5.4-esm 49.53% <ø> (?)
test-optimization-jest-latest-latest 55.56% <ø> (?)
test-optimization-jest-latest-oldest 54.47% <ø> (?)
test-optimization-jest-oldest-latest 54.92% <ø> (?)
test-optimization-jest-oldest-oldest 53.79% <ø> (?)
test-optimization-mocha-latest-oldest 51.43% <ø> (?)
test-optimization-mocha-oldest-latest 53.81% <ø> (?)
test-optimization-playwright-latest-latest-playwright-active-test-span 44.49% <ø> (?)
test-optimization-playwright-latest-latest-playwright-atr 43.15% <ø> (?)
test-optimization-playwright-latest-latest-playwright-efd 43.56% <ø> (?)
test-optimization-playwright-latest-latest-playwright-final-status 43.62% <ø> (?)
test-optimization-playwright-latest-latest-playwright-impacted-tests 43.08% <ø> (?)
test-optimization-playwright-latest-latest-playwright-reporting 43.17% <ø> (?)
test-optimization-playwright-latest-latest-playwright-test-management 44.77% <ø> (?)
test-optimization-playwright-latest-oldest-playwright-active-test-span 44.29% <ø> (?)
test-optimization-playwright-latest-oldest-playwright-atr 43.22% <ø> (?)
test-optimization-playwright-latest-oldest-playwright-final-status 43.52% <ø> (?)
test-optimization-playwright-latest-oldest-playwright-impacted-tests 43.00% <ø> (?)
test-optimization-playwright-latest-oldest-playwright-reporting 42.98% <ø> (?)
test-optimization-playwright-latest-oldest-playwright-test-management 44.71% <ø> (?)
test-optimization-playwright-oldest-latest-playwright-active-test-span 44.52% <ø> (?)
test-optimization-playwright-oldest-latest-playwright-efd 43.56% <ø> (?)
test-optimization-playwright-oldest-latest-playwright-final-status 43.65% <ø> (?)
test-optimization-playwright-oldest-latest-playwright-impacted-tests 43.11% <ø> (?)
test-optimization-playwright-oldest-latest-playwright-reporting 43.20% <ø> (?)
test-optimization-playwright-oldest-latest-playwright-test-management 44.80% <ø> (?)
test-optimization-playwright-oldest-oldest-playwright-active-test-span 44.33% <ø> (?)
test-optimization-playwright-oldest-oldest-playwright-atr 43.26% <ø> (?)
test-optimization-playwright-oldest-oldest-playwright-final-status 43.56% <ø> (?)
test-optimization-playwright-oldest-oldest-playwright-impacted-tests 43.03% <ø> (?)
test-optimization-playwright-oldest-oldest-playwright-reporting 43.01% <ø> (?)
test-optimization-playwright-oldest-oldest-playwright-test-management 44.75% <ø> (?)
test-optimization-selenium-latest 45.43% <ø> (?)
test-optimization-selenium-oldest 44.99% <ø> (?)
test-optimization-testopt-active 48.56% <ø> (?)
test-optimization-testopt-latest 48.56% <ø> (?)
test-optimization-testopt-maintenance 48.54% <ø> (?)
test-optimization-testopt-oldest 49.64% <ø> (?)
test-optimization-vitest-latest 51.00% <ø> (?)
test-optimization-vitest-oldest 48.14% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter

pr-commenter Bot commented May 31, 2026

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2026-06-03 16:31:04

Comparing candidate commit 35b66fc in PR branch BridgeAR/2026-05-31-bench-integrations with baseline commit 92e814b in branch master.

Found 16 performance improvements and 69 performance regressions! Performance is the same for 1334 metrics, 48 unstable metrics.

scenario:net-with-tracer-20

  • 🟥 cpu_user_time [+329.356ms; +337.228ms] or [+106.177%; +108.714%]
  • 🟥 execution_time [+642.529ms; +671.596ms] or [+140.616%; +146.977%]
  • 🟥 instructions [+546.6M instructions; +551.6M instructions] or [+52.188%; +52.661%]
  • 🟥 max_rss_usage [+11.160MB; +11.537MB] or [+15.363%; +15.882%]
  • 🟩 cpu_usage_percentage [-7.752%; -6.171%]

scenario:net-with-tracer-22

  • 🟥 cpu_user_time [+283.332ms; +292.257ms] or [+98.614%; +101.720%]
  • 🟥 execution_time [+572.417ms; +584.964ms] or [+130.999%; +133.870%]
  • 🟥 instructions [+535.8M instructions; +541.3M instructions] or [+51.817%; +52.352%]
  • 🟥 max_rss_usage [+8.982MB; +9.392MB] or [+11.093%; +11.599%]
  • 🟩 cpu_usage_percentage [-7.114%; -6.382%]

scenario:net-with-tracer-24

  • 🟥 cpu_user_time [+221.148ms; +228.714ms] or [+72.836%; +75.328%]
  • 🟥 execution_time [+489.848ms; +494.379ms] or [+106.898%; +107.887%]
  • 🟥 instructions [+451.8M instructions; +460.5M instructions] or [+47.349%; +48.268%]
  • 🟥 max_rss_usage [+11.500MB; +12.437MB] or [+13.647%; +14.759%]
  • 🟩 cpu_usage_percentage [-5.491%; -5.302%]

scenario:plugin-aws-sdk-extract-response-body-20

  • 🟥 instructions [+17.1G instructions; +17.4G instructions] or [+284.669%; +288.927%]

scenario:plugin-aws-sdk-extract-response-body-22

  • 🟥 instructions [+15.0G instructions; +15.3G instructions] or [+280.734%; +285.440%]

scenario:plugin-aws-sdk-extract-response-body-24

  • 🟥 instructions [+14.9G instructions; +15.3G instructions] or [+278.315%; +286.703%]

scenario:plugin-dns-with-tracer-20

  • 🟥 cpu_user_time [+499.698ms; +532.959ms] or [+131.606%; +140.366%]
  • 🟥 instructions [+1.3G instructions; +1.3G instructions] or [+110.960%; +114.892%]
  • 🟥 max_rss_usage [+15.340MB; +16.775MB] or [+19.694%; +21.536%]
  • 🟩 cpu_usage_percentage [-15.888%; -15.673%]

scenario:plugin-dns-with-tracer-22

  • 🟥 cpu_user_time [+501.093ms; +525.076ms] or [+155.943%; +163.406%]
  • 🟥 instructions [+1.3G instructions; +1.3G instructions] or [+110.478%; +114.636%]
  • 🟥 max_rss_usage [+18.605MB; +19.051MB] or [+21.676%; +22.195%]
  • 🟩 cpu_usage_percentage [-13.719%; -13.543%]

scenario:plugin-dns-with-tracer-24

  • 🟥 cpu_user_time [+428.130ms; +459.159ms] or [+133.955%; +143.663%]
  • 🟥 instructions [+1.3G instructions; +1.4G instructions] or [+130.795%; +138.161%]
  • 🟥 max_rss_usage [+20.955MB; +21.946MB] or [+22.256%; +23.309%]
  • 🟩 cpu_usage_percentage [-14.032%; -13.761%]

scenario:plugin-graphql-long-with-depth-and-collapse-off-20

  • 🟥 cpu_user_time [+1.890s; +2.110s] or [+32.867%; +36.701%]
  • 🟥 execution_time [+1.776s; +2.001s] or [+28.129%; +31.679%]
  • 🟥 instructions [+19.0G instructions; +19.3G instructions] or [+101.148%; +103.123%]
  • 🟩 max_rss_usage [-494.523MB; -484.955MB] or [-50.378%; -49.403%]

scenario:plugin-graphql-long-with-depth-and-collapse-off-22

  • 🟥 cpu_user_time [+1.544s; +1.792s] or [+28.411%; +32.976%]
  • 🟥 execution_time [+1.347s; +1.606s] or [+22.347%; +26.629%]
  • 🟥 instructions [+16.6G instructions; +17.1G instructions] or [+91.415%; +93.939%]
  • 🟩 max_rss_usage [-465.575MB; -453.849MB] or [-46.657%; -45.482%]

scenario:plugin-graphql-long-with-depth-and-collapse-off-24

  • 🟥 instructions [+12.7G instructions; +13.9G instructions] or [+94.027%; +102.654%]
  • 🟩 max_rss_usage [-347.563MB; -293.543MB] or [-37.836%; -31.955%]

scenario:plugin-graphql-long-with-depth-off-20

  • 🟥 instructions [+53.5G instructions; +54.0G instructions] or [+664.667%; +670.010%]
  • 🟩 max_rss_usage [-469.058MB; -454.523MB] or [-77.619%; -75.214%]

scenario:plugin-graphql-long-with-depth-off-22

  • 🟥 instructions [+52.3G instructions; +52.7G instructions] or [+678.683%; +684.252%]
  • 🟩 max_rss_usage [-474.188MB; -458.804MB] or [-77.057%; -74.557%]

scenario:plugin-graphql-long-with-depth-off-24

  • 🟥 cpu_user_time [+3.529s; +3.603s] or [+195.196%; +199.256%]
  • 🟥 execution_time [+3.402s; +3.475s] or [+161.631%; +165.125%]
  • 🟥 instructions [+23.3G instructions; +23.7G instructions] or [+477.947%; +486.735%]
  • 🟩 max_rss_usage [-318.009MB; -315.005MB] or [-60.469%; -59.898%]

scenario:plugin-graphql-long-with-depth-on-max-20

  • 🟥 instructions [+46.5G instructions; +47.3G instructions] or [+470.014%; +477.311%]
  • 🟩 max_rss_usage [-535.461MB; -518.778MB] or [-76.445%; -74.063%]

scenario:plugin-graphql-long-with-depth-on-max-22

  • 🟥 instructions [+44.3G instructions; +44.8G instructions] or [+423.924%; +429.132%]
  • 🟩 max_rss_usage [-520.193MB; -514.512MB] or [-72.868%; -72.072%]

scenario:plugin-graphql-long-with-depth-on-max-24

  • 🟥 instructions [+21.2G instructions; +21.6G instructions] or [+321.453%; +327.599%]
  • 🟩 max_rss_usage [-389.911MB; -385.706MB] or [-64.443%; -63.748%]

scenario:plugin-http-client-with-tracer-20

  • 🟥 cpu_user_time [+2.290s; +2.320s] or [+435.413%; +441.183%]
  • 🟥 execution_time [+3.375s; +3.412s] or [+459.186%; +464.246%]
  • 🟥 instructions [+4.8G instructions; +4.9G instructions] or [+361.361%; +363.300%]
  • 🟥 max_rss_usage [+60.731MB; +63.087MB] or [+75.417%; +78.343%]

scenario:plugin-http-client-with-tracer-22

  • 🟥 cpu_user_time [+2.178s; +2.219s] or [+450.294%; +458.820%]
  • 🟥 execution_time [+3.381s; +3.421s] or [+479.650%; +485.260%]
  • 🟥 instructions [+4.5G instructions; +4.6G instructions] or [+338.330%; +342.797%]
  • 🟥 max_rss_usage [+62.938MB; +69.857MB] or [+69.793%; +77.466%]
  • 🟩 cpu_usage_percentage [-5.436%; -5.060%]

scenario:plugin-http-client-with-tracer-24

  • 🟥 cpu_user_time [+1.549s; +1.580s] or [+344.114%; +351.050%]
  • 🟥 execution_time [+2.523s; +2.554s] or [+385.442%; +390.155%]
  • 🟥 instructions [+4.5G instructions; +4.5G instructions] or [+370.824%; +372.661%]
  • 🟥 max_rss_usage [+140.618MB; +142.489MB] or [+152.116%; +154.141%]

scenario:plugin-http-server-querystring-obfuscation-20

  • 🟥 cpu_user_time [+1.203s; +1.216s] or [+630.664%; +637.822%]
  • 🟥 execution_time [+4.918s; +4.982s] or [+689.089%; +698.104%]
  • 🟥 instructions [+4.3G instructions; +4.3G instructions] or [+915.465%; +917.227%]

scenario:plugin-http-server-querystring-obfuscation-22

  • 🟥 cpu_user_time [+1.269s; +1.288s] or [+664.798%; +674.518%]
  • 🟥 execution_time [+4.757s; +4.821s] or [+674.765%; +683.795%]
  • 🟥 instructions [+4.5G instructions; +4.5G instructions] or [+926.463%; +928.533%]

scenario:plugin-http-server-querystring-obfuscation-24

  • 🟥 execution_time [+4.140s; +4.189s] or [+626.906%; +634.426%]
  • 🟥 instructions [+4.7G instructions; +4.7G instructions] or [+1037.826%; +1040.253%]
  • 🟥 max_rss_usage [+6.642MB; +7.434MB] or [+10.963%; +12.271%]

scenario:plugin-http-server-with-tracer-20

  • 🟥 execution_time [+4.122s; +4.156s] or [+596.026%; +601.051%]
  • 🟥 instructions [+3.8G instructions; +3.8G instructions] or [+850.937%; +852.961%]

scenario:plugin-http-server-with-tracer-22

  • 🟥 cpu_usage_percentage [+5.520%; +5.828%]
  • 🟥 execution_time [+3.905s; +3.957s] or [+571.499%; +579.100%]
  • 🟥 instructions [+4.0G instructions; +4.0G instructions] or [+864.452%; +866.762%]

scenario:plugin-http-server-with-tracer-24

  • 🟥 cpu_usage_percentage [+8.368%; +8.658%]
  • 🟥 execution_time [+3.399s; +3.426s] or [+538.279%; +542.486%]
  • 🟥 instructions [+4.2G instructions; +4.2G instructions] or [+992.348%; +994.721%]
  • 🟥 max_rss_usage [+8.008MB; +8.635MB] or [+13.604%; +14.670%]

@BridgeAR
BridgeAR force-pushed the BridgeAR/2026-05-31-bench-integrations branch from f0066f4 to f5e0be3 Compare June 1, 2026 11:41
@BridgeAR
BridgeAR marked this pull request as ready for review June 1, 2026 12:13
@BridgeAR
BridgeAR requested review from a team as code owners June 1, 2026 12:13
@BridgeAR
BridgeAR requested review from khanayan123 and wconti27 and removed request for a team June 1, 2026 12:13
@BridgeAR
BridgeAR force-pushed the BridgeAR/2026-05-31-bench-integrations branch from f5e0be3 to a54d611 Compare June 2, 2026 14:26
Base automatically changed from BridgeAR/2026-05-31-benchmark-platform-job to master June 2, 2026 18:34
rochdev
rochdev previously approved these changes Jun 3, 2026
@BridgeAR
BridgeAR force-pushed the BridgeAR/2026-05-31-bench-integrations branch from a5b2b17 to 1e369aa Compare June 3, 2026 11:08
Bring the integration sirun benches under the per-variant runtime budget and
retire the bluebird/q benches:

1. dns and http lower their sirun repeat counts (20 -> 10, 20 -> 15); the
   graphql-long variants lower their query counts so each targets ~1 minute,
   with the startup-guard share staying under the ceiling.
2. dns/graphql/http/net/aws-sdk/propagation fixtures drive the instrumentation
   hot path rather than fixture construction.
3. bluebird and q benches are removed, along with their PLUGINS install entry
   and CODEOWNERS lines.
4. Leftover baseline keys are dropped from the debugger and llmobs metas.
@BridgeAR
BridgeAR force-pushed the BridgeAR/2026-05-31-bench-integrations branch from 1e369aa to 35b66fc Compare June 3, 2026 16:14
@BridgeAR
BridgeAR enabled auto-merge (squash) June 3, 2026 16:21
"baseline": "control",
"env": { "WITH_TRACER": "1", "WITH_DEPTH_AND_COLLAPSE": "4,0" }
},
"with-depth-and-collapse-on": {

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this variant removed?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was a duplicate. Collapse is active by default.

@BridgeAR
BridgeAR merged commit c8f9a93 into master Jun 3, 2026
907 of 909 checks passed
@BridgeAR
BridgeAR deleted the BridgeAR/2026-05-31-bench-integrations branch June 3, 2026 16:31
@dd-octo-sts dd-octo-sts Bot mentioned this pull request Jun 4, 2026
crysmags added a commit that referenced this pull request Jun 9, 2026
…nch rework

The earlier revert (90a60ba) used a stale local master ref and pulled an
older version of these files. Master has since picked up #8787 (profiler
workload + llmobs guard + shortened benches) and #8734 (integration tuning)
which both touch these paths, so the branch went CONFLICTING and Actions
stopped triggering on new commits.

Pulls in origin/master's current shape for both meta.json (3 variants,
adjusted query counts) and index.js (startup guard + assert + the
no-WITH_ASYNC_HOOKS path). No graphql plugin code is affected.

Co-Authored-By: Claude Opus 4.7 <[email protected]>
BridgeAR added a commit that referenced this pull request Jun 11, 2026
…rop bluebird and q (#8734)

Bring the integration sirun benches under the per-variant runtime budget and
retire the bluebird/q benches:

1. dns and http lower their sirun repeat counts (20 -> 10, 20 -> 15); the
   graphql-long variants lower their query counts so each targets ~1 minute,
   with the startup-guard share staying under the ceiling.
2. dns/graphql/http/net/aws-sdk/propagation fixtures drive the instrumentation
   hot path rather than fixture construction.
3. bluebird and q benches are removed, along with their PLUGINS install entry
   and CODEOWNERS lines.
4. Leftover baseline keys are dropped from the debugger and llmobs metas.
tlhunter pushed a commit that referenced this pull request Jun 18, 2026
…rop bluebird and q (#8734)

Bring the integration sirun benches under the per-variant runtime budget and
retire the bluebird/q benches:

1. dns and http lower their sirun repeat counts (20 -> 10, 20 -> 15); the
   graphql-long variants lower their query counts so each targets ~1 minute,
   with the startup-guard share staying under the ceiling.
2. dns/graphql/http/net/aws-sdk/propagation fixtures drive the instrumentation
   hot path rather than fixture construction.
3. bluebird and q benches are removed, along with their PLUGINS install entry
   and CODEOWNERS lines.
4. Leftover baseline keys are dropped from the debugger and llmobs metas.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants