chore(llmobs): update evaluation metric api endpoint to v2 by sabrenner · Pull Request #7511 · DataDog/dd-trace-js

sabrenner · 2026-02-12T19:08:15Z

What does this PR do?

Updates the API endpoint used for submitting LLMObs evaluation metrics from v1 to v2. This has no SDK API impact on the user, migrating to this endpoint allows us to attach more fields to the evaluation metric in follow-up PRs that the v1 endpoint does not support. The API signature for submitEvaluation remains the same.

Motivation

Unlock ability to implement new features that are supported by the v2 API endpoint.

Additional Notes

I verified this locally as well

llmobs.trace({ name: 'test', kind: 'workflow' }, () => {
  const spanCtx = llmobs.exportSpan()
  llmobs.submitEvaluation(spanCtx, {
    label: 'foo',
    value: 'bar',
    metricType: 'categorical'
  })
})

github-actions · 2026-02-12T19:09:12Z

Overall package size

Self size: 4.6 MB
Deduped: 5.44 MB
No deduping: 5.44 MB

Dependency sizes

| name | version | self size | total size | |------|---------|-----------|------------| | import-in-the-middle | 2.0.6 | 81.92 kB | 813.08 kB | | dc-polyfill | 0.1.10 | 26.73 kB | 26.73 kB |

_{🤖 This report was automatically generated by heaviest-objects-in-the-universe}

codecov · 2026-02-12T19:09:19Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 80.23%. Comparing base (875e585) to head (9baaf7c).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files

@@           Coverage Diff           @@
##           master    #7511   +/-   ##
=======================================
  Coverage   80.22%   80.23%           
=======================================
  Files         731      731           
  Lines       31194    31194           
=======================================
+ Hits        25026    25029    +3     
+ Misses       6168     6165    -3

Flag	Coverage Δ
aiguard-macos	`39.07% <ø> (?)`
aiguard-ubuntu	`39.19% <ø> (-0.11%)`	⬇️
aiguard-windows	`38.93% <ø> (-0.11%)`	⬇️
apm-capabilities-tracing-macos	`48.80% <ø> (ø)`
apm-capabilities-tracing-ubuntu	`48.83% <ø> (ø)`
apm-capabilities-tracing-windows	`48.52% <ø> (ø)`
apm-integrations-child-process	`38.64% <ø> (-0.11%)`	⬇️
apm-integrations-couchbase-18	`37.39% <ø> (-0.10%)`	⬇️
apm-integrations-couchbase-eol	`37.87% <ø> (-0.10%)`	⬇️
apm-integrations-oracledb	`38.06% <ø> (-0.10%)`	⬇️
appsec-express	`55.44% <ø> (-0.08%)`	⬇️
appsec-fastify	`52.05% <ø> (-0.08%)`	⬇️
appsec-graphql	`52.40% <ø> (-0.07%)`	⬇️
appsec-kafka	`44.64% <ø> (-0.14%)`	⬇️
appsec-ldapjs	`44.39% <ø> (-0.09%)`	⬇️
appsec-lodash	`44.07% <ø> (-0.09%)`	⬇️
appsec-macos	`58.50% <ø> (-0.07%)`	⬇️
appsec-mongodb-core	`49.31% <ø> (-0.08%)`	⬇️
appsec-mongoose	`50.00% <ø> (-0.09%)`	⬇️
appsec-mysql	`51.39% <ø> (-0.18%)`	⬇️
appsec-node-serialize	`43.58% <ø> (-0.09%)`	⬇️
appsec-passport	`48.15% <ø> (-0.09%)`	⬇️
appsec-postgres	`51.12% <ø> (-0.10%)`	⬇️
appsec-sourcing	`42.92% <ø> (-0.09%)`	⬇️
appsec-template	`43.75% <ø> (-0.09%)`	⬇️
appsec-ubuntu	`58.58% <ø> (-0.07%)`	⬇️
appsec-windows	`58.36% <ø> (-0.07%)`	⬇️
instrumentations-instrumentation-bluebird	`32.32% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-body-parser	`40.85% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-child_process	`37.94% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-cookie-parser	`34.55% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-express	`34.89% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-express-mongo-sanitize	`34.69% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-express-session	`40.47% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-fs	`31.92% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-generic-pool	`30.19% <ø> (ø)`
instrumentations-instrumentation-http	`39.66% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-knex	`32.33% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-mongoose	`33.68% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-multer	`40.59% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-mysql2	`38.44% <ø> (-0.10%)`	⬇️
instrumentations-instrumentation-passport	`44.46% <ø> (-0.09%)`	⬇️
instrumentations-instrumentation-passport-http	`44.11% <ø> (-0.09%)`	⬇️
instrumentations-instrumentation-passport-local	`44.67% <ø> (-0.09%)`	⬇️
instrumentations-instrumentation-pg	`37.85% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-promise	`32.25% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-promise-js	`32.26% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-q	`32.30% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-url	`32.22% <ø> (-0.11%)`	⬇️
instrumentations-instrumentation-when	`32.27% <ø> (-0.11%)`	⬇️
llmobs-ai	`41.48% <ø> (-0.10%)`	⬇️
llmobs-anthropic	`40.67% <ø> (-0.10%)`	⬇️
llmobs-bedrock	`39.55% <ø> (-0.09%)`	⬇️
llmobs-google-genai	`40.16% <ø> (-0.09%)`	⬇️
llmobs-langchain	`39.70% <ø> (-0.08%)`	⬇️
llmobs-openai	`44.51% <ø> (-0.09%)`	⬇️
llmobs-vertex-ai	`40.37% <ø> (-0.17%)`	⬇️
platform-core	`29.71% <ø> (ø)`
platform-esbuild	`32.89% <ø> (ø)`
platform-instrumentations-misc	`40.53% <ø> (ø)`
platform-shimmer	`36.14% <ø> (ø)`
platform-unit-guardrails	`31.27% <ø> (ø)`
plugins-azure-event-hubs	`24.02% <ø> (ø)`
plugins-azure-service-bus	`23.42% <ø> (ø)`
plugins-bullmq	`43.85% <ø> (-0.03%)`	⬇️
plugins-cassandra	`38.10% <ø> (-0.10%)`	⬇️
plugins-cookie	`25.08% <ø> (ø)`
plugins-cookie-parser	`24.87% <ø> (ø)`
plugins-crypto	`24.72% <ø> (ø)`
plugins-dd-trace-api	`38.49% <ø> (-0.11%)`	⬇️
plugins-express-mongo-sanitize	`25.04% <ø> (ø)`
plugins-express-session	`24.83% <ø> (ø)`
plugins-fastify	`42.58% <ø> (-0.10%)`	⬇️
plugins-fetch	`38.64% <ø> (-0.10%)`	⬇️
plugins-fs	`38.74% <ø> (-0.11%)`	⬇️
plugins-generic-pool	`24.06% <ø> (ø)`
plugins-google-cloud-pubsub	`45.79% <ø> (-0.07%)`	⬇️
plugins-grpc	`41.32% <ø> (-0.10%)`	⬇️
plugins-handlebars	`25.08% <ø> (ø)`
plugins-hapi	`40.49% <ø> (-0.10%)`	⬇️
plugins-hono	`40.75% <ø> (-0.10%)`	⬇️
plugins-ioredis	`38.54% <ø> (-0.11%)`	⬇️
plugins-knex	`24.80% <ø> (ø)`
plugins-ldapjs	`22.61% <ø> (ø)`
plugins-light-my-request	`24.48% <ø> (ø)`
plugins-limitd-client	`32.62% <ø> (-0.11%)`	⬇️
plugins-lodash	`24.13% <ø> (ø)`
plugins-mariadb	`39.65% <ø> (-0.10%)`	⬇️
plugins-memcached	`38.28% <ø> (-0.11%)`	⬇️
plugins-microgateway-core	`39.51% <ø> (-0.10%)`	⬇️
plugins-moleculer	`40.88% <ø> (-0.10%)`	⬇️
plugins-mongodb	`39.52% <ø> (-0.10%)`	⬇️
plugins-mongodb-core	`39.15% <ø> (-0.10%)`	⬇️
plugins-mongoose	`39.20% <ø> (-0.10%)`	⬇️
plugins-multer	`24.83% <ø> (ø)`
plugins-mysql	`39.29% <ø> (-0.08%)`	⬇️
plugins-mysql2	`39.39% <ø> (-0.10%)`	⬇️
plugins-node-serialize	`25.12% <ø> (ø)`
plugins-opensearch	`37.93% <ø> (-0.10%)`	⬇️
plugins-passport-http	`24.91% <ø> (ø)`
plugins-postgres	`35.78% <ø> (-0.09%)`	⬇️
plugins-process	`24.72% <ø> (ø)`
plugins-pug	`25.08% <ø> (ø)`
plugins-redis	`38.87% <ø> (-0.26%)`	⬇️
plugins-router	`43.36% <ø> (-0.10%)`	⬇️
plugins-sequelize	`23.66% <ø> (ø)`
plugins-test-and-upstream-amqp10	`38.61% <ø> (-0.11%)`	⬇️
plugins-test-and-upstream-amqplib	`43.97% <ø> (-0.10%)`	⬇️
plugins-test-and-upstream-apollo	`39.34% <ø> (-0.09%)`	⬇️
plugins-test-and-upstream-avsc	`38.89% <ø> (-0.11%)`	⬇️
plugins-test-and-upstream-bunyan	`33.94% <ø> (-0.11%)`	⬇️
plugins-test-and-upstream-connect	`41.17% <ø> (-0.10%)`	⬇️
plugins-test-and-upstream-graphql	`40.29% <ø> (-0.10%)`	⬇️
plugins-test-and-upstream-koa	`40.74% <ø> (-0.10%)`	⬇️
plugins-test-and-upstream-protobufjs	`39.12% <ø> (-0.11%)`	⬇️
plugins-test-and-upstream-rhea	`44.25% <ø> (-0.07%)`	⬇️
plugins-undici	`39.43% <ø> (-0.10%)`	⬇️
plugins-url	`24.72% <ø> (ø)`
plugins-valkey	`38.20% <ø> (-0.11%)`	⬇️
plugins-vm	`24.72% <ø> (ø)`
plugins-winston	`34.31% <ø> (-0.10%)`	⬇️
plugins-ws	`42.29% <ø> (-0.10%)`	⬇️
profiling-macos	`40.04% <ø> (-0.10%)`	⬇️
profiling-ubuntu	`40.17% <ø> (-0.10%)`	⬇️
profiling-windows	`41.41% <ø> (-0.10%)`	⬇️
serverless-azure-functions-client	`23.75% <ø> (ø)`
serverless-azure-functions-eventhubs	`23.75% <ø> (ø)`
serverless-azure-functions-servicebus	`23.75% <ø> (ø)`

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

datadog-datadog-prod-us1 · 2026-02-12T19:13:21Z

⚠️ Tests

✨ Fix all issues with Cursor

⚠️ Warnings

❄️ 2 New flaky tests detected

[email protected] commonJS flaky test retries retries flaky tests from integration-tests/cypress/cypress.spec.js (Datadog) (Fix with Cursor)
Expected values to be strictly equal:

0 !== 1
cypress@latest commonJS impacted tests does not retry impacted tests when testIsolation is false from integration-tests/cypress/cypress.spec.js (Datadog) (Fix with Cursor)
Cannot read properties of undefined (reading 'content')

ℹ️ Info

🧪 All tests passed

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 9baaf7c | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

pr-commenter · 2026-02-12T19:15:27Z

Benchmarks

Benchmark execution time: 2026-02-12 19:15:23

Comparing candidate commit 9baaf7c in PR branch sabrenner/update-eval-metrics-api-version with baseline commit 875e585 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 230 metrics, 30 unstable metrics.

* use v2 api endpoint * update tests

sabrenner added 2 commits February 12, 2026 14:04

use v2 api endpoint

ce43b17

update tests

9baaf7c

sabrenner added the semver-patch label Feb 12, 2026

sabrenner marked this pull request as ready for review February 12, 2026 19:57

sabrenner requested review from a team as code owners February 12, 2026 19:57

gsvigruha approved these changes Feb 12, 2026

View reviewed changes

sabrenner merged commit c589ad4 into master Feb 12, 2026
793 checks passed

sabrenner deleted the sabrenner/update-eval-metrics-api-version branch February 12, 2026 20:07

dd-octo-sts bot pushed a commit that referenced this pull request Feb 13, 2026

chore(llmobs): update evaluation metric api endpoint to v2 (#7511)

e9cfc99

* use v2 api endpoint * update tests

dd-octo-sts bot mentioned this pull request Feb 13, 2026

v5.87.0 proposal #7523

Merged

juan-fernandez pushed a commit that referenced this pull request Feb 18, 2026

chore(llmobs): update evaluation metric api endpoint to v2 (#7511)

2099837

* use v2 api endpoint * update tests

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore(llmobs): update evaluation metric api endpoint to v2#7511

chore(llmobs): update evaluation metric api endpoint to v2#7511
sabrenner merged 2 commits intomasterfrom
sabrenner/update-eval-metrics-api-version

sabrenner commented Feb 12, 2026

Uh oh!

github-actions bot commented Feb 12, 2026

Uh oh!

codecov bot commented Feb 12, 2026 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Feb 12, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Feb 12, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

sabrenner commented Feb 12, 2026

What does this PR do?

Motivation

Additional Notes

Uh oh!

github-actions bot commented Feb 12, 2026

Overall package size

Uh oh!

codecov bot commented Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

datadog-datadog-prod-us1 bot commented Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

⚠️ Warnings

ℹ️ Info

Uh oh!

pr-commenter bot commented Feb 12, 2026

Benchmarks

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

codecov bot commented Feb 12, 2026 •

edited

Loading

datadog-datadog-prod-us1 bot commented Feb 12, 2026 •

edited

Loading