Skip to content

refactor(llmobs/experiment): provide the entire record for tasks and evaluators#4025

Merged
rarguelloF merged 3 commits into
rarguelloF/AIDM-708/llmobs-clientfrom
10-06-refactor_llmobs_experiment_provide_the_entire_record_for_tasks_and_evaluators
Oct 7, 2025
Merged

refactor(llmobs/experiment): provide the entire record for tasks and evaluators#4025
rarguelloF merged 3 commits into
rarguelloF/AIDM-708/llmobs-clientfrom
10-06-refactor_llmobs_experiment_provide_the_entire_record_for_tasks_and_evaluators

Conversation

@rarguelloF

@rarguelloF rarguelloF commented Oct 6, 2025

Copy link
Copy Markdown
Contributor

What does this PR do?

Provide the entire record for experiment evaluators and tasks instead of individual fields.

Motivation

Reviewer's Checklist

  • Changed code has unit tests for its functionality at or near 100% coverage.
  • System-Tests covering this feature have been added and enabled with the va.b.c-dev version tag.
  • There is a benchmark for any new code, or changes to existing code.
  • If this interacts with the agent in a new way, a system test has been added.
  • New code is free of linting errors. You can check this by running ./scripts/lint.sh locally.
  • Add an appropriate team label so this PR gets put in the right place for the release notes.
  • Non-trivial go.mod changes, e.g. adding new modules, are reviewed by @DataDog/dd-trace-go-guild.

Unsure? Have a question? Request a review!

rarguelloF commented Oct 6, 2025

Copy link
Copy Markdown
Contributor Author

@rarguelloF
rarguelloF marked this pull request as ready for review October 6, 2025 11:19
@rarguelloF
rarguelloF requested a review from a team as a code owner October 6, 2025 11:19
@pr-commenter

pr-commenter Bot commented Oct 6, 2025

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2025-10-06 11:35:11

Comparing candidate commit bc9a44e in PR branch 10-06-refactor_llmobs_experiment_provide_the_entire_record_for_tasks_and_evaluators with baseline commit ea3971e in branch 10-06-fix_input_and_metadata_can_be_any_type.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 24 metrics, 0 unstable metrics.

Base automatically changed from 10-06-fix_input_and_metadata_can_be_any_type to rarguelloF/AIDM-708/llmobs-client October 7, 2025 15:22
…llmobs_experiment_provide_the_entire_record_for_tasks_and_evaluators
@rarguelloF
rarguelloF merged commit 9ceca95 into rarguelloF/AIDM-708/llmobs-client Oct 7, 2025
12 of 97 checks passed
@rarguelloF
rarguelloF deleted the 10-06-refactor_llmobs_experiment_provide_the_entire_record_for_tasks_and_evaluators branch October 7, 2025 15:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants