Skip to content

LLM: define common/system-specific event structure #834

@lmolkova

Description

@lmolkova

Area(s)

llm

Is your change request related to a problem? Please describe.

See #825 (comment)

#825 is going to introduce LLM events and (currently) requires to put prompts and completions as json string in OpenAI format. Some LLM vendors might not use json and instrumentation would be forced to use specific structure.

We should decide if:

  • we define a common format and all LLM vendor instrumentations are forced to use it.
  • we want one event with OpenAI JSON messages format (or another common format) and other vendors are forced to use it.
  • vendor-specific events. E.g. gen_ai.{vendor}.prompt and then vendors could document their own structure or document that they emit OpenAI-formatted events
  • we make format dynamic with additional attributes representing mime type.

This is closely coupled with #829

Describe the solution you'd like

TBD

Metadata

Metadata

Assignees

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions