Expose Prometheus metrics

Required:

all partitioned by provider, model, client, user_id, endpoint, streaming (where applicable)
all the metrics collected in the telemetry packet
interception_duration
passthrough count -> partitioned by provider, endpoint, user_id

We'll import the prometheus client in aibridge
coder/coder will pass in registerer, wrap with labels / name prefix

i.e.
aibridge_interception_duration
-> coderd_aibridge_interception_duration

This will slip this release unfortunately.

coder/coder#20865 is still outstanding

@dannykopping

@dannykopping is this completed? Do we have these in our Grafana dashboard already?
I want us to update the docs to mention we have this.

Completed, yes
In our dashboard, no
Would you mind raising a separate issue in coder/internal for that pls?

Navigation Menu