🚀 What's the Problem?
Right now OpenLIT can show the LLM events but their is no automated way to see if a event performed good or bad. This can be done using Eval metrics that generally run against a dataset
💡 Your Dream Solution
Auto Evalutaion scoring for all LLM requests traced and stored in OpenLIT
🤔 Seen anything similar?
NA
🖼️ Pictures or Drawings
NA
👐 Want to Help Make It Happen?
🚀 What's the Problem?
Right now OpenLIT can show the LLM events but their is no automated way to see if a event performed good or bad. This can be done using Eval metrics that generally run against a dataset
💡 Your Dream Solution
Auto Evalutaion scoring for all LLM requests traced and stored in OpenLIT
🤔 Seen anything similar?
NA
🖼️ Pictures or Drawings
NA
👐 Want to Help Make It Happen?