Log inSign up
DeepEval
178 posts
user avatar
DeepEval
@deepeval
The Open-Source LLM Evaluation Framework โ€“ created and maintained by @confident_ai GitHub: github.com/confident-ai/dโ€ฆ
San Francisco
github.com/confident-ai/dโ€ฆ
Joined February 2025
2
Following
683
Followers

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

TermsยทPrivacyยทCookiesยทAccessibilityยทAds Infoยทยฉ 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
  • user avatar
    DeepEval
    @deepeval
    Jul 24, 2025
    When it goes to testing AI agents, nothing's as important as being able to dissect each and every agent invokation, tool call, etc. Launching DeepEval evals for LLM tracing with @confident_ai.
    00:00
    1.1K
  • user avatar
    DeepEval
    @deepeval
    Jun 30, 2025
    ๐Ÿšง One of the biggest barriers to LLM evaluation today? The steep learning curve. Youโ€™re expected to: - Understand how each metric works - Interpret what the results actually mean - Compare across multiple (often conflicting) metrics And if you get it wrong? You might end up
    320
  • user avatar
    DeepEval
    @deepeval
    Jul 7, 2025
    Donโ€™t get frustrated by writing print statements and endlessly scrolling terminal logs to debug your @langchain (and LangGraph) app. Trace your agentโ€™s execution steps in production on @confident_ai using our callback handler, with just two lines of code. Documentation:
    314
  • user avatar
    DeepEval
    @deepeval
    Jul 15, 2025
    In DeepEval's latest release (โญ v3.2.6), we're doubling down on multi-turn LLM evals. Previously defining goldens for multi-turn use cases were awkward. This is because you simply cannot do it - you don't know for a given conversation what the nth user input will be, because it
    DeepEval - The LLM Evaluation Framework
    From deepeval.com
    138
  • user avatar
    DeepEval
    @deepeval
    Jun 17, 2025
    No marketing stunts, only grind
    250
  • user avatar
    DeepEval
    @deepeval
    Mar 14, 2025
    ๐Ÿ‘€
    user avatar
    Jeffrey ๐Ÿฌ confident-ai.com
    @jeffr_yyy
    Mar 14, 2025
    @deepeval
    202
  • user avatar
    DeepEval
    @deepeval
    Feb 19, 2025
    Hmmm whos powering their evals?
    user avatar
    Y Combinator
    @ycombinator
    Feb 19, 2025
    Confident AI helps developers build the best version of their LLM application by automating evaluation, prompt iteration, and live testing. Their framework is open source and runs 700k evals every day. ycombinator.com/launches/Mnp-cโ€ฆ Congrats on the launch, @jeffr_yyy + @KritinV78426!
    00:00
    82
  • user avatar
    DeepEval
    @deepeval
    Jun 6, 2025
    Claude Sonnet 4 has a lot of interesting feats and findings we got out of it, will share a writeup soon
    user avatar
    Avi Chawla
    @_avichawla
    Jun 6, 2025
    Replying to @_avichawla
    Claude Sonnet 4 is the newest reasoning model by Anthropic. Today, let's compare it with OpenAI o4 on coding tasks. We'll use: - @LiteLLM for orchestration. - @deepeval for evaluation (open-source). - @AnthropicAI Sonnet 4 and @OpenAI o4 as LLMs. Let's dive in!
    00:00
    371
  • user avatar
    DeepEval
    @deepeval
    Jun 3, 2025
    Thanks for the mention!
    user avatar
    Towards Data Science
    @TDataScience
    Jun 3, 2025
    How do you truly measure LLM success when the output is text, not a number? ๐Ÿค” Stephanie Kirmer's new article introduces a robust framework for evaluating LLM inference performance, using a "rubric" approach and tools like @DeepEval. towardsdatascience.com/evaluating-llmโ€ฆ
    120
  • user avatar
    DeepEval
    @deepeval
    Feb 13, 2025
    hmm this company looks promising....
    user avatar
    Jeffrey ๐Ÿฌ confident-ai.com
    @jeffr_yyy
    Feb 13, 2025
    It's official! @confident_ai just went public on @ycombinator's Launch YC! Checkout how we're changing LLM evaluation, our open-source approach, and ROIs we're bringing for customers: ycombinator.com/launches/Mnp-cโ€ฆ
    63
  • user avatar
    DeepEval
    @deepeval
    May 22, 2025
    Replying to @akshay_pachaar
    thanks for the mention ๐Ÿ‘€
    489
  • user avatar
    DeepEval
    @deepeval
    Jun 30, 2025
    Mult-turn evals are now extremely popular for users on DeepEval.
    118
  • user avatar
    DeepEval
    @deepeval
    Jun 13, 2025
    Don't want to turn a Friday meeting into a QA debate on that AI app you're trynna ship? Check us out:
    GitHub - confident-ai/deepeval: The LLM Evaluation Framework
    From github.com
    103
  • user avatar
    DeepEval
    @deepeval
    May 28, 2025
    Replying to @c4ml_ and @Sumanth_077
    ๐Ÿ‘€
    52