Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: scaleapi/llm-engine
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.0.0beta26
Choose a base ref
...
head repository: scaleapi/llm-engine
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.0.0beta27
Choose a head ref
  • 2 commits
  • 6 files changed
  • 2 contributors

Commits on Mar 11, 2024

  1. Try to fix async requests getting stuck (#466)

    @squeakymouse
    squeakymouse authored Mar 11, 2024
    Configuration menu
    Copy the full SHA
    d0d7c05 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. [Client] Add num_prompt_tokens to the client's CompletionOutputs (#467) 

    * add prompt token, untested

* comment

* remove stop_str stuff, it doesn't do anything with the public api, and it breaks on certain frameworks when hosted locally
    @seanshi-scale
    seanshi-scale authored Mar 12, 2024
    Configuration menu
    Copy the full SHA
    234f0a4 View commit details
    Browse the repository at this point in the history
Loading