Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: scaleapi/llm-engine
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.0.0beta22
Choose a base ref
...
head repository: scaleapi/llm-engine
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.0.0beta25
Choose a head ref
  • 6 commits
  • 10 files changed
  • 3 contributors

Commits on Jan 31, 2024

  1. LLM benchmark script improvements (#427)

    * step concurrency
    
    * add completion time percentiles
    
    * fix up percentiles to be total request time
    
    * rename some things
    
    * wip percentiles for inter token latency
    
    * actually record the numbers
    
    * oops
    
    * add percentiles for time to first token
    seanshi-scale authored Jan 31, 2024
    Configuration menu
    Copy the full SHA
    b8688a2 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2024

  1. Allow using pydantic v2 (#429)

    * Allow using pydantic v2
    
    * bump version
    seanshi-scale authored Feb 3, 2024
    Configuration menu
    Copy the full SHA
    b0e7d29 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Configuration menu
    Copy the full SHA
    5e45f4a View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. Allow pydantic 2 in python client requested requirements (#433)

    * allow pydantic 2 in requirements
    
    * bump version
    
    * ignore mypy for line
    
    * fix mypy
    
    * can't just cast to HttpUrl like that
    seanshi-scale authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    8a35e38 View commit details
    Browse the repository at this point in the history
  2. Fix permissions (#431)

    * Fix s5cmd env vars
    
    * more fixes for s5cmd
    
    * dont error
    
    * add back aws_profile
    
    * flush
    
    * fix test
    yunfeng-scale authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    5585d8e View commit details
    Browse the repository at this point in the history
  3. [Client] Add Auth headers to the python async routes (#434)

    * add Auth headers to the async routes
    
    * bump version
    seanshi-scale authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    886af3c View commit details
    Browse the repository at this point in the history
Loading