Skip to content

Gateway startup: models.mode=replace should skip pricing fetches #74020

Description

@CassidyTTWD-bot

When starting the gateway with \models.mode=replace, the gateway still runs pricing fetches (e.g. OpenRouter, LiteLLM) which take up to 60 seconds to timeout. Since the mode is
eplace\ and models are manually configured, these fetches are unnecessary and significantly delay startup. Please skip pricing fetches when mode is
eplace.

Metadata

Metadata

Assignees

No one assigned

    Labels

    staleMarked as stale due to inactivity

    Type

    No type

    Fields

    Priority

    None yet

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions