• Hexarei ( [email protected] ) 
    link
    fedilink
    arrow-up
    2
    ·
    26 days ago

    I just run the llama-swap docker container with a config file mounted, set to listen for config changes so I don’t have to restart it to add new models. I don’t have a guide besides the README for llama-swap.