bad connection with to ollama container #7715
Description
Describe the bug
Typing at the console "hi" hangs the ollama container on max cpu
goose container
wget 'https://github.com/block/goose/releases/download/v1.27.0/goose-x86_64-unknown-linux-gnu.tar.bz2'
docker run -v /dev/log:/dev/log -it --network host debian:bookworm-slim /bin/bash
docker cp goose goose:/usr/local/bin/
apt-get update
apt-get install libgomp1 ca-certificates
ollama container
docker run -v /dev/log:/dev/log -v /home/data:/root/.ollama --network host --cpus=6 ollama/ollama:latest
docker exec -it ollama ollama pull llama3 (does not work with goose? (tools/function calling) use llama3.1)
docker exec -it ollama ollama list
tests like these are fine, and produce immediate results
docker exec -it ollama ollama run llama3.1 "hi"
curl -X POST http://localhost:11434/api/generate \
-H "Content-Type: application/json" \
-d '{
"model": "llama3.1",
"prompt": "hi",
"stream": true
}'
However typing "hi" in goose takes forever, load increases to max cpu on the ollama container, however does not seem to end.
Metadata
Metadata
Assignees
Labels
No labels