Skip to content

Implement OllamaProvider using ollama-rs #9

@bug-ops

Description

@bug-ops

Description

Implement the LlmProvider trait for Ollama local inference using the ollama-rs crate.

Parent: #2

Branch

feat/m1/ollama-backend

Files

  • crates/zeph-llm/src/ollama.rs — OllamaProvider struct + LlmProvider impl
  • crates/zeph-llm/src/lib.rs — add module
  • crates/zeph-llm/Cargo.toml — add ollama-rs, tokio deps

Acceptance Criteria

  • OllamaProvider::new(base_url, model) constructor
  • chat() sends messages, returns response text
  • health_check() async method verifies Ollama is reachable
  • Handles connection errors gracefully

Depends On

#8 (LlmProvider trait)

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureNew functionalityllmzeph-llm crate (Ollama, Claude)

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions