Skip to content

Hardware auto select#44

Merged
jeremyfowers merged 12 commits intomainfrom
hw-select
Sep 12, 2025
Merged

Hardware auto select#44
jeremyfowers merged 12 commits intomainfrom
hw-select

Conversation

@jeremyfowers
Copy link
Member

@jeremyfowers jeremyfowers commented Sep 10, 2025

  • Add get_system_info() and select_model_for_hardware() functions to LemonadeClient
  • Arcade app now uses these functions to choose from 3 models at startup:
    • 64GB+ RAM or discrete GPU with 16GB+ VRAM: Qwen3-Coder-30B-A3B-Instruct-GGUF
    • AMD NPU available: Qwen-2.5-7B-Instruct-Hybrid
    • Default/fallback: Qwen3-4B-Instruct-2507-GGUF
image

@jeremyfowers jeremyfowers self-assigned this Sep 10, 2025
@jeremyfowers jeremyfowers merged commit 026e810 into main Sep 12, 2025
5 checks passed
@jeremyfowers jeremyfowers deleted the hw-select branch September 12, 2025 15:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant