What is LLMIX?
LLMIX turns a Raspberry Pi 5 into a self-contained AI hotspot that anyone nearby can join over Wi-Fi.
| Mode | Purpose | Model |
|---|---|---|
| Chat | Everyday Q&A and conversation | Granite-3.3-2B |
| Med-Chat | Medical explanations & symptom questions | Medicanite (fine-tuned Granite) |
| Code-Chat | Programming help & examples | Qwen 2.5 Coder 1.5B |
| Wiki-Chat | Wikipedia-grounded fact answers | Granite + FAISS RAG |
No internet, no GPU, no cloud calls – everything runs entirely on-device with llama.cpp.
Why you might care
Section titled “Why you might care”- 2.6 B people still lack reliable internet (ITU 2024).
- Kiwix & Internet-in-a-Box proved offline knowledge matters.
- LLMIX adds reasoning to that idea: live chat, code help, medical answers, RAG – anywhere a Pi can boot.