Will it fit on your machine?
Choose a model and hardware to calculate the memory you need.
Your configuration
Narrow models to your hardware, and hardware to your model, using your current settings.
Memory needed
estimated use / available memory
- Model weights
- 5.4 GiB
- Conversation memory
- 0.3 GiB
- Runtime allowance
- 1.0 GiB
- Room left
- 16.3 GiB
1.0 GiB reserved for the system and other apps.
Calculation assumptions
Text inference estimate. Image, audio and video inputs need additional encoder and temporary memory.
Local LLM questions, answered.
Practical next steps, with the technical detail there when you need it.
- Why is my local LLM so slow?
Troubleshoot slow Ollama, LM Studio and llama.cpp inference. Separate loading, prompt processing and generation before changing hardware.
- Smaller Q8 or larger Q4: which local model should you run?
Choose between a smaller high-precision LLM and a larger quantized model with a practical test for quality, memory, context and response time.
- Local RAG giving bad answers? Check retrieval first.
Fix local document Q&A with a practical RAG checklist: PDF extraction, chunks, embeddings, hybrid search, reranking and a small evaluation set.