https://nalar.dev/tags/ollama/ Recent content in Ollama on Nalar Hugo en-us Sat, 19 Sep 2026 00:00:00 +0000 https://nalar.dev/ollama-gemma-3-270m-memory-beyond-model-file-size/ Sat, 19 Sep 2026 00:00:00 +0000 https://nalar.dev/ollama-gemma-3-270m-memory-beyond-model-file-size/ <p>Ollama lists <code>gemma3:270m</code> at about 292 MB. That number is useful for storage planning, but it is not a RAM requirement. It describes the packaged model data for the default Ollama variant, which uses Q8_0 quantization. Once inference starts, the runtime also needs memory for model metadata, execution buffers, token state, and the key-value cache used by attention.</p> <p>That distinction matters on small machines. A device with 512 MB of RAM may appear large enough when compared only with a 292 MB model file, yet the remaining memory must also accommodate Ollama and the operating system. The context configuration can move the total substantially.</p>