https://nalar.dev/tags/pagedattention/ Recent content in PagedAttention on Nalar Hugo en-us Wed, 23 Sep 2026 00:00:00 +0000 https://nalar.dev/pagedattention-maps-logical-kv-blocks-to-noncontiguous-physical-memory/ Wed, 23 Sep 2026 00:00:00 +0000 https://nalar.dev/pagedattention-maps-logical-kv-blocks-to-noncontiguous-physical-memory/ <p>An autoregressive request grows its KV cache as tokens arrive, but its final sequence length is not known when decoding begins. Reserving one contiguous region for the maximum possible sequence length ties memory to capacity that may never be used. PagedAttention changes that allocation boundary: a sequence is represented as logical KV blocks, while a block table maps those logical blocks to physical blocks that need not be adjacent in GPU memory.</p>