https://nalar.dev/tags/sequence-generation/ Recent content in Sequence Generation on Nalar Hugo en-us Thu, 03 Sep 2026 00:00:00 +0700 https://nalar.dev/understand-beam-search-for-sequence-generation/ Thu, 03 Sep 2026 00:00:00 +0700 https://nalar.dev/understand-beam-search-for-sequence-generation/ <p>A model that generates text or another sequence makes a series of local decisions. At each step, it assigns scores or probabilities to possible next tokens. The simplest decoder chooses the most likely token, appends it, and repeats.</p> <p>That strategy is called <strong>greedy decoding</strong>. It is cheap and easy to understand, but an early choice that looks best by itself can lead to a worse complete sequence. Once greedy decoding commits to that choice, it cannot reconsider it.</p>