https://nalar.dev/tags/sequence-models/ Recent content in Sequence Models on Nalar Hugo en-us Fri, 04 Sep 2026 00:00:00 +0700 https://nalar.dev/understand-teacher-forcing-in-autoregressive-models/ Fri, 04 Sep 2026 00:00:00 +0700 https://nalar.dev/understand-teacher-forcing-in-autoregressive-models/ <p>An autoregressive model generates a sequence one element at a time. A language model predicts the next token from the tokens before it; a sequence model might similarly predict the next symbol, event, or value from an existing prefix.</p> <p>That creates a practical training question: when teaching the model to predict step 5, should the input contain the correct steps 1–4 from the dataset, or the model&rsquo;s own earlier predictions?</p>