https://nalar.dev/tags/model-monitoring/ Recent content in Model Monitoring on Nalar Hugo en-us Fri, 04 Sep 2026 00:00:00 +0700 https://nalar.dev/detect-distribution-shift-before-model-quality-fails/ Fri, 04 Sep 2026 00:00:00 +0700 https://nalar.dev/detect-distribution-shift-before-model-quality-fails/ <p>A model can pass offline evaluation and still become less useful after deployment. The model may not have changed at all. Instead, the data reaching it may have changed.</p> <p>A fraud classifier trained on last year&rsquo;s transactions may encounter a new payment pattern. A support-ticket model may see terminology introduced by a new product. An image model deployed to different hardware may receive images with different lighting or compression. These are forms of <strong>distribution shift</strong>: the statistical conditions seen in production differ from those represented by the data used to develop or evaluate the model.</p>