https://nalar.dev/tags/summarization/ Recent content in Summarization on Nalar Hugo en-us Sat, 19 Sep 2026 00:00:00 +0000 https://nalar.dev/where-pegasus-xsum-inference-time-goes/ Sat, 19 Sep 2026 00:00:00 +0000 https://nalar.dev/where-pegasus-xsum-inference-time-goes/ <p><code>google/pegasus-xsum</code> is a summarization checkpoint, not a compact text utility. Its latency follows directly from the work performed by a large Transformer encoder-decoder: first encode the source document, then run the decoder repeatedly until the summary is complete. On a CPU, the second phase is usually the part that makes a short output feel disproportionately expensive.</p> <p>The original PEGASUS work describes a Transformer encoder-decoder pretrained with Gap Sentences Generation and reports a 568M-parameter best model. The XSum checkpoint is fine-tuned for highly abstractive single-document summarization. That combination is useful when summary quality matters, but it also means inference has substantially more machinery than extracting a few source sentences or running a small classifier.</p>