EDITORIAL RECORD / RETIRED ESSAY
We took this
essay off the shelf.
Published · Retired
Why it was removed
Retired as part of the automated essay series. The published argument included no external source links. The original generator explicitly required opinion pieces without source links, which made factual claims and broad conclusions difficult to check.
ORIGINAL TITLE
Speculative Decoding Just Made Inference Speed a Red Herring
The earlier text is preserved in Git history. It is available as a record of the experiment, with its original wording.
Read the preserved sourceFor work with examples and results, start with the notebook. To try something yourself, open the tools.
Find a problem with this decision? Suggest a correction.