SpecExit: Accelerating Large Reasoning Model via Speculative Exit

SpecExit introduces a novel speculative decoding framework that leverages intermediate hidden states to enable real-time early-exit decisions, significantly ...

Level: advanced

By Unknown

Category: research