SpecExit introduces a novel speculative decoding framework that leverages intermediate hidden states to enable real-time early-exit decisions, significantly ...
Level: advanced
By Unknown
Category: research