Martingale Foresight Sampling: A Principled Approach to Inference-Time LLM Decoding

Explore Martingale Foresight Sampling, a novel framework leveraging Doob decomposition and martingale properties to optimize LLM decoding through principled ...

Level: expert

By Huayu Li, ZhengXiao He, Siyuan Tian, Jinghao Wen, Ao Li

Category: research