Small Vocabularies, Big Gains: Pretraining and Tokenization in Time Series Models

This research explores how small, engineered vocabularies and pretraining strategies can significantly enhance the stability and performance of time series f...

Level: advanced

By Alexis Roger, Gwen Legate, Kashif Rasul, Yuriy Nevmyvaka, Irina Rish

Category: research