Efficient Resource-Constrained Training of Vision Transformers via Subspace Optimization

This research introduces WASI, a novel subspace optimization method designed to train Vision Transformers efficiently on resource-constrained devices, signif...

Level: advanced

By Unknown

Category: research