Cross-attention Secretly Performs Orthogonal Alignment in Recommendation Models

This research reveals that cross-attention in recommendation models implicitly performs orthogonal alignment, enhancing performance and scaling laws without ...

Level: advanced

By Unknown

Category: research