When LRP Diverges from Leave-One-Out in Transformers

This research exposes critical flaws in bilinear propagation schemes within Transformers, demonstrating how AttnLRP violates implementation invariance and pr...

Level: expert

By Weiqiu You, Siqi Zeng, Yao-Hung Hubert Tsai, Makoto Yamada, Han Zhao

Category: research