Collapse-Free Prototype Readout Layer for Transformer Encoders

This research introduces DDCL-Attention, a novel prototype-based readout layer that eliminates prototype collapse in transformer encoders through exact loss ...

Level: expert

By Giansalvo Cirrincione, Rahul Ranjeev Kumar

Category: research