Training In-Context and In-Weights Mixtures Via Contrastive Context Sampling

This research explores strategies to co-develop in-context and in-weights learning in large language models, introducing a novel Contrastive-Context method t...

Level: advanced

By Deeptanshu Malu, Deevyanshu Malu, Aditya Nemiwal, Sunita Sarawagi

Category: research