ssToken: Self-modulated and Semantic-aware Token Selection for LLM Fine-tuning

This research introduces ssToken, a novel framework for LLM fine-tuning that dynamically selects tokens using self-modulated gradients and semantic attention...

Level: advanced

By Unknown

Category: research