Lightweight Baselines for Medical Abstract Classification: DistilBERT with Cross-Entropy as a Strong Default
This research evaluates DistilBERT as a high-efficiency baseline for medical text classification, comparing loss functions and calibration strategies to opti...