The recent release of ModernBERT by LightOn and AnswerAI aims at providing the best base model that can be then used in different industry verticals. Efficient Continued Pre-Training, Streamlined for ...