Submitted by
Jacob Nielsen
AI & ML interests
- Ressource constrained language modelling - Evaluation - Low-Bandwidth Distributed Training - Quantization - Medical Language Modelling - AI x Human
Recent Activity
Papers
FlexMoRE: A Flexible Mixture of Rank-heterogeneous Experts for Efficient Federatedly-trained Large Language Models
DeToNATION: Decoupled Torch Network-Aware Training on Interlinked Online Nodes