Running Featured 1.26k FineWeb: decanting the web for the finest text data at scale 🍷 1.26k Generate high-quality text data for LLMs using FineWeb
Running 3.63k The Ultra-Scale Playbook 🌌 3.63k The ultimate guide to training LLM on large GPU Clusters
Running on CPU Upgrade Featured 2.82k The Smol Training Playbook 📚 2.82k The secrets to building world-class LLMs
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models Paper • 1910.02054 • Published Oct 4, 2019 • 9
Journal Club Collection Candidate papers to read in the H4 journal club • 54 items • Updated Apr 21, 2024 • 36
Papers We've Read Collection Papers discussed in the H4 journal club • 3 items • Updated Apr 12, 2024 • 10
Discrete Diffusion in Large Language and Multimodal Models: A Survey Paper • 2506.13759 • Published Jun 16, 2025 • 43
facebook/wav2vec2-base-960h Automatic Speech Recognition • 94.4M • Updated Nov 14, 2022 • 1.33M • 385