FineWeb-HQ datasets Collection Collection containing FineWeb-HQ and FineWeb2-HQ quality filtered datasets. β’ 3 items β’ Updated Oct 8
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments Paper β’ 2509.14233 β’ Published Sep 17 β’ 14
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments Paper β’ 2509.14233 β’ Published Sep 17 β’ 14
Benchmarking Optimizers for Large Language Model Pretraining Paper β’ 2509.01440 β’ Published Sep 1 β’ 24
Benchmarking Optimizers for Large Language Model Pretraining Paper β’ 2509.01440 β’ Published Sep 1 β’ 24
Gradient Clipping Improves AdaGrad when the Noise Is Heavy-Tailed Paper β’ 2406.04443 β’ Published Jun 6, 2024
Benchmarking Optimizers for Large Language Model Pretraining Paper β’ 2509.01440 β’ Published Sep 1 β’ 24
BaCaDI: Bayesian Causal Discovery with Unknown Interventions Paper β’ 2206.01665 β’ Published Jun 3, 2022 β’ 2
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language Paper β’ 2506.20920 β’ Published Jun 26 β’ 75
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language Paper β’ 2506.20920 β’ Published Jun 26 β’ 75
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language Paper β’ 2506.20920 β’ Published Jun 26 β’ 75
The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text Paper β’ 2506.05209 β’ Published Jun 5 β’ 59
view post Post 6070 SmolVLM is now available on PocketPal β you can run it offline on your smartphone to interpret the world around you. ππ±And check out this real-time camera demo by @ngxson , powered by llama.cpp:https://github.com/ngxson/smolvlm-realtime-webcamhttps://x.com/pocketpal_ai See translation 4 replies Β· β€οΈ 11 11 π 1 1 + Reply
SmolVLM: Redefining small and efficient multimodal models Paper β’ 2504.05299 β’ Published Apr 7 β’ 202
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model Paper β’ 2502.02737 β’ Published Feb 4 β’ 252