Interleaved Head Attention
Paper • 2602.21371 • Published • 1
Luc Robert--Villanueva
lucrbrtv
AI & ML interests
None yet
Recent Activity
updated a model about 6 hours ago
lucrbrtv/doom-world-model published a model about 21 hours ago
lucrbrtv/doom-world-model liked a dataset 2 days ago
Anthropic/BioMysteryBench-previewOrganizations
None yet
upvoted a paper 18 days ago
upvoted a changelog 22 days ago
Hugging Face Changelog
Agent Traces on the Hub
• 121
upvoted an article 29 days ago
Article
Welcome Gemma 4: Frontier multimodal intelligence on device
- +5
•
884
upvoted a paper about 1 month ago
upvoted a collection about 1 month ago
upvoted a changelog about 1 month ago
Hugging Face Changelog
Hugging Face Papers for AI Agents
• 139
upvoted an article about 2 months ago
Article
PRX Part 3 — Training a Text-to-Image Model in 24h!
•
62
upvoted 2
papers about 2 months ago
upvoted an article 2 months ago
Article
Mixture of Experts (MoEs) in Transformers
- +5
•
156
upvoted 2
articles 5 months ago
Article
We Got Claude to Fine-Tune an Open Source LLM
•
624
Article
Transformers v5: Simple model definitions powering the AI ecosystem
- +2
•
310
upvoted a paper 5 months ago
upvoted 6
articles 5 months ago
Article
~Don't~ Repeat Yourself
•
55
Article
nanoVLM: The simplest repository to train your VLM in pure PyTorch
- +5
•
257
Article
The 1 Billion Token Challenge: Finding the Perfect Pre-training Mix
•
65
Article
Text-to-image Architectural Experiments
•
57
Article
Why Did MiniMax M2 End Up as a Full Attention Model?
•
80
Article
We’re open-sourcing our text-to-image model and the process behind it
•
98
upvoted an article 6 months ago
Article
Streaming datasets: 100x More Efficient
- +3
•
86