llm-stacking

non-profit

AI & ML interests

None defined yet.

wydu

authored a paper 3 months ago

The Station: An Open-World Environment for AI-Driven Discovery

Paper • 2511.06309 • Published Nov 9, 2025 • 37

wydu

authored a paper 9 months ago

Learning from Peers in Reasoning Models

Paper • 2505.07787 • Published May 12, 2025 • 45

Zeno-Luo

authored a paper 9 months ago

Learning from Peers in Reasoning Models

Paper • 2505.07787 • Published May 12, 2025 • 45

wydu

authored a paper 11 months ago

Learning from Failures in Multi-Attempt Reinforcement Learning

Paper • 2503.04808 • Published Mar 4, 2025 • 18

wydu

in llm-stacking/README 12 months ago

Baseline models

#1 opened 12 months ago by

Zeno-Luo

authored a paper over 1 year ago

Unlocking Continual Learning Abilities in Language Models

Paper • 2406.17245 • Published Jun 25, 2024 • 30

wydu

authored 2 papers over 1 year ago

Unlocking Continual Learning Abilities in Language Models

Paper • 2406.17245 • Published Jun 25, 2024 • 30

Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training

Paper • 2405.15319 • Published May 24, 2024 • 28

wydu

updated 12 models over 1 year ago

llm-stacking/StackingLaw_Factor_1.1B12L

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Factor_1.1B3L

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Factor_1.1B1L

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B50BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B20BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B5BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_1.1B1BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M50BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M20BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M10BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M5BT

Updated Jun 6, 2024 • 1

llm-stacking/StackingLaw_Timing_410M1BT

Updated Jun 6, 2024 • 1