BabyLM Sequence Length

babylm-seqlen 's models 50

Sort:  Recently updated

babylm-seqlen/opt-2048-warmup-v2

0.1B • Updated Jun 30, 2025 • 6

babylm-seqlen/mamba-2048-warmup-v2

0.2B • Updated Jun 30, 2025 • 15

babylm-seqlen/mamba-64-warmup-v2

0.2B • Updated Jun 26, 2025 • 13

babylm-seqlen/mamba-8192-warmup-v2

0.2B • Updated Jun 26, 2025 • 7

babylm-seqlen/mamba-4096-warmup-v2

0.2B • Updated Jun 26, 2025 • 15

babylm-seqlen/opt-8192-warmup-v2

0.1B • Updated Jun 25, 2025 • 7

babylm-seqlen/opt-4096-warmup-v2

0.1B • Updated Jun 25, 2025 • 14

babylm-seqlen/mamba-128-warmup-v2

0.2B • Updated Jun 25, 2025 • 6

babylm-seqlen/mamba-512-warmup-v2

0.2B • Updated Jun 25, 2025 • 5

babylm-seqlen/mamba-1024-warmup-v2

0.2B • Updated Jun 25, 2025 • 40

babylm-seqlen/opt-128-warmup-v2

0.1B • Updated Jun 24, 2025 • 10

babylm-seqlen/opt-256-warmup-v2

0.1B • Updated Jun 24, 2025 • 22

babylm-seqlen/opt-512-warmup-v2

0.1B • Updated Jun 24, 2025 • 8

babylm-seqlen/mamba-256-warmup-v2

0.2B • Updated Jun 15, 2025 • 19

babylm-seqlen/opt-1024-warmup-v2

0.1B • Updated Jun 15, 2025 • 6

babylm-seqlen/opt-64-warmup-v2

0.1B • Updated Jun 14, 2025 • 16

babylm-seqlen/mamba-4096

0.2B • Updated Jun 6, 2025 • 4

babylm-seqlen/opt-8192

0.1B • Updated Jun 6, 2025 • 4

babylm-seqlen/opt-4096

0.1B • Updated Jun 6, 2025 • 5

babylm-seqlen/mamba-8192

0.2B • Updated Jun 3, 2025 • 3

babylm-seqlen/mamba-8192-warmup

0.2B • Updated Jun 3, 2025 • 5

babylm-seqlen/mamba-4096-warmup

0.2B • Updated Jun 3, 2025 • 5

babylm-seqlen/mamba-2048-warmup

0.2B • Updated Jun 3, 2025 • 7

babylm-seqlen/mamba-512-warmup

0.2B • Updated Jun 3, 2025 • 8

babylm-seqlen/mamba-1024-warmup

0.2B • Updated Jun 3, 2025 • 6

babylm-seqlen/mamba-64-warmup

0.2B • Updated Jun 3, 2025 • 5

babylm-seqlen/mamba-128-warmup

0.2B • Updated Jun 3, 2025 • 5

babylm-seqlen/mamba-256-warmup

0.2B • Updated Jun 3, 2025 • 7

babylm-seqlen/opt-2048

0.1B • Updated Jun 3, 2025 • 6

babylm-seqlen/mamba-2048

0.2B • Updated Jun 3, 2025 • 4