Pretrained models from the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"
Zayd Muhammad Kawakibi Zuhri PRO
zaydzuhri
AI & ML interests
I really like watching loss go down
Recent Activity
updated
a model
about 10 hours ago
zaydzuhri/dsmtp-code-7B-4096-batch8x2-steps40000-20260101-092051
published
a model
about 10 hours ago
zaydzuhri/dsmtp-code-7B-4096-batch8x2-steps40000-20260101-092051
updated
a model
about 11 hours ago
zaydzuhri/dsmtp-code-1B-4096-batch16x1-steps40000-20251231-083610
Organizations
None yet
models
106
zaydzuhri/dsmtp-code-7B-4096-batch8x2-steps40000-20260101-092051
Updated
zaydzuhri/dsmtp-code-1B-4096-batch16x1-steps40000-20251231-083610
Updated
zaydzuhri/dsmtp-math-7B-4096-batch8x2-steps8000-20251230-174318
Updated
zaydzuhri/dsmtp-math-1B-4096-batch16x1-steps8000-20251230-122541
Updated
zaydzuhri/mtp-math-7B-4096-model
7B
•
Updated
•
10
zaydzuhri/vanilla-math-7B-4096-model
7B
•
Updated
•
25
zaydzuhri/top-math-7B-4096-model
7B
•
Updated
•
23
zaydzuhri/top-math-1.8B-4096-model
2B
•
Updated
•
56
zaydzuhri/vanilla-math-1.8B-4096-model
2B
•
Updated
•
39
zaydzuhri/mtp-math-1.8B-4096-model
2B
•
Updated
•
30
datasets
14
zaydzuhri/OpenMathInstruct-2-GSM8K-Text
Viewer
•
Updated
•
22M
•
14
zaydzuhri/mbpp-train-text
Viewer
•
Updated
•
374
•
10
zaydzuhri/OpenCodeInstruct-MBPP-Text
Viewer
•
Updated
•
5M
•
43
zaydzuhri/OpenCodeInstruct-HumanEval-Text
Viewer
•
Updated
•
5M
•
62
zaydzuhri/hendrycks_math_text
Viewer
•
Updated
•
12.5k
•
22
zaydzuhri/OpenMathInstruct-2-Text
Viewer
•
Updated
•
22M
•
123
zaydzuhri/stack-edu-python
Viewer
•
Updated
•
25.3M
•
52
zaydzuhri/stack-edu
Viewer
•
Updated
•
99.5M
•
171
zaydzuhri/kreyol-mt-cleaned
Viewer
•
Updated
•
903k
•
308
zaydzuhri/the_pile_tokenized_5percent_truncated_packed_v2
Viewer
•
Updated
•
2.46M
•
210