Leooyii/YaRN_32k_Slimpajama_1B
Text Generation • 7B • Updated • 31
Long Context Controlled Study
Models and datasets of "A Controlled Study on Long Context Extension and Generalization in LLMs"
-
-
Leooyii/NTK_32k_Slimpajama_1B
Text Generation • 7B • Updated • 46 -
Leooyii/PI_32k_Slimpajama_1B
Text Generation • 7B • Updated • 43 -
Leooyii/NTK_64k_Slimpajama_2B
Text Generation • 7B • Updated • 44 -
Leooyii/Longlora_32k_Slimpajama_1B
Text Generation • 7B • Updated • 25 -
Leooyii/NTK_64k_Slimpajama_1B
Text Generation • 7B • Updated • 45 -
Leooyii/phi-2-CLEX-32k-Slimpajama-1B
Text Generation • 3B • Updated • 7 -
Leooyii/Landmark_512_Slimpajama_1B
Text Generation • Updated • 6 -
Leooyii/Landmark_1024_Slimpajama_1B
Text Generation • Updated • 3 -
Leooyii/phi-2-NTK-64k-Slimpajama-1B
Updated -
Leooyii/phi-2-NTK-32k-Slimpajama-1B
Updated -
Leooyii/Llama-2-7b-CLEX-32k-Slimpajama-1B
Updated -
Leooyii/phi-2-PI-32k-Slimpajama-1B
Updated -
Leooyii/longbench
Preview • Updated • 12k -
Leooyii/Slimpajama_downsample_32k_1B
Viewer • Updated • 20.5k • 14 -
Leooyii/Slimpajama_downsample_64k_1B
Viewer • Updated • 10.3k • 10 -
Leooyii/Slimpajama_downsample_4k_1B
Viewer • Updated • 164k • 15 -
Leooyii/Slimpajama_downsample_64k_2B
Viewer • Updated • 20.5k • 5 -
Leooyii/manyshots_trec
Viewer • Updated • 3k • 9