taufeeque
/

TokFSM_k1_codebook_model

Generated from Trainer

Eval Results (legacy)

Model card Files Files and versions

taufeeque commited on Oct 8, 2023

Commit

917144d

·

1 Parent(s): d2a7b67

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -3,7 +3,7 @@
     "GPTNeoXCodebookModel"
   ],
   "codebook_at": [
-    "preproj_attention",
     "mlp"
   ],
   "codebook_kwargs": {},

     "GPTNeoXCodebookModel"
   ],
   "codebook_at": [
+    "attn_preproj",
     "mlp"
   ],
   "codebook_kwargs": {},