Instructions to use jbochi/candle-coedit-quantized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jbochi/candle-coedit-quantized with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("jbochi/candle-coedit-quantized") model = AutoModelForSeq2SeqLM.from_pretrained("jbochi/candle-coedit-quantized") - Notebooks
- Google Colab
- Kaggle
Upload model-xxl-q4k.gguf with huggingface_hub
Browse files- model-xxl-q4k.gguf +3 -0
model-xxl-q4k.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a30e77a6976cf68c0797200819cf228f7a311fce03c309dfde4e0626354aaff9
|
| 3 |
+
size 6265274656
|