Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,9 @@ library_name: transformers
|
|
| 10 |
---
|
| 11 |
> [!NOTE]
|
| 12 |
> <br> If you are using `llama.cpp`, use `--jinja`
|
| 13 |
-
>
|
|
|
|
|
|
|
| 14 |
<div>
|
| 15 |
<p style="margin-top: 0;margin-bottom: 0;">
|
| 16 |
<em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
|
|
|
|
| 10 |
---
|
| 11 |
> [!NOTE]
|
| 12 |
> <br> If you are using `llama.cpp`, use `--jinja`
|
| 13 |
+
> ```
|
| 14 |
+
> ./llama.cpp/llama-cli -hf unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_XL.gguf -ngl 99 --jinja --temp 0.7 --top-k 20 --top-p 0.8 --repeat-penalty 1.05
|
| 15 |
+
> ```
|
| 16 |
<div>
|
| 17 |
<p style="margin-top: 0;margin-bottom: 0;">
|
| 18 |
<em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
|