gemma-2-9b-it-exl3 / README.md
turboderp's picture
Update README.md
6074f9c verified
metadata
license: gemma
base_model: google/gemma-2-9b-it
base_model_relation: quantized
quantized_by: turboderp
tags:
  - exl3

EXL3 quants of gemma-2-9b-it

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

image/png