Hydra Decoding
Collection
Paper: https://arxiv.org/abs/2402.05109 | Code: https://github.com/zankner/Hydra • 3 items • Updated
How to use ankner/hydra-vicuna-7b-v1.3 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("ankner/hydra-vicuna-7b-v1.3", dtype="auto")No model card