Models

11,997

Full-text search

Active filters: dpo

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated Mar 31 • 1.01k • 23

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated 25 days ago • 175

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 15.7k • • 269

wololoo/Llama-3.2-3B-TR-Instruct-DPO

Text Generation • 3B • Updated Jan 9 • 28 • • 2

vmal/med-advisor-4b

Text Generation • 4B • Updated 2 days ago • 103 • 1

mradermacher/dotnet-coder-14b-GGUF

15B • Updated 13 days ago • 524 • 1

VladShash/deepseek-math-7B-lean-prover-grpo-olmo-weighed

Text Generation • 7B • Updated 2 days ago • 3.62k • 1

HCY123902/llama-3-8b-inst-dpo-on-p-twj-beta-1e-0

Text Generation • 266k • Updated 2 days ago • 263 • 1

Olak17/Qwen2.5-Coder-1.5B-Unsensored-DPO-i1-GGUF

2B • Updated 24 days ago • 3.59k • 2

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated 19 days ago • 17.8k • 57

zipaltrivedi/dotnet-coder-14b

Text Generation • 15B • Updated 15 days ago • 4.25k • 5

apol/alia-40b-distill-vapol

Text Generation • Updated 2 days ago • 1.99k • 2

F16/z-image-turbo-masked-dpo

Text-to-Image • Updated 25 days ago • • 19

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 9 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 12 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 7

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 13 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 21 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 12 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 97 • 123

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 5

ContextualAI/archangel_sft_pythia2-8b

Text Generation • 3B • Updated Jan 11, 2024 • 12 • 1

ContextualAI/archangel_sft_pythia6-9b

Text Generation • 7B • Updated Jan 11, 2024 • 15

ContextualAI/archangel_sft_pythia12-0b

Text Generation • 12B • Updated Jan 11, 2024 • 20

ContextualAI/archangel_sft_llama7b

Text Generation • 7B • Updated Jan 11, 2024 • 14 • 1

ContextualAI/archangel_sft_llama13b

Text Generation • 13B • Updated Jan 11, 2024 • 54

ContextualAI/archangel_sft_llama30b

Text Generation • 33B • Updated Jan 11, 2024 • 9

ContextualAI/archangel_slic_llama30b

Text Generation • 33B • Updated Jan 11, 2024 • 6