Models

929

Full-text search

Active filters: orpo, trl

jyc0325/Qwen2.5-7B-ORPO-code

Text Generation • Updated Jul 1, 2025 • 1

jyc0325/Qwen2.5-1.5B-ORPO-code

Text Generation • 2B • Updated Jul 2, 2025 • 3

jyc0325/Qwen2.5-1.5B-ORPO-code-fix

Text Generation • 2B • Updated Jul 3, 2025 • 3

jyc0325/Qwen2.5-1.5B-ORPO-vezora

Text Generation • 2B • Updated Jul 7, 2025 • 3

jyc0325/Qwen2.5-1.5B-ORPO-vcpp

Text Generation • 2B • Updated Jul 7, 2025 • 3

jyc0325/Qwen2.5-1.5B-ORPO-code-hard

Text Generation • 2B • Updated Jul 8, 2025 • 7

jyc0325/Qwen2.5-1.5B-SFT-ORPO

Text Generation • 2B • Updated Jul 9, 2025 • 3

mradermacher/sokol-1.5b-orpo-GGUF

2B • Updated Jul 10, 2025 • 10

mradermacher/sokol-1.5b-orpo-i1-GGUF

2B • Updated Jul 10, 2025 • 4

Kyleyee/Qwen2.5-1.5B-ropo-hh

Text Generation • 2B • Updated Jul 25, 2025 • 2

Eehan/Qwen2.5-1.5B-orpo-flip-hh

Text Generation • 2B • Updated Jul 28, 2025 • 4

Eehan/pythia-1b-orpo-flip-tldr

Text Generation • 1B • Updated Jul 28, 2025 • 3

Eehan/pythia-1b-orpo-tldr

Text Generation • 1B • Updated Jul 29, 2025 • 3

Dalfaxy/mt0_xl_french_detox_v3-beam-groups

Updated Aug 11, 2025

ShaunM1/pubmedqa-orpo-llama-3.1-8b

Text Generation • Updated Aug 13, 2025

alexxbobr/SFT5000stepsORPO5000steps

Text Generation • 0.5B • Updated Aug 13, 2025 • 2

alexxbobr/ORPO5000stepsclear

Text Generation • 0.5B • Updated Aug 13, 2025 • 3

alexxbobr/ORPO10000stepsclear

Text Generation • 0.5B • Updated Aug 14, 2025 • 4

ntraore/dbenv-week2-HW2-orpo

Text Generation • 0.1B • Updated Aug 14, 2025 • 2

neko-llm/Qwen3-32B-DPO-test

Text Generation • Updated Aug 16, 2025 • 3

manasvininid/exp-qwen3b-orpo

Text Generation • Updated Aug 16, 2025

miyako6105/Qwen3-32B-ORPO-test

Text Generation • 677k • Updated Aug 17, 2025 • 3

miyako6105/Qwen3-235B-ORPO-test

Updated Aug 24, 2025

TTahir/act-therapist-orpo-llama31-3b-2025-08-20

Text Generation • Updated Aug 20, 2025

ntkhoi/Qwen3-4B-Medical-SFT-ORPO-0820

Text Generation • 4B • Updated Aug 21, 2025 • 1

ntkhoi/Qwen3-4B-Medical-CPT-ORPO-0820

Text Generation • 4B • Updated Aug 21, 2025 • 1

TTahir/act-therapist-orpo-llama31-3b-2025-08-25

Text Generation • Updated Aug 25, 2025

mradermacher/Llama-3.1-8B-sft-gen-dpo-10k-ORPO-GGUF

8B • Updated Aug 30, 2025 • 2

mradermacher/Llama-3.1-8B-sft-SPIN-Llama-3.1-70B-Instruct-ORPO-GGUF

8B • Updated Sep 2, 2025 • 11 • 1

mradermacher/Llama-3.1-8B-sft-all-pool-ORPO-GGUF

8B • Updated Sep 3, 2025 • 17