Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31

Base only

Active filters: meta-llama

Ashishkr/llama-2-medical-consultation

Text Generation • Updated Sep 26, 2023 • 16 • 5

vanta-research/mox-tiny-1

Text Generation • 8B • Updated Mar 1 • 49 • 19

monsterapi/llama2_70B_dolly15k

Updated Oct 12, 2023 • 5

monsterapi/llama2_70B_dolly15k_mergedweights

Updated Oct 14, 2023

monsterapi/mistral_7b_WizardLMEvolInstruct70k

Updated Nov 4, 2023 • 11 • 11

monsterapi/llama2_7b_WizardLMEvolInstruct70k

Updated Oct 27, 2023 • 6 • 2

monsterapi/zephyr_7b_WizardLMEvolInstruct70k

Updated Nov 4, 2023 • 5

monsterapi/gptj_6b_WizardLMEvolInstruct70k

Updated Oct 27, 2023 • 11

frizai/Pulse-v1

Updated Mar 2, 2024 • 1

prithivMLmods/Llama-3.2-1B-GGUF

Text Generation • 1B • Updated Nov 20, 2024 • 291 • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 11

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 35

roleplaiapp/Llama-3.3-70B-Instruct-Q2_K-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 13

roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 43

roleplaiapp/Llama-3.3-70B-Instruct-Q4_0-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 17 • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 33 • 1

roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_M-GGUF

Text Generation • 71B • Updated Jan 15, 2025 • 867 • 2

roleplaiapp/Llama-3.3-70B-Instruct-Q5_0-GGUF

Text Generation • 71B • Updated Jan 16, 2025 • 20

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 16, 2025 • 14

roleplaiapp/Llama-3.3-70B-Instruct-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 16, 2025 • 54

roleplaiapp/Llama-3.3-70B-Instruct-Q6_K-GGUF

Text Generation • 71B • Updated Jan 16, 2025 • 77

roleplaiapp/Llama-3.3-70B-Instruct-Q8_0-GGUF

Text Generation • 71B • Updated Jan 16, 2025 • 28

kaiquepsantos/debugai-1-8B

Text Generation • 8B • Updated Oct 25, 2025

vanta-research/mox-8b

8B • Updated Mar 1 • 13 • 5

unmodeled-tyler/vanta-research-unit-001

8B • Updated Jan 21 • 1

mradermacher/mox-tiny-1-GGUF

Text Generation • 8B • Updated Mar 7 • 247 • 1

mradermacher/mox-tiny-1-i1-GGUF

Text Generation • 8B • Updated Mar 7 • 298 • 4

xMiguel11/Wiguel

Text Generation • 1B • Updated Jun 23 • 6 • 1

uzairkhn/Llama-3.2-1B-Instruct-Uncensored

Text Generation • Updated 23 days ago • 29 • 1

mradermacher/mox-8b-GGUF

8B • Updated 8 days ago • 722