MLX
Safetensors
mistral

mlx-community/Mistral-Nemo-Instruct-2407-bf16

The Model mlx-community/Mistral-Nemo-Instruct-2407-bf16 was converted to MLX format from mistralai/Mistral-Nemo-Instruct-2407 using mlx-lm version 0.16.0.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Mistral-Nemo-Instruct-2407-bf16")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Downloads last month
52
Safetensors
Model size
12B params
Tensor type
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including mlx-community/Mistral-Nemo-Instruct-2407-bf16