Ready-to-use GGUF quantizations for Ollama, llama.cpp, and local inference.
Richard Young
richardyoung
AI & ML interests
Large Language Models, LLM Evaluation, Instruction Following, Healthcare AI, Clinical AI,
Computational Neuroscience, Foundation Models, Responsible AI, AI Safety, Deep Learning,
Reinforcement Learning, NLP, MLOps, Neuroscience, Medical AI, Model Evaluation, Benchmark
Design, Open Science, Reproducible Research, Multi-Agent Systems
Recent Activity
liked a dataset 6 days ago
PurCL/astra-agent-security published a dataset 13 days ago
richardyoung/code-safety-benchmark-results updated a dataset 26 days ago
richardyoung/code-safety-benchmark-resultsOrganizations
Models with reduced safety guardrails for research purposes. Created using Heretic abliteration. Use responsibly.
High-performance LLMs optimized for Apple Silicon Macs using MLX. Run state-of-the-art models locally on M1/M2/M3/M4 Macs with unified memory.
-
richardyoung/Kimi-K2-Instruct-0905-MLX-3bit
Text Generation • 1T • Updated • 97 -
richardyoung/Kimi-K2-Instruct-0905-MLX-4bit
Text Generation • 1T • Updated • 125 • 1 -
richardyoung/Kimi-K2-Instruct-0905-MLX-2bit
Text Generation • 1T • Updated • 215 • 2 -
richardyoung/Kimi-K2-Instruct-0905-MLX-5bit
Text Generation • 1T • Updated • 82
Ready-to-use GGUF quantizations for Ollama, llama.cpp, and local inference.
Models with reduced safety guardrails for research purposes. Created using Heretic abliteration. Use responsibly.
Models and datasets for medical AI research. Includes CardioEmbed embeddings for cardiology, medical LLMs, and synthetic patient datasets.
High-performance LLMs optimized for Apple Silicon Macs using MLX. Run state-of-the-art models locally on M1/M2/M3/M4 Macs with unified memory.
-
richardyoung/Kimi-K2-Instruct-0905-MLX-3bit
Text Generation • 1T • Updated • 97 -
richardyoung/Kimi-K2-Instruct-0905-MLX-4bit
Text Generation • 1T • Updated • 125 • 1 -
richardyoung/Kimi-K2-Instruct-0905-MLX-2bit
Text Generation • 1T • Updated • 215 • 2 -
richardyoung/Kimi-K2-Instruct-0905-MLX-5bit
Text Generation • 1T • Updated • 82