snowflake-arctic-embed-l-v2.0-ko GGUF

GGUF conversion of dragonkue/snowflake-arctic-embed-l-v2.0-ko.

#1 on Korean Embedding Leaderboard (NDCG@5,10 avg: 84.77)

Files

File Quant Size
snowflake-arctic-embed-l-v2.0-ko-Q8_0.gguf Q8_0 599 MB
snowflake-arctic-embed-l-v2.0-ko-F16.gguf F16 1.15 GB

Usage with llama.cpp

llama-server -m snowflake-arctic-embed-l-v2.0-ko-Q8_0.gguf --port 9020 --embedding --pooling mean

Model Info

  • Architecture: XLM-RoBERTa (24 layers, hidden=1024)
  • Parameters: ~335M
  • Embedding dimension: 1024
  • Max sequence length: 8192
  • Korean fine-tuned version of snowflake-arctic-embed-l-v2.0
Downloads last month
107
GGUF
Model size
0.6B params
Architecture
bert
Hardware compatibility
Log In to add your hardware

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for BAEM1N/snowflake-arctic-embed-l-v2.0-ko-GGUF