Sentence Similarity
sentence-transformers
PyTorch
ONNX
Safetensors
Transformers
Transformers.js
English
nomic_bert
feature-extraction
mteb
custom_code
Eval Results (legacy)
text-embeddings-inference
Instructions to use nomic-ai/nomic-embed-text-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use nomic-ai/nomic-embed-text-v1 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("nomic-ai/nomic-embed-text-v1", trust_remote_code=True) sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Transformers
How to use nomic-ai/nomic-embed-text-v1 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("nomic-ai/nomic-embed-text-v1", trust_remote_code=True) model = AutoModel.from_pretrained("nomic-ai/nomic-embed-text-v1", trust_remote_code=True, device_map="auto") - Transformers.js
How to use nomic-ai/nomic-embed-text-v1 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('feature-extraction', 'nomic-ai/nomic-embed-text-v1'); - Notebooks
- Google Colab
- Kaggle
NomicBertModel.forward() got an unexpected keyword argument 'return_dict'
#10
by edsealing - opened
Using SentenceTransformer to load the model:
model_name = 'nomic-ai/nomic-embed-text-v1'
embedmodel = SentenceTransformer(model_name, trust_remote_code=True)
return setup_model_device(embedmodel, model_name)
When attempting to call the embedding function, I receive an error.
def compute(self, docs: list[str]) -> list[Optional[Item]]:
"""Call the embedding function."""
prefixed_docs = [f"search_document {doc}" for doc in docs]
return chunked_compute_embedding(
self._model.encode, prefixed_docs, self.local_batch_size * 16, chunker=clustering_spacy_chunker
)
NomicBertModel.forward() got an unexpected keyword argument 'return_dict'
thanks for the headsup!
Just fixed and tested
from sentence_transformers import SentenceTransformer
model_name = 'nomic-ai/nomic-embed-text-v1'
embedmodel = SentenceTransformer(model_name, trust_remote_code=True)
test = ["search_query: who does shohei ohtani play for?", "search_document: shohei ohtani plays for the los angeles dodgers"]
embedmodel.encode(test)
Let me know if it doesn't work on your end
That did the trick! Fastest fix I think I've ever seen...
Cheers!
edsealing changed discussion status to closed