Updated: 2026-07-07

Cohere[1] released Embed v3 in late 2023 with a concrete distinction from OpenAI and open-source embeddings: explicit document-quality signals. It doesn’t just compute embeddings; it generates them knowing whether your text is a query or a document (a potential answer), and it also assesses whether the document is well-structured or noise. This article covers what Embed v3 adds, where it beats OpenAI, and when it fits a serious RAG architecture.

What Embed v3 brings

Cohere Embed v3 introduces several changes over v2:

  • Explicit input_type: search_query, search_document, classification, clustering. The model adjusts the embedding according to purpose.

  • Quality awareness: noisy documents (lots of boilerplate, little signal) are represented so they naturally rank lower.

  • Multilingual: the embed-multilingual-v3.0 model covers 100+ languages with even quality, including Spanish, Portuguese, French, German, Arabic, Chinese and Japanese.

  • Reduced dimensions: 1024 in v3.0 vs 4096 in the large v2.0 models, cheaper storage and faster searches.

That combination of explicit quality and multilingual support is Embed v3’s real differentiator, not a marketing label.

Basic Python usage

The input_type is critical. If you index documents with search_query, retrieval quality drops noticeably, as Cohere’s documentation on embeddings[2] warns:

import cohere
co = cohere.Client("YOUR_API_KEY")

# Documents: index for RAG
docs = co.embed(
    texts=["Core inflation closed 2023 at 3.8%...", ...],
    model="embed-multilingual-v3.0",
    input_type="search_document"
).embeddings

# Query: user question
q = co.embed(
    texts=["how did inflation evolve last year?"],
    model="embed-multilingual-v3.0",
    input_type="search_query"
).embeddings[0]

Cohere vs OpenAI embeddings

Honest comparison with OpenAI text-embedding-3-small, announced in January 2024[3]:

Aspect Cohere Embed v3 OpenAI text-embedding-3-small
Dimensions 1024 1536 (adjustable)
Multilingual Excellent, 100+ on par Good, English-dominated
input_type Yes, with real impact No
Price / 1M tokens $0.10 $0.02
Data residency US/EU optional (enterprise) US by default

For pure-English RAG at high volume, OpenAI wins on price. For multilingual RAG (especially Spanish, Portuguese, or French), Embed v3 usually delivers better recall.

Where real multilingual matters

A corporate knowledge base with documents in English and Spanish is the revealing test. A Spanish query must find English docs if they’re relevant.

With OpenAI text-embedding-3-small, cross-lingual recall is acceptable, but there’s bleed: Spanish queries sometimes prioritize mediocre Spanish docs over better English ones. With Embed v3 multilingual, semantic similarity is computed better regardless of language.

For enterprises with multilingual operations, something very common in Europe, this is a real differentiator and not just a theoretical one.

Document-quality ranking

The least-documented but most interesting feature: Embed v3 is trained to produce embeddings that already include an intrinsic document-quality signal. A document full of scraped HTML boilerplate has a different direction in vector space than a well-edited one.

Practical effect: when doing top-k retrieval, low-quality docs naturally fall, even without an explicit re-ranker. This improves RAG pipeline quality without added latency. Cohere backs this up with public benchmarks on the Hugging Face MTEB leaderboard[4].

Vector-DB integration

Compatible with all popular vector stores: Pinecone, Qdrant, Weaviate with direct integrations; pgvector works unchanged with dimension=1024; Chroma and Milvus alike. The rest of the RAG stack (LangChain, LlamaIndex) has official Cohere connectors. Migration from OpenAI reduces to changing the embedding function.

The Embed v3 + Rerank combo

Embed v3 + Cohere Rerank[5] is a powerful combo for serious pipelines:

  • Broad recall with Embed v3 (top-100 by similarity).

  • Re-rank with the cross-encoder, ordering the 100 candidates with greater precision.

  • Pass the top-10 to the generator LLM.

Cohere’s and community evaluations show 10-20% relevance improvements vs embedding-only. The extra cost is small for production pipelines.

Pricing and deployment options

Three tiers:

  • Trial: usage-limited for initial evaluation.

  • Production: $0.10 per million tokens for embeddings. Rerank is billed separately, per search ($2 per 1,000 searches on the current Rerank 3.5 model, per Cohere’s pricing page[6]).

  • Enterprise: SLAs, European residency, dedicated models.

Private deployment (the model on your own infrastructure, with no data leaving it) is available for large customers. Regulated cases, such as finance or health, use it habitually.

Real limitations

  • Max length: 512 tokens. Chunking is required for long documents, standard practice in the sector and not a Cohere quirk.

  • Proprietary model: no weight access for Embed v3.

  • Price: 5x more expensive than OpenAI per volume.

  • Rate limits: with basic plans, strong spikes can saturate.

When to choose it

Choose Cohere Embed v3 if your RAG is multilingual with relevant volume, you want integrated quality signals without adding a re-ranker, you have European data-residency requirements, or you’ll use Rerank in the same pipeline. Stick with OpenAI if your domain is primarily English or unit price is dominant.

Conclusion

Cohere Embed v3 is the serious option for multilingual RAG. Its input_type and intrinsic-quality signals are real differentiators. For European and multilingual contexts, matching that quality with OpenAI means building extra pipeline (language classification, a separate re-ranker) that Cohere already ships built in. The final call depends more on your linguistic context and compliance requirements than on abstract technical preferences.

Sources

  1. Cohere
  2. Cohere’s documentation on embeddings
  3. announced in January 2024
  4. Hugging Face MTEB leaderboard
  5. Cohere Rerank
  6. Cohere’s pricing page