Skip to content

Cohere API embedding inference

Authentication

To provide an API key to authenticate to OpenAI API, use the COHERE_API environment variable when starting Nixiesearch:

docker run -it -e COHERE_API=<thekey> nixiesearch/nixiesearch <opts>

Usage

To define an Cohere embedding model in the config file, use the following snippet:

inference:
  embedding:
    <model-name>:
      provider: cohere
      model: embed-english-v3.0

The full configuration with all default options:

inference:
  embedding:
    <model-name>:
      provider: cohere
      model: embed-english-v3.0
      timeout: 2000ms
      endpoint: "https://api.cohere.com/"
      batch_size: 32

Parameters:

  • timeout: optional, duration, default 2s. External APIs might be slow sometimes.
  • batch_size: optional, int, default 32. Batch size for calls with many documents.

See Config file reference for more details on creating a config file.