Skip to main content
This guide providers more details about creating and setting AI api keys in your .env file for using Xyne’s chat feature. To use AI chat, you need to configure access credentials. You can use one of the following providers: AWS, OpenAI, Ollama, Gemini, Together AI or Fireworks AI.

AWS (Amazon Bedrock)

  • Sign in to the AWS Management Console
  • Generate your Access Key and Secret Key.
  • Add them as environment variables in your .env.default file:
    .env.default
    The AWS_REGION key is optional in the .env.default file; if not provided, it defaults to us-west-2

OpenAI

  • Create an API key from the OpenAI API settings.
  • Add it as environment variables in your .env.default file:
    .env.default

Ollama (Local LLM)

  • Install Ollama and the desired model from Ollama.
  • Add the model name in your .env.default file:
    .env.default
If you’re using Ollama, ensure the specified model is downloaded locally.
Also ensure that your downloaded ollama model is working in the host machine, you can use ollama run your_model_name your_message. This should return an output confirming ollama is working.
For quickstart mode ensure Ollama is listening from all addresses, so that docker is able to reach it.

Google AI

  • Generate your API key from Google AI Studio
  • Add them as environment variables in your .env.default file:
    .env.default

Together AI

  • Create your API key in Together AI
  • Select the model from your choice.
  • Add the following to your .env.default file:
    .env.default

Fireworks AI

  • Create your API key in Fireworks AI
  • Select the model from your choice.
  • Add the following to your .env.default file:
    .env.default

Setting up for Reasoning [Together | Fireworks | Ollama] :

For addition of only reasoning in your model, you need to add REASONING in your .env.default file:
.env.default

For example :

Reasoning with Together AI :

.env.default

Reasoning with Fireworks AI :

.env.default

Reasoning with Ollama :

.env.default

Additional BASE URL support

We’ve also added support for adding base url values for OpenAI and Together AI, along with your Open AI or Together API Key, you can the base url value:

Key Selection Order :

If multiple keys are set in the environment variable, our system follows this precedence:
Only a single provider is required to get started. This means either AWS or OpenAI, Ollama, Gemini, Together AI or Fireworks AI can be used, all of them aren’t required.