How to setup LLM connections

To use LLMs, you have to set up connections to providers of LLMs.

The view below shows the currently defined connections. By default connections for OpenAI and Anthropic are listed. A connection has to be connectable. To make a connection that is based on an API connectable, you need to set the API key, as described in Adding an OpenAI API key or Adding an Anthropic API key.

If you have Ollama running locally, the connections registered there will also appear once you specify that it is connectable. Learn more at Working with Ollama.

The connection set as default is the one that is picked up when instantiating a chat without specifying the connection (right click on any of them and click on Make default to make them the default connector):

Once you established a default connection, test it at Moldable Agent Harness: a step-by-step tutorial.

To include locally available models from Ollama, see Managing LLM provider connections and setting the default.