Skip to content

Supported providers

We support multiple LLM providers under a unified interface. Besides the table below, other providers can be used as an OpenAI-compatible API by specifying the baseUrl option in the OpenAIChatModel configuration.

Provider Sampling Params Function Calling Web Search Structured Output Reasoning Citation 1 Text Input Image Input Audio Input Text Output Image Output Audio Output
OpenAI (Responses) ✅ except top_k,frequency_penalty, presence_penalty, seed ✅ text, image ✅ via web search
OpenAI (Chat Completion) ✅ except top_k ✅ text
Anthropic ✅ except frequency_penalty, presence_penalty, seed ✅ text, image ✅ (Search results)
Google ✅ text ✅ via web search
Cohere ✅ text ✅ (Document)
Mistral ✅ except top_k ✅ text 🚧

Keys: ✅ supported · 🚧 planned · ➖ not supported.

  1. Source Input (citation) is not supported by all providers and may be converted to compatible inputs instead.