Skip to content

Supported providers

We support multiple LLM providers under a unified interface. Besides the table below, other providers can be used as an OpenAI-compatible API by specifying the baseUrl option in the OpenAIChatModel configuration.

Provider Sampling Params Function Calling Web Search Structured Output Reasoning Citation 1 Text Input Image Input Audio Input Text Output Image Output Audio Output
OpenAI (Responses) ✅ except top_k,frequency_penalty, presence_penalty, seed ✅ text, image ✅ ✅ ✅ ✅ via web search ✅ ✅ ➖ ✅ ✅ ➖
OpenAI (Chat Completion) ✅ except top_k ✅ text ➖ ✅ ➖ ➖ ✅ ✅ ✅ ✅ ➖ ✅
Anthropic ✅ except frequency_penalty, presence_penalty, seed ✅ text, image ✅ ✅ ✅ ✅ (Search results) ✅ ✅ ➖ ✅ ➖ ➖
Google ✅ ✅ text ✅ ✅ ✅ ✅ via web search ✅ ✅ ✅ ✅ ✅ ✅
Cohere ✅ ✅ text ➖ ✅ ✅ ✅ (Document) ✅ ✅ ➖ ✅ ➖ ➖
Mistral ✅ except top_k ✅ text ➖ ✅ ✅ 🚧 ✅ ✅ ✅ ✅ ➖ ➖

Keys: ✅ supported · 🚧 planned · ➖ not supported.

  1. Source Input (citation) is not supported by all providers and may be converted to compatible inputs instead. ↩