Supported providers
We support multiple LLM providers under a unified interface.
Besides the table below, other providers can be used as an OpenAI-compatible API by specifying the baseUrl option in the OpenAIChatModel configuration.
| Provider | Sampling Params | Function Calling | Web Search | Structured Output | Reasoning | Citation 1 | Text Input | Image Input | Audio Input | Text Output | Image Output | Audio Output |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OpenAI (Responses) | ✅ except top_k,frequency_penalty, presence_penalty, seed |
✅ text, image | ✅ | ✅ | ✅ | ✅ via web search | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
| OpenAI (Chat Completion) | ✅ except top_k |
✅ text | ➖ | ✅ | ➖ | ➖ | ✅ | ✅ | ✅ | ✅ | ➖ | ✅ |
| Anthropic | ✅ except frequency_penalty, presence_penalty, seed |
✅ text, image | ✅ | ✅ | ✅ | ✅ (Search results) | ✅ | ✅ | ➖ | ✅ | ➖ | ➖ |
| ✅ | ✅ text | ✅ | ✅ | ✅ | ✅ via web search | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | |
| Cohere | ✅ | ✅ text | ➖ | ✅ | ✅ | ✅ (Document) | ✅ | ✅ | ➖ | ✅ | ➖ | ➖ |
| Mistral | ✅ except top_k |
✅ text | ➖ | ✅ | ✅ | 🚧 | ✅ | ✅ | ✅ | ✅ | ➖ | ➖ |
Keys: ✅ supported · 🚧 planned · ➖ not supported.
Footnotes
Section titled “Footnotes”-
Source Input (citation) is not supported by all providers and may be converted to compatible inputs instead. ↩