Supported providers
We support multiple LLM providers under a unified interface.
Besides the table below, other providers can be used as an OpenAI-compatible API by specifying the baseUrl option in the OpenAIChatModel configuration.
| Provider | Sampling Params | Function Calling | Structured Output | Reasoning | Citation 1 | Text Input | Image Input | Audio Input | Text Output | Image Output | Audio Output |
|---|---|---|---|---|---|---|---|---|---|---|---|
| OpenAI (Responses) | ✅ except top_k,frequency_penalty, presence_penalty, seed | ✅ | ✅ | ✅ | ➖ | ✅ | ✅ | ✅ | ✅ | ✅ | ➖ |
| OpenAI (Chat Completion) | ✅ except top_k | ✅ | ✅ | ➖ | ➖ | ✅ | ✅ | ✅ | ✅ | ➖ | ✅ |
| Anthropic | ✅ except frequency_penalty, presence_penalty, seed | ✅ | ➖ | ✅ | ✅ (Search results) | ✅ | ✅ | ➖ | ✅ | ➖ | ➖ |
| ✅ | ✅ | ✅ | ✅ | ➖ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | |
| Cohere | ✅ | ✅ | ✅ | ✅ | ✅ (Document) | ✅ | ✅ | ➖ | ✅ | ➖ | ➖ |
| Mistral | ✅ except top_k | ✅ | ✅ | ✅ | 🚧 | ✅ | ✅ | ✅ | ✅ | ➖ | ➖ |
Keys:
- ✅: Supported
- 🚧: Not yet implemented
- ➖: Not available from provider
Footnotes
Section titled “Footnotes”-
Source Input (citation) is not supported by all providers and may be converted to compatible inputs instead. ↩