Supported providers
We support multiple LLM providers under a unified interface.
Besides the table below, other providers can be used as an OpenAI-compatible API by specifying the baseUrl
option in the OpenAIChatModel
configuration.
Provider | Sampling Params | Function Calling | Structured Output | Text Input | Image Input | Audio Input | Citation 1 | Text Output | Image Output | Audio Output | Reasoning |
---|---|---|---|---|---|---|---|---|---|---|---|
OpenAI (Responses) | ✅ except top_k ,frequency_penalty , presence_penalty , seed | ✅ | ✅ | ✅ | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ | ✅ |
OpenAI (Chat Completion) | ✅ except top_k | ✅ | ✅ | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
Anthropic | ✅ except frequency_penalty , presence_penalty , seed | ✅ | ➖ | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ | ➖ | ✅ |
✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ➖ | ✅ | ✅ | ✅ | ✅ | |
Cohere | ✅ | ✅ | ✅ | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ | ➖ | ✅ |
Mistral | ✅ except top_k | ✅ | ✅ | ✅ | ✅ | ✅ | 🚧 | ✅ | ➖ | ➖ | ✅ |
Keys:
- ✅: Supported
- 🚧: Not yet implemented
- ➖: Not available from provider
Footnotes
Section titled “Footnotes”-
Source Input (citation) is not supported by all providers and may be converted to compatible inputs instead. ↩