Skip to content
llm-sdk llm-sdk llm-sdk

llm-sdk

Get started with Agent Learn how to build LLM applications using llm-agent.
Get started with SDK Use various LLM providers with a unified interface using llm-sdk.

llm-sdk is a suite of libraries to interact with various Large Language Model (LLM) providers through a unified API and build LLM applications.

Two libraries are provided:

  • LLM SDK: Unified SDKs to interact with various LLM providers.
  • LLM Agent: An abstraction to build LLM applications using the LLM SDK.

Check out the Console Application for a demo application that showcases the capabilities of the libraries.

Console Chat UI

Features

Section titled “Features”
  • Supports multiple LLM providers with a unified API.
  • Handles multiple modalities: Text, Image, and Audio.
  • Supports streaming, including for image and audio.
  • Supports multi-modality tool results (image/audio returned from tools).
  • Supports citations (RAG) and reasoning for supported models.
  • Reports token usage and calculates the cost of a request when provided with the model’s pricing information.
  • Unified serialization across programming languages (systems in different languages can work together).
  • Integrates OpenTelemetry for tracing.