Skip to content
llm-sdk llm-sdk llm-sdk

llm-sdk

llm-sdk is a suite of libraries to interact with various Large Language Model (LLM) providers through a unified API and build agentic AI applications.

Two libraries are provided:

  • LLM SDK: Unified SDKs to interact with various LLM providers.
  • LLM Agent: An abstraction to build agentic AI applications using the LLM SDK.

Check out the Console Application for a demo application that showcases the capabilities of the libraries.

Console Chat UI

Features

Section titled “Features”
  • Supports multiple LLM providers with a unified API.
  • Handles multiple modalities: Text, Image, and Audio.
  • Supports streaming, including for image and audio.
  • Supports citations and reasoning for supported models.
  • Reports token usage and calculates the cost of a request when provided with the model’s pricing information.
  • Unified serialization across programming languages (systems in different languages can work together).
  • Integrates OpenTelemetry for tracing.