Home Explore Help
Register Sign In
ai
/
OpenHands
2
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Tree: 5f52eebb40
Branches Tags
OpenHands
/
docs
/
modules
/
usage
/
llms
/
litellm-proxy.md

litellm-proxy.md 984 B
History Raw

LiteLLM Proxy

OpenHands supports using the LiteLLM proxy to access various LLM providers.

Configuration

To use LiteLLM proxy with OpenHands, you need to:

  1. Set up a LiteLLM proxy server (see LiteLLM documentation)
  2. When running OpenHands, you'll need to set the following in the OpenHands UI through the Settings:
    • Enable Advanced Options
    • Custom Model to the prefix litellm_proxy/ + the model you will be using (e.g. litellm_proxy/anthropic.claude-3-5-sonnet-20241022-v2:0)
    • Base URL to your LiteLLM proxy URL (e.g. https://your-litellm-proxy.com)
    • API Key to your LiteLLM proxy API key

Supported Models

The supported models depend on your LiteLLM proxy configuration. OpenHands supports any model that your LiteLLM proxy is configured to handle.

Refer to your LiteLLM proxy configuration for the list of available models and their names.