OpenHands/docs/modules/usage/llms/openai-llms.md

OpenAI

OpenHands uses LiteLLM to make calls to OpenAI's chat models. You can find their documentation on using OpenAI as a provider here.

Configuration

When running OpenHands, you'll need to set the following in the OpenHands UI through the Settings under the LLM tab:

• LLM Provider to OpenAI
• LLM Model to the model you will be using. Visit here to see a full list of OpenAI models that LiteLLM supports. If the model is not in the list, enable Advanced options, and enter it in Custom Model (e.g. openai/<model-name> like openai/gpt-4o).
• API Key to your OpenAI API key. To find or create your OpenAI Project API Key, see here.

Using OpenAI-Compatible Endpoints

Just as for OpenAI Chat completions, we use LiteLLM for OpenAI-compatible endpoints. You can find their full documentation on this topic here.

Using an OpenAI Proxy

If you're using an OpenAI proxy, in the OpenHands UI through the Settings under the LLM tab:

1. Enable Advanced options
2. Set the following:
   • Custom Model to openai/<model-name> (e.g. openai/gpt-4o or openai/<proxy-prefix>/<model-name>)
   • Base URL to the URL of your OpenAI proxy
   • API Key to your OpenAI API key