chore: add LITELLM_PROXY usage docs to readme

This commit is contained in:
Mahan Zendedel 2025-11-12 12:22:54 +03:30
parent d6f23c1a3c
commit 38aa90ae5a
1 changed files with 11 additions and 0 deletions

View File

@ -532,6 +532,17 @@ Or directly from the command line:
OLLAMA_API_BASE="https://custom-openai-proxy.com/v1" cai
```
Or alternatively, utilize [LiteLLM Proxy Gateway](https://docs.litellm.ai/docs/proxy/quick_start) to access all supported LLM providers through a unified interface (given that your provided proxy also supports them):
```bash
# Set environment variables to use LiteLLM proxy
export LITELLM_PROXY_API_BASE="http://localhost:4000"
export LITELLM_PROXY_API_KEY="your-proxy-key"
cai
```
See the [LiteLLM Proxy documentation](https://docs.litellm.ai/docs/proxy/quick_start) for setup instructions.
## :triangular_ruler: Architecture: