RomanNum3ral
/
cai
mirror of https://github.com/aliasrobotics/cai.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Add some additional bits to README.md 

Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
This commit is contained in:
Víctor Mayoral Vilches 2025-03-24 17:26:11 +01:00
parent 012f1caf90
commit cec4dbe54a
1 changed files with 15 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
README.md
View File

@ -180,7 +180,12 @@ We're committed to continuing to build the Agents SDK as an open source framewor
## LiteLLM Proxy Server integration
Testing some basic models:
```bash
# launch proxy
litellm --config config.yaml
```
Testing some basic models against proxy to verify it's operational:
```bash
# qwen2.5:14b
curl -s http://localhost:4000/v1/chat/completions -H "Content-Type: application/json" -d '{"model": "qwen2.5:14b", "messages": [{"role": "user", "content": "Say hi"}], "max_tokens": 10}' | jq
@ -190,4 +195,12 @@ curl -s http://localhost:4000/v1/chat/completions -H "Content-Type: application/
# gpt-4o
curl -s http://localhost:4000/v1/chat/completions -H "Content-Type: application/json" -d '{"model": "gpt-4o", "messages": [{"role": "user", "content": "Say hi"}], "max_tokens": 10}' | jq
```
```
Launch the Agents SDK with the proxy server:
```bash
python3 examples/agent_patterns/litellm.py
```
Additional docs:
- LiteLLM admin UI https://docs.litellm.ai/docs/proxy/ui