From cec4dbe54ac8d082328c0bd852d0bc76352d170a Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?V=C3=ADctor=20Mayoral=20Vilches?= Date: Mon, 24 Mar 2025 17:26:11 +0100 Subject: [PATCH] Add some additional bits to README.md MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Signed-off-by: Víctor Mayoral Vilches --- README.md | 17 +++++++++++++++-- 1 file changed, 15 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index ab033a4b..69d90c59 100644 --- a/README.md +++ b/README.md @@ -180,7 +180,12 @@ We're committed to continuing to build the Agents SDK as an open source framewor ## LiteLLM Proxy Server integration -Testing some basic models: +```bash +# launch proxy +litellm --config config.yaml +``` + +Testing some basic models against proxy to verify it's operational: ```bash # qwen2.5:14b curl -s http://localhost:4000/v1/chat/completions -H "Content-Type: application/json" -d '{"model": "qwen2.5:14b", "messages": [{"role": "user", "content": "Say hi"}], "max_tokens": 10}' | jq @@ -190,4 +195,12 @@ curl -s http://localhost:4000/v1/chat/completions -H "Content-Type: application/ # gpt-4o curl -s http://localhost:4000/v1/chat/completions -H "Content-Type: application/json" -d '{"model": "gpt-4o", "messages": [{"role": "user", "content": "Say hi"}], "max_tokens": 10}' | jq -``` \ No newline at end of file +``` + +Launch the Agents SDK with the proxy server: +```bash +python3 examples/agent_patterns/litellm.py +``` + +Additional docs: +- LiteLLM admin UI https://docs.litellm.ai/docs/proxy/ui \ No newline at end of file