4 Commits

Author	SHA1	Message	Date
quevedoSteven	4546033b8e	feat: round-robin NVIDIA NIM API key rotation ... Adds cai.util.nim_rotation which cycles NVIDIA_NIM_API_KEY_1..N per request, keeping under NIM per-key rate limits (~40 req/min). Rotation applies in the OpenAI-compatible LLM path and the direct httpx completion path when the API base is a NIM endpoint (api.nvidia.com). Also defaults cache_write_tokens to 0 in the streamed usage object: litellm CustomResponseUsage now requires the field while NIM usage payloads omit it, which previously aborted streaming at end of response.	2026-07-31 15:51:30 +00:00
UnaiAlias	1c79507140	CAI 1.1.5 release (#455)	2026-06-05 13:43:19 +02:00
Mery-Sanz	560ba79ed8	Add cai_model env variable (#297) ... add cai_model env variable Co-authored-by: Maria <maria@aliasrobotics.com>	2025-10-20 12:28:42 +02:00
Francesco Balassone	d0c3838874	Added .env.example	2025-05-28 16:40:13 +02:00