RomanNum3ral
/
cai
mirror of https://github.com/aliasrobotics/cai.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Create lm_studio (#332) 

Add LM studio models
This commit is contained in:
jimbas 2025-11-05 18:30:52 +00:00 committed by GitHub
parent 96ba5dc07e
commit 1354dd851f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 11 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
docs/providers/lm_studio Normal file
View File

@ -0,0 +1,11 @@
# LM Studio Configuration
#### [LM Studio Integration](https://lmstudio.ai/)
For local models using LM Studio, add the following to your .env:
```bash
CAI_MODEL=deepseek-r1-0528-qwen3-8b #do not use the prefix, just the model name eg. deepseek/deepseek-r1-0528-qwen3-8b should be deepseek-r1-0528-qwen3-8b
OLLAMA_API_BASE=http://localhost:1234/v1 # note, maybe you have a different endpoint (1234 is the default value for LM Studio)
```
Make sure that the Ollama server is running and accessible at the specified base URL. You can swap the model with any other supported by your local Ollama instance.