From 1354dd851f601af071e4d87192df66bea93877ea Mon Sep 17 00:00:00 2001 From: jimbas Date: Wed, 5 Nov 2025 18:30:52 +0000 Subject: [PATCH] Create lm_studio (#332) Add LM studio models --- docs/providers/lm_studio | 11 +++++++++++ 1 file changed, 11 insertions(+) create mode 100644 docs/providers/lm_studio diff --git a/docs/providers/lm_studio b/docs/providers/lm_studio new file mode 100644 index 00000000..d24afd22 --- /dev/null +++ b/docs/providers/lm_studio @@ -0,0 +1,11 @@ +# LM Studio Configuration + +#### [LM Studio Integration](https://lmstudio.ai/) +For local models using LM Studio, add the following to your .env: + +```bash +CAI_MODEL=deepseek-r1-0528-qwen3-8b #do not use the prefix, just the model name eg. deepseek/deepseek-r1-0528-qwen3-8b should be deepseek-r1-0528-qwen3-8b +OLLAMA_API_BASE=http://localhost:1234/v1 # note, maybe you have a different endpoint (1234 is the default value for LM Studio) +``` + +Make sure that the Ollama server is running and accessible at the specified base URL. You can swap the model with any other supported by your local Ollama instance.