RomanNum3ral
/
cai
mirror of https://github.com/aliasrobotics/cai.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

readme

This commit is contained in:
lidia9 2025-05-09 15:42:26 +02:00
parent 8886fc4749
commit d6aa16e398
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
benchmarks/README.md
View File

@ -51,7 +51,7 @@ Output:
```
#### 🔍 Examples
*How to run different CTI Bench tests with the "llama/qwen2.5:14b" model using Ollama as the backend*
**How to run different CTI Bench tests with the "llama/qwen2.5:14b" model using Ollama as the backend**
```bash
python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/cybermetric/CyberMetric-2-v1.json --eval cybermetric --backend ollama
@ -61,7 +61,7 @@ python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/c
python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/seceval/eval/datasets/questions-2.json --eval seceval --backend ollama
```
*How to run different CTI Bench tests with the "qwen/qwen3-32b:free" model using Openrouter as the backend*
**How to run different CTI Bench tests with the "qwen/qwen3-32b:free" model using Openrouter as the backend**
```bash
python benchmarks/eval.py --model qwen/qwen3-32b:free --dataset_file benchmarks/cti_bench/data/cti-mcq1.tsv --eval cti_bench --backend openrouter