RomanNum3ral
/
cai
mirror of https://github.com/aliasrobotics/cai.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge branch 'benchmarks' of https://gitlab.com/aliasrobotics/alias_research/cai into benchmarks

This commit is contained in:
Mery-Sanz 2025-05-09 15:25:37 +02:00
parent 99eaf4c1e6 174f40dc11
commit b34c37cd01
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
benchmarks/README.md
View File

@ -51,9 +51,12 @@ Output:
```
#### 🔍 Examples
Below are examples showing how to run different CTI Bench tests with the Qwen 2.5 14B model using Ollama as the backend:
```bash
python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/cybermetric/CyberMetric-2-v1.json --eval cybermetric --backend ollama
````
```bash
python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/seceval/eval/datasets/questions-2.json --eval seceval --backend ollama
````