RomanNum3ral
/
cai
mirror of https://github.com/aliasrobotics/cai.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Fix .gitmodules and add it to README 

Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
This commit is contained in:
Víctor Mayoral Vilches 2025-05-08 17:39:30 +02:00
parent 1055b65270
commit a04282a491
2 changed files with 9 additions and 9 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
.gitmodules vendored
View File

@ -1,9 +1,9 @@
[submodule "benchmark/seceval"] [submodule "benchmarks/seceval"]
path = benchmark/seceval path = benchmarks/seceval
url = https://github.com/XuanwuAI/SecEval.git url = https://github.com/XuanwuAI/SecEval.git
[submodule "benchmark/cybermetric"] [submodule "benchmarks/cybermetric"]
path = benchmark/cybermetric path = benchmarks/cybermetric
url = https://github.com/cybermetric/CyberMetric.git url = https://github.com/cybermetric/CyberMetric.git
[submodule "benchmark/cti_bench"] [submodule "benchmarks/cti_bench"]
path = benchmark/cti_bench path = benchmarks/cti_bench
url = https://github.com/xashru/cti-bench.git url = https://github.com/xashru/cti-bench.git

6
benchmarks/README.md
View File

@ -27,7 +27,9 @@ SecEval is a benchmark designed to evaluate large language models (LLMs) on secu
#### ▶️ Usage #### ▶️ Usage
```bash ```bash
git submodule update --init --recursive # init submodules
cd benchmarks/seceval/eval cd benchmarks/seceval/eval
pip install -r requirements.txt pip install -r requirements.txt
``` ```
@ -47,10 +49,8 @@ CyberMetric is a benchmark framework that focuses on measuring the performance o
#### ▶️ Usage #### ▶️ Usage
```bash ```bash
git submodule update --init --recursive # init submodules
cd benchmarks/cybermetric cd benchmarks/cybermetric
```
```bash
python3 CyberMetric_evaluator.py --model_name ollama/qwen2.5:14b --file_path CyberMetric-2-v1.json python3 CyberMetric_evaluator.py --model_name ollama/qwen2.5:14b --file_path CyberMetric-2-v1.json
``` ```