From 23d46783907a09f148ce2adcb910ec297d9dc107 Mon Sep 17 00:00:00 2001 From: lidia9 Date: Fri, 9 May 2025 15:27:17 +0200 Subject: [PATCH] update readme --- benchmarks/README.md | 18 +++++++++--------- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/benchmarks/README.md b/benchmarks/README.md index 8ecff7e3..f4ceb41e 100644 --- a/benchmarks/README.md +++ b/benchmarks/README.md @@ -51,7 +51,7 @@ Output: ``` #### 🔍 Examples -Below are examples showing how to run different CTI Bench tests with the Qwen 2.5 14B model using Ollama as the backend: +How to run different CTI Bench tests with the "llama/qwen2.5:14b" model using Ollama as the backend: ```bash python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/cybermetric/CyberMetric-2-v1.json --eval cybermetric --backend ollama @@ -59,13 +59,13 @@ python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/c ```bash python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/seceval/eval/datasets/questions-2.json --eval seceval --backend ollama +``` + +How to run different CTI Bench tests with the "qwen/qwen3-32b:free" model using Openrouter as the backend: + +```bash +python benchmarks/eval.py --model qwen/qwen3-32b:free --dataset_file benchmarks/cti_bench/data/cti-mcq1.tsv --eval cti_bench --backend openrouter ```` ```bash -python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/cti_bench/data/cti-mcq1.tsv --eval cti_bench --backend ollama -```` -```bash -python benchmarks/eval.py --model ollama/qwen2.5:14b --dataset_file benchmarks/cti_bench/data/cti-ate2.tsv --eval cti_bench --backend ollama -```` -```bash -python benchmarks/eval.py --model qwen/qwen3-32b:free --dataset_file benchmarks/cybermetric/CyberMetric-2-v1.json --eval cybermetric --backend openrouter -``` \ No newline at end of file +python benchmarks/eval.py --model qwen/qwen3-32b:free --dataset_file benchmarks/cti_bench/data/cti-ate2.tsv --eval cti_bench --backend openrouter +```` \ No newline at end of file