Commit Graph

82 Commits

Author SHA1 Message Date
UnaiAlias 1c79507140
CAI 1.1.5 release (#455) 2026-06-05 13:43:19 +02:00
Didier Durand 68e33196ee
[Doc]: fixing typos in different files (#369) 2025-12-19 13:09:33 +01:00
Víctor Mayoral Vilches 2825450478 Add note with exemplary image
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-11-13 12:02:40 +01:00
Víctor Mayoral Vilches d74e036c20 Add clarification note on CAIBench availability
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-11-13 11:58:37 +01:00
Víctor Mayoral Vilches 9688f78679
Update README
Leave only the footnote as the main source of info.
2025-11-13 11:44:27 +01:00
Víctor Mayoral Vilches a6f60b1853
Remove CAI PRO version note from README (#342)
Clarify note about CAI PRO availability leaving the other note.
2025-11-13 11:35:58 +01:00
Francesco Balassone cd956813f0
Extended CAIBench README (#311)
* add preliminar files

* add preliminar files

* cai pro foot note

* cadd cyber PII info

* Update monolithsentinel image reference in README

* add ciberPII-bench

* Document Attack-Defense CTF framework in README

Added detailed section on Attack-Defense CTF including game structure, rules, scoring, architecture, and technical features.

* Update benchmarks/README.md

* Update README with Plot skeletons

* Added plots

* Update benchmark plots in README.md

* Added titles

* Add files via upload

* Add files via upload

* Update navigation in mkdocs.yml

---------

Co-authored-by: Maria <maria@aliasrobotics.com>
Co-authored-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-10-28 14:38:07 +01:00
Víctor Mayoral Vilches c73446b847 Align CyberPII-Bench with the rest of the benchmarks
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-06-03 08:22:21 +00:00
Mery-Sanz b3f08a22de change readme 2025-05-13 09:21:57 +02:00
Mery-Sanz 79f491efcd add pentestperf + suppoer for openai 2025-05-13 09:15:44 +02:00
Mery-Sanz 50efce06fd cybermetric json 2025-05-12 08:42:34 +02:00
Mery-Sanz cc4ada3836 update datasets 2025-05-12 08:39:17 +02:00
Mery-Sanz 1970c312e4 review path 2025-05-12 08:23:36 +02:00
Mery-Sanz 54bb4655b2 cybermetric submodule 2025-05-12 08:03:34 +02:00
Mery-Sanz 3ee4833dd6 submodule seceval 2025-05-12 07:58:30 +02:00
Mery-Sanz 433bd9bf65 add datasets 2025-05-12 07:57:01 +02:00
lidia9 c724543da1 run tests before mr 2025-05-09 16:48:52 +02:00
lidia9 d6aa16e398 readme 2025-05-09 15:42:26 +02:00
lidia9 8886fc4749 readme 2025-05-09 15:40:02 +02:00
Mery-Sanz e7b1d04963 add data sets for cti 2025-05-09 15:35:24 +02:00
Mery-Sanz d7837ee0ff Add new file 2025-05-09 13:33:09 +00:00
Mery-Sanz 5620eee859 Add new directory 2025-05-09 13:32:14 +00:00
Mery-Sanz 933149d8b5 Add new directory 2025-05-09 13:31:54 +00:00
lidia9 ce67681374 remove datset 2025-05-09 15:28:50 +02:00
lidia9 23d4678390 update readme 2025-05-09 15:27:17 +02:00
Mery-Sanz b34c37cd01 Merge branch 'benchmarks' of https://gitlab.com/aliasrobotics/alias_research/cai into benchmarks 2025-05-09 15:25:37 +02:00
Mery-Sanz 99eaf4c1e6 fix cti-bench 2025-05-09 15:25:26 +02:00
lidia9 174f40dc11 pdate readme 2025-05-09 15:14:12 +02:00
lidia9 5d02f0c381 cti_bench 2025-05-09 15:01:28 +02:00
lidia9 c420ecaf1a implement metrics for the rest of cti benchs 2025-05-09 15:00:04 +02:00
Mery-Sanz 7a5b4c12be Merge remote changes 2025-05-09 12:31:59 +02:00
Mery-Sanz 3629795b7f fix all parser respnses 2025-05-09 12:27:19 +02:00
lidia9 4306bbcf67 update readme 2025-05-09 11:25:54 +02:00
lidia9 312cdf3499 update readme 2025-05-09 11:21:24 +02:00
Mery-Sanz d9d230118f try pipleni 1 2025-05-09 10:39:50 +02:00
Mery-Sanz aa18a6fe6a add gobal eval and try pipeline 2025-05-09 09:58:18 +02:00
Mery-Sanz a6daeabeb8 add ctibenchmark 2025-05-09 07:39:39 +02:00
Víctor Mayoral Vilches fa18a09bdd Retry openai 9
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-05-08 19:42:00 +02:00
Víctor Mayoral Vilches 5845691613 Add support for OpenAI models for testing
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-05-08 18:49:41 +02:00
Víctor Mayoral Vilches 53ed345cd0 Re-try after fixes in servers
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-05-08 18:26:52 +02:00
Víctor Mayoral Vilches 984f4e5b35 Let's see how it reacts with debug
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-05-08 17:57:48 +02:00
Víctor Mayoral Vilches a04282a491 Fix .gitmodules and add it to README
Signed-off-by: Víctor Mayoral Vilches <v.mayoralv@gmail.com>
2025-05-08 17:39:30 +02:00
lidia9 1055b65270 os env 2025-05-08 16:50:54 +02:00
lidia9 0c81fa66c5 testing 2025-05-08 16:44:16 +02:00
lidia9 976b375c71 fix 2025-05-08 16:32:23 +02:00
lidia9 4f9b7ffc83 remov 2025-05-08 16:19:59 +02:00
lidia9 851b01903a test 2025-05-08 15:38:10 +02:00
Li 8d9220e58e Edit README.md 2025-05-08 13:16:37 +00:00
Mery-Sanz 1e66c916f2 ubdate readme 2025-05-08 15:05:39 +02:00
Mery-Sanz e51656eed1 add cti-benchmark 2025-05-08 14:05:02 +02:00