mirror of https://github.com/aliasrobotics/cai.git
add data sets for cti
This commit is contained in:
parent
d7837ee0ff
commit
e7b1d04963
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because it is too large
Load Diff
|
|
@ -0,0 +1,3 @@
|
|||
URL Question Option A Option B Option C Option D Prompt GT
|
||||
https://attack.mitre.org/techniques/T1548/ Which of the following mitigations involves preventing applications from running that haven't been downloaded from legitimate repositories? Audit Execution Prevention Operating System Configuration User Account Control You are given a multiple-choice question (MCQ) from a Cyber Threat Intelligence (CTI) knowledge benchmark dataset. Your task is to choose the best option among the four provided. Return your answer as a single uppercase letter: A, B, C, or D. **Question:** Which of the following mitigations involves preventing applications from running that haven't been downloaded from legitimate repositories? **Options:** A) Audit B) Execution Prevention C) Operating System Configuration D) User Account Control **Important:** The last line of your answer should contain only the single letter corresponding to the best option, with no additional text. B
|
||||
https://attack.mitre.org/techniques/T1548/ Which data source is recommended for monitoring commands that may circumvent mechanisms designed to control elevation of privileges? Command File Process User Account You are given a multiple-choice question (MCQ) from a Cyber Threat Intelligence (CTI) knowledge benchmark dataset. Your task is to choose the best option among the four provided. Return your answer as a single uppercase letter: A, B, C, or D. **Question:** Which data source is recommended for monitoring commands that may circumvent mechanisms designed to control elevation of privileges? **Options:** A) Command B) File C) Process D) User Account **Important:** The last line of your answer should contain only the single letter corresponding to the best option, with no additional text. D
|
||||
|
File diff suppressed because it is too large
Load Diff
File diff suppressed because one or more lines are too long
|
|
@ -0,0 +1,3 @@
|
|||
URL Description Prompt GT
|
||||
https://nvd.nist.gov/vuln/detail/CVE-2024-23848 In the Linux kernel through 6.7.1, there is a use-after-free in cec_queue_msg_fh, related to drivers/media/cec/core/cec-adap.c and drivers/media/cec/core/cec-api.c. Analyze the following CVE description and map it to the appropriate CWE. Provide a brief justification for your choice. Ensure the last line of your response contains only the CWE ID. CVE Description: In the Linux kernel through 6.7.1, there is a use-after-free in cec_queue_msg_fh, related to drivers/media/cec/core/cec-adap.c and drivers/media/cec/core/cec-api.c. CWE-416
|
||||
https://nvd.nist.gov/vuln/detail/CVE-2023-38738 IBM OpenPages with Watson 8.3 and 9.0 could provide weaker than expected security in a OpenPages environment using Native authentication. If OpenPages is using Native authentication an attacker with access to the OpenPages database could through a series of specially crafted steps could exploit this weakness and gain unauthorized access to other OpenPages accounts. IBM X-Force ID: 262594. Analyze the following CVE description and map it to the appropriate CWE. Provide a brief justification for your choice. Ensure the last line of your response contains only the CWE ID. CVE Description: IBM OpenPages with Watson 8.3 and 9.0 could provide weaker than expected security in a OpenPages environment using Native authentication. If OpenPages is using Native authentication an attacker with access to the OpenPages database could through a series of specially crafted steps could exploit this weakness and gain unauthorized access to other OpenPages accounts. IBM X-Force ID: 262594. CWE-257
|
||||
|
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
|
|
@ -0,0 +1,2 @@
|
|||
URL Description Prompt GT
|
||||
https://nvd.nist.gov/vuln/detail/CVE-2024-23848 In the Linux kernel through 6.7.1, there is a use-after-free in cec_queue_msg_fh, related to drivers/media/cec/core/cec-adap.c and drivers/media/cec/core/cec-api.c. Analyze the following CVE description and calculate the CVSS v3.1 Base Score. Determine the values for each base metric: AV, AC, PR, UI, S, C, I, and A. Summarize each metric's value and provide the final CVSS v3.1 vector string. Valid options for each metric are as follows: - **Attack Vector (AV)**: Network (N), Adjacent (A), Local (L), Physical (P) - **Attack Complexity (AC)**: Low (L), High (H) - **Privileges Required (PR)**: None (N), Low (L), High (H) - **User Interaction (UI)**: None (N), Required (R) - **Scope (S)**: Unchanged (U), Changed (C) - **Confidentiality (C)**: None (N), Low (L), High (H) - **Integrity (I)**: None (N), Low (L), High (H) - **Availability (A)**: None (N), Low (L), High (H) Summarize each metric's value and provide the final CVSS v3.1 vector string. Ensure the final line of your response contains only the CVSS v3 Vector String in the following format: Example format: CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:H/I:H/A:H CVE Description: In the Linux kernel through 6.7.1, there is a use-after-free in cec_queue_msg_fh, related to drivers/media/cec/core/cec-adap.c and drivers/media/cec/core/cec-api.c. CVSS:3.1/AV:L/AC:L/PR:L/UI:N/S:U/C:N/I:N/A:H
|
||||
|
|
|
@ -70,7 +70,7 @@ benchmarks-test-cti_bench-openrouter:
|
|||
<<: *run_benchmarks
|
||||
variables:
|
||||
MODEL_NAME: "openrouter/qwen/qwen3-32b:free"
|
||||
BENCHMARK_FILE: "benchmarks/dataset_cti_bench/cti-mcq1.tsv"
|
||||
BENCHMARK_FILE: "benchmarks/utils/cti_bench_dataset/cti-mcq1.tsv"
|
||||
BENCHMARK_NAME: "cti_bench"
|
||||
BACKEND: "openrouter"
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue