cai/examples/triage_agent

Triage agent

This example is a CAI containing a triage agent, which takes in user inputs and chooses whether to respond directly, or triage the request to a sales or refunds agent.

Setup

To run the triage agent CAI:

1. Run

python3 run.py

Evals

[!NOTE] These evals are intended to be examples to demonstrate functionality, but will have to be updated and catered to your particular use case.

This example uses Pytest to run eval unit tests. We have two tests in the evals.py file, one which tests if we call the correct triage function when expected, and one which assesses if a conversation is 'successful', as defined in our prompt in evals.py.

To run the evals, run

pytest evals.py