Jailbreak attempts
Configuration, evaluation scope, and practical limits for jailbreak.
jailbreak is the policy type used by the API and policy editor.
What it checks
Checks LLM input and, by default, output for known jailbreak patterns and optionally a model classifier.
Configure the policy
Create a policy under Dashboard → Security → Policies. Choose this policy type, set the agent scope, and start in warning mode while you measure results. Use blocking only after verifying the application’s decision gate.
The following is the config object, not a complete policy-creation request:
{
"threshold": 0.75,
"use_ml": true,
"check_output": true
}Scope and limits
Disabling use_ml reduces this to pattern coverage. Model absence can leave degraded coverage. The check evaluates submitted text; it does not maintain an independent multi-turn conversation history or automatically inspect images.
Verify before rollout
Test a representative safe input, a synthetic positive case, and an unavailable-detector case. Inspect evaluation_status, errors, policies_evaluated, findings and allowed. A clean empty finding list is useful only when the required checks completed.
The policy mode determines the decision: warning findings can coexist with allowed: true. Your application must act on a blocking decision before the protected operation. Evaluation does not automatically redact text or cancel an operation that already happened.