NSFW text
Configuration, evaluation scope, and practical limits for nsfw_detection.
nsfw_detection is the policy type used by the API and policy editor.
What it checks
Checks submitted text for adult-content signals.
Configure the policy
Create a policy under Dashboard → Security → Policies. Choose this policy type, set the agent scope, and start in warning mode while you measure results. Use blocking only after verifying the application’s decision gate.
The following is the config object, not a complete policy-creation request:
{
"threshold": 0.6,
"check_output": true
}Scope and limits
This provider processes text, not image, video or audio content. It uses a bounded prefix (currently 500 characters). Verify model readiness and domain-specific false positives before requiring a blocking outcome.
Verify before rollout
Test a representative safe input, a synthetic positive case, and an unavailable-detector case. Inspect evaluation_status, errors, policies_evaluated, findings and allowed. A clean empty finding list is useful only when the required checks completed.
The policy mode determines the decision: warning findings can coexist with allowed: true. Your application must act on a blocking decision before the protected operation. Evaluation does not automatically redact text or cancel an operation that already happened.