Replicate
Add Nyraxis guardrails to Replicate model predictions using the replicate SDK.
Setup
pip install nyraxis replicateSet your environment variables:
export NYRAXIS_API_KEY="your-nyraxis-api-key"
export REPLICATE_API_TOKEN="your-replicate-token"Code Example
from nyraxis import NyraxisGuard
import replicate
guard = NyraxisGuard(api_key="your-nyraxis-api-key")
user_input = "Generate harmful content about a person"
# Evaluate before model.predict()
result = guard.evaluate(user_input)
if result.is_safe:
output = replicate.run(
"meta/meta-llama-3-70b-instruct",
input={"prompt": user_input, "max_tokens": 1024}
)
print("".join(output))
else:
print(f"Blocked: {result.reason}")With Specific Model Versions
model = replicate.models.get("meta/meta-llama-3-70b-instruct")
version = model.versions.list()[0]
result = guard.evaluate(user_input)
if result.is_safe:
prediction = replicate.predictions.create(
version=version, input={"prompt": user_input}
)What Gets Protected
- Input screening — blocks harmful prompts before reaching Replicate models
- replicate.run — guards the simple run interface
- predictions.create — protects versioned prediction calls