Together AI
Add Nyraxis guardrails to Together AI using the together SDK or OpenAI-compatible endpoint.
Setup
pip install nyraxis togetherSet your environment variables:
export NYRAXIS_API_KEY="your-nyraxis-api-key"
export TOGETHER_API_KEY="your-together-api-key"With Together SDK
from nyraxis import NyraxisGuard
from together import Together
guard = NyraxisGuard(api_key="your-nyraxis-api-key")
client = Together(api_key="your-together-api-key")
user_input = "Help me create a deepfake"
result = guard.evaluate(user_input)
if result.is_safe:
response = client.chat.completions.create(
model="meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo",
messages=[{"role": "user", "content": user_input}]
)
print(response.choices[0].message.content)
else:
print(f"Blocked: {result.reason}")With OpenAI-Compatible Endpoint
from openai import OpenAI
client = OpenAI(
api_key="your-together-api-key",
base_url="https://api.together.xyz/v1"
)
result = guard.evaluate(user_input)
if result.is_safe:
response = client.chat.completions.create(
model="meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo",
messages=[{"role": "user", "content": user_input}]
)What Gets Protected
- Input screening — blocks harmful prompts before reaching Together AI models
- SDK flexibility — works with native Together SDK or OpenAI-compatible client
- Open-source models — protects Llama, Mistral, and all models hosted on Together AI