Spotlight
Spotlight is the Shinzo Platform’s AI model proxy service. It forwards requests to AI providers (like Anthropic) while automatically tracking usage, tokens, costs, and session analytics.Features
- Model Proxy: Forward requests to AI providers with automatic retry and error handling
- Token Tracking: Track input/output tokens, cache hits, and costs
- Session Analytics: Group API calls into sessions for analysis
- Streaming Support: Full support for streaming responses with Server-Sent Events
- Multi-Auth: Authenticate with JWT tokens or Platform API keys
Supported Providers
Authentication
Spotlight endpoints accept either:- JWT Token:
Authorization: Bearer <jwt_token> - Platform API Key:
x-shinzo-api-key: <api_key>orAuthorization: Bearer <api_key>
Provider Credentials
Spotlight needs credentials to make requests to AI providers. You can:- Store credentials in Shinzo using Provider Keys (recommended)
- Pass credentials directly in the request using the
x-api-keyheader
Endpoints
Model Proxy
Analytics
Session Sharing
Session Tracking
Requests are grouped into sessions using themetadata.user_id field in your API requests:
user_id is provided, requests are grouped under a default-session.
