Features¶

Explore the core features of the observability stack.

• PII & Injection Scanning — Protect user data and scan for prompt exploits.
• Deterministic Sampling — 1% modulo gate to control overhead.
• MiniLM Embeddings — Async 384-dimensional vector embeddings of prompt texts.
• Prometheus Metrics & Grafana — Prebuilt dashboards for monitoring latency, TTFT, cost, and error rates.
• Temporal EWMA Cost Anomaly Detection — Decoupled EWMA baseline computing & cost anomaly detection worker.