Our product team has been busy this week deploying significant changes to logs, external telemetry integrations and PII/sensitive data detection. Here are some of the updates we’ve shipped to our front end. We thank you for your continued support and collaboration, since it directly helps us continue to ship great products for our customers.

Product Updates

PII and Sensitive Data Detection

This week we leveraged our webhooks framework to introduce a prompt evaluation tool to help users detect PII or sensitive content and automatically route traffic. Our alpha integration with with the powerful evaluation engine, Patronus.ai is just one way that Radiant customers can introduce Model evaluation into their workflows. This integration will allow users to select a Patronus evaluator to inspect the contents of a prompt then route or deny access based on that content. Watch a short demo video here.

Integration with Rerank 3 by Cohere

This week we introduced a new integration for the Rerank model family from Cohere. Reranking is a powerful capability to improve responses in search workflows such as RAG and document search. We increasingly see customers deploying reranking in multi-model pipelines.

Prometheus and Grafana Integrations

This week we expanded our compatibility with third party observation tools, Prometheus and Grafana. This now gives even more options to our customers to monitor their AI applications in real time. 

Updates to Logs

This week we introduced new filter options to our unified logs to allow users to quickly identify issues with models such as searching by status. We also introduced a dynamic URL for logs so users can easily share a filtered view with their team for collaborative troubleshooting.

UI-driven weighting for load balancing

Users can now select weights for balancing request load between models, enabling more fine-grained control over how traffic is sent from the source.

About Radiant

Radiant is the Enterprise AI platform to take you from idea to production deployment. From security and governance to scaling and resiliency, we make it simple to make AI a critical part of your business. 

Try out a demo here, sign up here to get your own instance, or reach out to our founders directly at [email protected].

We’re also hiring. If you know of someone great that is interested in helping every company build AI into their products and operations, we'd love an introduction.