New Relic launches AI Evaluation to link AI quality with production performance
New Relic has introduced AI Evaluation, a capability within its AI Observability platform designed to help enterprises monitor AI response quality, identify security risks, and assess the business impact of AI workloads across the application lifecycle.
The capability extends beyond evaluating individual large language model (LLM) calls by linking AI performance and response quality to the underlying application transaction. It aims to give developers, site reliability engineers (SREs), and platform teams a unified view of AI behaviour, infrastructure performance, and resource consumption, from development through production.
As enterprises deploy generative AI applications in business-critical environments, traditional application performance metrics alone may not reveal issues such as hallucinations, prompt injection attacks, data leaks, or declining response quality following model updates.
New Relic AI Evaluation addresses these challenges by integrating AI quality assessments with application performance monitoring and distributed tracing. The platform uses an asynchronous LLM-as-a-judgeservice to evaluate sampled inputs and...
Copyright of this story solely belongs to www.expresscomputer.in. To see the full text click HERE
