Want Reliable AI? It Starts with Knowing What’s Going On

Abstract

As AI becomes a mission-critical business asset, traditional monitoring tools fall short in tracking AI-specific metrics like token usage, model drift, prompt quality, and response accuracy—factors that directly impact cost, compliance, and user experience. New Relic’s AI Monitoring bridges this gap with full-stack visibility, helping you detect issues like LLM failure and performance bottlenecks before they affect users.

This hands-on workshop will show you how to confidently build and manage AI applications using Azure Open AI and New Relic. You’ll learn to achieve complete observability across your stack to optimize performance, ensure reliability, and control costs.

Through real-world scenarios, you’ll deploy an Azure Open AI model, integrate New Relic instrumentation, analyze token consumption, and troubleshoot issues using AI-specific dashboards and alerts. Join us to master the tools that keep your AI systems aligned, efficient, and enterprise-ready.

Objectives:

- Get an introduction to Azure AI Studio, Open AI SDK, and model deployments.

- Build an AI bot powered by Azure OpenAI.

- Complete the stack with instrumentation using New Relic.

- Learn how to debug AI-based applications with New Relic.

Prerequisites:

- Required: A free New Relic account. Sign up here.

- Optional but recommended: Azure Foundry access to deploy OpenAI and DALL-E 3 base models.

By invitation only