Did your application get better or worse?

Testing is hard, which is why developers tend to avoid it. Testing non-deterministic things is even harder, which is unfortunate, since we're all writing AI-infused applications, and AI models are notoriously non-deterministic. What happens when the applications start using advanced features, such as RAG, tools, and agents? How do you test these applications? There must be some tools, technologies, and practices out there that can help, while not costing your organization lots of money! Join Eric as he visits a topic he’s been chasing for well over a year. The AI landscape changes at a breathtaking pace, so what new capabilities and strategies are available? Hopefully by the end of the presentation you will be able to answer the question "If I change my model/prompt/application, did I get…