When the Demo Works
but Production Fails:
Leading Quality in the AI Era
About Topic
In today’s rapidly evolving development landscape, quality leadership faces unprecedented challenges as AI integration makes applications increasingly non-deterministic. Ben Hofferber draws from his extensive experience at The Link, Rangle.io, and Hint Services to illuminate the core problems quality leaders must address when “user acceptance doesn’t validate system resilience.”
This session explores the fundamental shift happening as Agentic AI systems depend on error identification for grounding, creating an inseparable link between quality and development. With the data needed to improve AI systems now living directly in production rather than staging, traditional testing paradigms require significant rethinking. Ben shares perspective on balancing accelerated development with quality assurance when dealing with systems whose behavior can’t be fully predicted.
Attendees will gain practical insights on transitioning from acceptance-focused testing to resilience frameworks, transforming test automation approaches for non-deterministic components, and establishing meaningful metrics to evaluate AI improvements. Join this forward-looking session to explore the complex challenges of quality leadership in the AI era—where best practices are still emerging, but addressing fundamental quality problems cannot wait.
Key Takeaways
1. Innovation creates noise, making obvious truths harder to see.
2. Question if a problem really needs GenAI or if existing tools suffice.
3. Understand GenAI’s true value beyond the hype.
4. Old and new solutions should complement, not replace, each other.
5. A real-world case study shows how GenAI can be used effectively.
6. Clarity comes from cutting through illusions and embracing simplicity.
About Speaker
Ben Hofferber is a technical consultant with a strong background in web development and strategy consulting, having honed these skills at Rangle.io before founding Hint Services. At Hint Services, Ben provided AI solutions and shared thought leadership through the Stable Discussion YouTube channel.
Currently serving as the Head of Engineering at The LNK, Ben is focused on building an innovative logistics platform that enables e-commerce brands to ship globally. With a passion for cutting-edge AI solutions, Ben continuously seeks opportunities to help teams implement advanced technologies and leverage them to enhance customer experiences.
Topic details coming soon..
Other Speakers at QonfX 2025
San Francisco
Atomic Talk Title: 7 Highly Valuable Approaches for REST API Testing
It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout. The point of using Lorem Ipsum is that it has
It is a long established fact that a reader will be distracted by the readable conte
will be distracted by the readable content.
Ajay Balamurugadas
Exploratory Testing
Functional Testing
San Francisco
Atomic Talk Title: 7 Highly Valuable Approaches for REST API Testing
It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout. The point of using Lorem Ipsum is that it has
It is a long established fact that a reader will be distracted by the readable conte
will be distracted by the readable content.
Ajay Balamurugadas
Exploratory Testing
Functional Testing
San Francisco
Atomic Talk Title: 7 Highly Valuable Approaches for REST API Testing
It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout. The point of using Lorem Ipsum is that it has
It is a long established fact that a reader will be distracted by the readable conte
will be distracted by the readable content.
Ajay Balamurugadas
Exploratory Testing
Functional Testing
San Francisco
Atomic Talk Title: 7 Highly Valuable Approaches for REST API Testing
It is a long established fact that a reader will be distracted by the readable content of a page when looking at its layout. The point of using Lorem Ipsum is that it has
It is a long established fact that a reader will be distracted by the readable conte
will be distracted by the readable content.
Ajay Balamurugadas
Exploratory Testing
Functional Testing