In this podcast, InfoQ spoke with Elena Samuylova from Evidently AI, on best practices in evaluating Large Language Model (LLM) based applications. She also discussed the tools for evaluating, testing and monitoring applications powered by AI technologies.

Read a transcript of this interview:  https://bit.ly/4mHAKvN 

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:
www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (October 15-16, 2025)
Essential insights on critical software development priorities.
devsummit.infoq.com/conference/munich2025

QCon San Francisco 2025 (November 17-21, 2025)
Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.
qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)
ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)
qconlondon.com/

The InfoQ Podcasts:
Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast www.infoq.com/podcasts/
- Engineering Culture Podcast by InfoQ www.infoq.com/podcasts/#engineering_culture
- Generally AI: www.infoq.com/generally-ai-podcast/

Follow InfoQ:
- Mastodon: techhub.social/@infoq
- X: x.com/InfoQ?from=@
- LinkedIn: www.linkedin.com/company/infoq/
- Facebook: www.facebook.com/InfoQdotcom#
- Instagram: www.instagram.com/infoqdotcom/?hl=en
- Youtube: www.youtube.com/infoq
- Bluesky: bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.
- Join a community of experts.
- Increase your visibility.
- Grow your career.
www.infoq.com/write-for-infoq

Transcript

Elena Samuylova on Large Language Model (LLM) Based Application Evaluation and LLM as a Judge

Software engineers, architects and team leads have found inspiration to drive change and innovation in their team by listening to the weekly InfoQ Podcast. They have received essential information that helped them validate their software development map. We have achieved that by interviewing some of the top CTOs, engineers and technology directors from companies like Uber, Netflix and more. Over 1,200,000 downloads in the last 3 years.

New tracks tagged #LLM Benchmarks