Media Summary: In this comprehensive talk (adapted from my presentation at ODSC), I provide a practical, hands-on GenAI is reshaping the product landscape, creating huge opportunities (along with new expectations) for product managers. This hands-on workshop will guide participants through the complete

Framework For Evaluating Generative Ai - Detailed Analysis & Overview

In this comprehensive talk (adapted from my presentation at ODSC), I provide a practical, hands-on GenAI is reshaping the product landscape, creating huge opportunities (along with new expectations) for product managers. This hands-on workshop will guide participants through the complete With the newfound prevalence of applications built with large language models (LLMs) including features such as Retrieval ...

Photo Gallery

A Practical Guide to Evaluating Generative AI Applications - Updated Nov 2025
LLM as a Judge: Scaling AI Evaluation Strategies
Lesson 3A: What is generative AI? (Deep Dive) | AI Fluency: Framework & Foundations Course
Evaluation for Generative AI - A simply explained starting point
Framework for Evaluating Generative AI Use Cases - Barak Turovsky
Shipping AI That Works: An Evaluation Framework for PMs – Aman Khan, Arize
Ensure AI Agents Work: Evaluation Frameworks for Scaling Success — Aparna Dhinkaran, CEO Arize
WWDC26: Meet the Evaluations framework | Apple
Lightning Round: Framework for Evaluating GenAI; Using Gen AI for OER; Gen AI for Curriculum Mapping
How to Systematically Setup LLM Evals (Metrics, Unit Tests, LLM-as-a-Judge)
Evaluating LLM-based chatbots: A framework for reliable AI assistants
[Evals Workshop] Mastering AI Evaluation: From Playground to Production
View Detailed Profile
A Practical Guide to Evaluating Generative AI Applications - Updated Nov 2025

A Practical Guide to Evaluating Generative AI Applications - Updated Nov 2025

In this comprehensive talk (adapted from my presentation at ODSC), I provide a practical, hands-on

LLM as a Judge: Scaling AI Evaluation Strategies

LLM as a Judge: Scaling AI Evaluation Strategies

Ready to become a certified watsonx

Lesson 3A: What is generative AI? (Deep Dive) | AI Fluency: Framework & Foundations Course

Lesson 3A: What is generative AI? (Deep Dive) | AI Fluency: Framework & Foundations Course

This video is part of Deep Dive 1 of

Evaluation for Generative AI - A simply explained starting point

Evaluation for Generative AI - A simply explained starting point

This video presents a comprehensive

Framework for Evaluating Generative AI Use Cases - Barak Turovsky

Framework for Evaluating Generative AI Use Cases - Barak Turovsky

How

Shipping AI That Works: An Evaluation Framework for PMs – Aman Khan, Arize

Shipping AI That Works: An Evaluation Framework for PMs – Aman Khan, Arize

GenAI is reshaping the product landscape, creating huge opportunities (along with new expectations) for product managers.

Ensure AI Agents Work: Evaluation Frameworks for Scaling Success — Aparna Dhinkaran, CEO Arize

Ensure AI Agents Work: Evaluation Frameworks for Scaling Success — Aparna Dhinkaran, CEO Arize

Turning

WWDC26: Meet the Evaluations framework | Apple

WWDC26: Meet the Evaluations framework | Apple

Learn how

Lightning Round: Framework for Evaluating GenAI; Using Gen AI for OER; Gen AI for Curriculum Mapping

Lightning Round: Framework for Evaluating GenAI; Using Gen AI for OER; Gen AI for Curriculum Mapping

Creating and Presenting a

How to Systematically Setup LLM Evals (Metrics, Unit Tests, LLM-as-a-Judge)

How to Systematically Setup LLM Evals (Metrics, Unit Tests, LLM-as-a-Judge)

Want to learn real

Evaluating LLM-based chatbots: A framework for reliable AI assistants

Evaluating LLM-based chatbots: A framework for reliable AI assistants

Learn a practical

[Evals Workshop] Mastering AI Evaluation: From Playground to Production

[Evals Workshop] Mastering AI Evaluation: From Playground to Production

This hands-on workshop will guide participants through the complete

AWS re:Invent 2024 - Responsible generative AI: Evaluation best practices and tools (AIM342)

AWS re:Invent 2024 - Responsible generative AI: Evaluation best practices and tools (AIM342)

With the newfound prevalence of applications built with large language models (LLMs) including features such as Retrieval ...