Media Summary: Deploying an agent is only the start. In this workshop, Samuel Colvin shows how to improve agents after they are already live, ... Matt will be back on stage at the World's Fair next week! see https:// Code Follow-up: This is how I think through designing a full stack

Production Ai Workflow Tutorial Evals - Detailed Analysis & Overview

Deploying an agent is only the start. In this workshop, Samuel Colvin shows how to improve agents after they are already live, ... Matt will be back on stage at the World's Fair next week! see https:// Code Follow-up: This is how I think through designing a full stack Today, I want to share a new episode with Aman Khan. The best way to learn about Hamel Husain and Shreya Shankar teach the world's most popular course on You don't know what your agents will do until you actually run them — which means agent observability is different and more ...

Most agents get tested by running a few queries and checking if it looks right. Laurie calls this the vibes problem: it doesn't catch ... Shishir Patal, a Research Scientist at Meta, delivered a presentation on

Photo Gallery

Production AI Workflow Tutorial – Evals, Synthetic Data, and Fine-tuning
Agent Optimization with Pydantic AI: GEPA, Evals, Feedback Loops — Samuel Colvin, Pydantic
Full Walkthrough: Workflow for AI Coding — Matt Pocock
You Can Learn AI Agent System Design In 19 Min | RAG, Vector Database, Evals, Function Calling
LLM as a Judge: Scaling AI Evaluation Strategies
AI Evals 101: How to Evaluate LLMs, Agentic AI & GenAI Systems (Step by Step)
Complete Beginner's Course on AI Evaluations in 50 Minutes (2025) | Aman Khan
Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar
Observability and Evals for AI Agents: A Simple Breakdown
[Evals Workshop] Mastering AI Evaluation: From Playground to Production
Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize
Agentic Evals by Shishir Patil
View Detailed Profile
Production AI Workflow Tutorial – Evals, Synthetic Data, and Fine-tuning

Production AI Workflow Tutorial – Evals, Synthetic Data, and Fine-tuning

This

Agent Optimization with Pydantic AI: GEPA, Evals, Feedback Loops — Samuel Colvin, Pydantic

Agent Optimization with Pydantic AI: GEPA, Evals, Feedback Loops — Samuel Colvin, Pydantic

Deploying an agent is only the start. In this workshop, Samuel Colvin shows how to improve agents after they are already live, ...

Full Walkthrough: Workflow for AI Coding — Matt Pocock

Full Walkthrough: Workflow for AI Coding — Matt Pocock

Matt will be back on stage at the World's Fair next week! see https://

You Can Learn AI Agent System Design In 19 Min | RAG, Vector Database, Evals, Function Calling

You Can Learn AI Agent System Design In 19 Min | RAG, Vector Database, Evals, Function Calling

Code Follow-up: https://youtu.be/ZREt9MAozho This is how I think through designing a full stack

LLM as a Judge: Scaling AI Evaluation Strategies

LLM as a Judge: Scaling AI Evaluation Strategies

Ready to become a certified watsonx

AI Evals 101: How to Evaluate LLMs, Agentic AI & GenAI Systems (Step by Step)

AI Evals 101: How to Evaluate LLMs, Agentic AI & GenAI Systems (Step by Step)

FREE Agentic

Complete Beginner's Course on AI Evaluations in 50 Minutes (2025) | Aman Khan

Complete Beginner's Course on AI Evaluations in 50 Minutes (2025) | Aman Khan

Today, I want to share a new episode with Aman Khan. The best way to learn about

Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar

Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar

Hamel Husain and Shreya Shankar teach the world's most popular course on

Observability and Evals for AI Agents: A Simple Breakdown

Observability and Evals for AI Agents: A Simple Breakdown

You don't know what your agents will do until you actually run them — which means agent observability is different and more ...

[Evals Workshop] Mastering AI Evaluation: From Playground to Production

[Evals Workshop] Mastering AI Evaluation: From Playground to Production

This hands-on workshop will

Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize

Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize

Most agents get tested by running a few queries and checking if it looks right. Laurie calls this the vibes problem: it doesn't catch ...

Agentic Evals by Shishir Patil

Agentic Evals by Shishir Patil

Shishir Patal, a Research Scientist at Meta, delivered a presentation on

Build evals from real production data

Build evals from real production data

Production