Media Summary: Today we're releasing Ramp SWE-Bench: a private, production-grounded In this talk, Ernst Haagsman, Product Leader at JetBrains, shares his expertise on scaling developer tools from his early days on ... Today, I want to share a new episode with Aman Khan. The best way to learn about AI evaluations is to watch 2 PMs build them ...

Evaluate Coding Agents On Financial - Detailed Analysis & Overview

Today we're releasing Ramp SWE-Bench: a private, production-grounded In this talk, Ernst Haagsman, Product Leader at JetBrains, shares his expertise on scaling developer tools from his early days on ... Today, I want to share a new episode with Aman Khan. The best way to learn about AI evaluations is to watch 2 PMs build them ... In the past year, we've seen rapid advancement of model intelligence and convergence on Vincent Caldeira (Field CTO at Red Hat) and Valentina Rodriguez Sosa (Principal Architect at Red Hat) map out a comprehensive ... Ready to become a certified watsonx AI Assistant Engineer? Register now and use

Join the Blog and follow on social handles for engaging conversations about Software Architecture and Tech.

Photo Gallery

Evaluate coding agents on financial SWE work with Ramp SWE-Bench
What Is Agentic Coding? How AI Agents Modernize Code
How to evaluate agents in practice
Practical AI Coding Agent Evaluation with SWE-bench, TeamCity, and Juni | Ernst Haagsman
Complete Beginner's Course on AI Evaluations in 50 Minutes (2025) | Aman Khan
Beginner's Guide to Agent Evaluations
Don't Build Agents, Build Skills Instead – Barry Zhang & Mahesh Murag, Anthropic
Testing the Untestable: Evaluation-Driven Development for Financial AI Agents
LLM as a Judge: Scaling AI Evaluation Strategies
What is a coding agent?
Creating an AI Agent for Financial Report Analysis
How to Evaluate AI Agents ?
View Detailed Profile
Evaluate coding agents on financial SWE work with Ramp SWE-Bench

Evaluate coding agents on financial SWE work with Ramp SWE-Bench

Today we're releasing Ramp SWE-Bench: a private, production-grounded

What Is Agentic Coding? How AI Agents Modernize Code

What Is Agentic Coding? How AI Agents Modernize Code

Learn more about Agentic

How to evaluate agents in practice

How to evaluate agents in practice

Evaluating Agents

Practical AI Coding Agent Evaluation with SWE-bench, TeamCity, and Juni | Ernst Haagsman

Practical AI Coding Agent Evaluation with SWE-bench, TeamCity, and Juni | Ernst Haagsman

In this talk, Ernst Haagsman, Product Leader at JetBrains, shares his expertise on scaling developer tools from his early days on ...

Complete Beginner's Course on AI Evaluations in 50 Minutes (2025) | Aman Khan

Complete Beginner's Course on AI Evaluations in 50 Minutes (2025) | Aman Khan

Today, I want to share a new episode with Aman Khan. The best way to learn about AI evaluations is to watch 2 PMs build them ...

Beginner's Guide to Agent Evaluations

Beginner's Guide to Agent Evaluations

When companies deploy their

Don't Build Agents, Build Skills Instead – Barry Zhang & Mahesh Murag, Anthropic

Don't Build Agents, Build Skills Instead – Barry Zhang & Mahesh Murag, Anthropic

In the past year, we've seen rapid advancement of model intelligence and convergence on

Testing the Untestable: Evaluation-Driven Development for Financial AI Agents

Testing the Untestable: Evaluation-Driven Development for Financial AI Agents

Vincent Caldeira (Field CTO at Red Hat) and Valentina Rodriguez Sosa (Principal Architect at Red Hat) map out a comprehensive ...

LLM as a Judge: Scaling AI Evaluation Strategies

LLM as a Judge: Scaling AI Evaluation Strategies

Ready to become a certified watsonx AI Assistant Engineer? Register now and use

What is a coding agent?

What is a coding agent?

Cline is an autonomous

Creating an AI Agent for Financial Report Analysis

Creating an AI Agent for Financial Report Analysis

Resources (including link to

How to Evaluate AI Agents ?

How to Evaluate AI Agents ?

Join the Blog and follow on social handles for engaging conversations about Software Architecture and Tech.

22 Keynote: On the Evaluation of AI Coding Agents

22 Keynote: On the Evaluation of AI Coding Agents

Keynote: On the