Media Summary: Download the AI model guide to learn more → Learn more about the technology → In this conversation, we sit down with Philip Kiely and Charlie O'Neill to talk about Philip's book This week on the show, Scott talks to Philip Kiley about his new book,
Inference Engineering With Baseten S - Detailed Analysis & Overview
Download the AI model guide to learn more → Learn more about the technology → In this conversation, we sit down with Philip Kiely and Charlie O'Neill to talk about Philip's book This week on the show, Scott talks to Philip Kiley about his new book, From routing a 200000-token prompt across GPUs to having GLM-5.2 profile, rewrite, and optimize the kernels serving itself, ... "It's not that open source models are just automatically less expensive. It's that you get levers that you control for cheaper tokens. Here is The Daily FM summary of the Latent Space that aired on Monday August 3rd. This episode was a deep technical ...
This video breaks down the reported mega-round for AI