View Detailed Profile
Ray Batch Evaluation: Run 10,000 LLM Test Cases in Python

Ray Batch Evaluation: Run 10,000 LLM Test Cases in Python

Distributed

Faster and Cheaper Offline Batch Inference with Ray

Faster and Cheaper Offline Batch Inference with Ray

The popularity of machine learning (ML) in the real world has exploded recently, with offline

Distributed Embeddings at Scale: Processing 10M+ Rows/ Day with Ray, GPUs & Qdrant | Ray Summit 2025

Distributed Embeddings at Scale: Processing 10M+ Rows/ Day with Ray, GPUs & Qdrant | Ray Summit 2025

At

Ray in 30 min

Ray in 30 min

Don't like the Sound Effect?:* https://youtu.be/zVy49qu9KbE *Text:* ...

Evaluating large language models with Ray in hybrid cloud

Evaluating large language models with Ray in hybrid cloud

Evaluating

Uber's GenAI Leap: Batch Predictions Using Ray and vLLM | Ray Summit 2024

Uber's GenAI Leap: Batch Predictions Using Ray and vLLM | Ray Summit 2024

At

Anyscale's Ray Data: Revolutionizing Batch Inference | Ray Summit 2024

Anyscale's Ray Data: Revolutionizing Batch Inference | Ray Summit 2024

As machine learning models grow in complexity and power, large-scale

Ray Train: Distributed Solutions for Removing Training Bottlenecks | Ray Summit 2025

Ray Train: Distributed Solutions for Removing Training Bottlenecks | Ray Summit 2025

Slides: https://drive.google.com/file/d/1TY9RrbO5nrrOevdzSr1_3uOVkE-vMxum/view?usp=sharing At

Scaling LLM Batch Inference with vLLM + Ray (Ray x AI21 Meetup)

Scaling LLM Batch Inference with vLLM + Ray (Ray x AI21 Meetup)

Learn how

Applied Intuition’s Blueprint for Scalable RL + Batch Inference | Ray Summit 2025

Applied Intuition’s Blueprint for Scalable RL + Batch Inference | Ray Summit 2025

At