08.08
Evaluate an agent
You score an agent across three altitudes, outcome, trajectory, and step, and separate pass^k reliability across a whole task from single-run pass@k capability.
- Designing Evals for AI Products
- 18 min
- Pro
Who's hiring for this skill
13 companies have live AI-PM roles that ask for skills taught in this lesson.
- Anthropic
- Brex
- Gusto
- Fireworks
- Speak
- Stripe
- Asana
- Cohere
- Lovable
- Vercel
- Klaviyo
- Luma AI
- Eve
This subchapter is part of the paid course.
Its video, its written lesson, its exercise and its grading are all included on any plan. The free subchapters stay free either way.