08.05
Write the criterion
You default every criterion to a binary pass or fail, reach for pairwise or an anchored scale only when a binary genuinely cannot say it, and force the judge to write its reasoning so its biases become visible.
- Designing Evals for AI Products
- 15 min
- Pro
Who's hiring for this skill
24 companies have live AI-PM roles that ask for skills taught in this lesson.
- Anthropic
- Nebius
- Glean
- Intercom
- Gusto
- Brex
- Scale AI
- Asana
- Fireworks
- Speak
- Writer
- Stripe
- Coursera
- Lovable
- Deepgram
- Klaviyo
- Okta
- Cohere
- Vercel
- Eve
- LangChain
- Luma AI
- Plaid
- Rogo
This subchapter is part of the paid course.
Its video, its written lesson, its exercise and its grading are all included on any plan. The free subchapters stay free either way.