08.07

Offline and online evals

You write the failing eval that reproduces a bug before you fix it, gate deploys on that suite in CI, and monitor sampled live traces with validated online evaluators after release.

Who's hiring for this skill

12 companies have live AI-PM roles that ask for skills taught in this lesson.

This subchapter is part of the paid course.

Its video, its written lesson, its exercise and its grading are all included on any plan. The free subchapters stay free either way.

Keep going