Flash sale 30% off with code LAUNCH30 Ends in --:--:--
See pricing
All Things PM

TAGGED

LLM-as-judge

2 articles

A product manager at a whiteboard lays out a long row of small paper tiles, each tile one word fragment, while a narrow window frame on the wall shows only part of the row
AI Product Management

LLM-as-Judge Explained for PMs

LLM-as-a-judge means using one language model to grade another model's outputs against a written criterion. This guide explains how PMs design, validate and ship a judge, and AllthingsPM teaches it in a graded Evals chapter with interview practice.

September 29, 2026 · 14 min read
A product manager at a long table sorts a tall stack of printed pages into labelled trays while a laptop sits open beside them
AI Product Management

AI Evals for Product Managers: The Complete Guide

AI evals are the tests that decide whether an AI feature is good enough to ship. This guide gives PMs the full method, and AllthingsPM lets you learn it in a graded course chapter and practise it in mock interviews built from real evals job descriptions.

September 26, 2026 · 18 min read
GET PM-READY, FREE

Read the theory here.
Practice it at allthingspm.app.

Start free
The AI PM course

Reading is the easy half.
The course grades the other half.

Start for free