Chapter E10-C02 · Evaluation, experiments, and observability
Judgment and diagnostic evidence
Calibrate judgments using human-reviewed examples; Trace a failure to data, prompt, model, tool, or code.
Units in this chapter
- E10-U03 Human rubrics and automated judges Calibrate judgments using human-reviewed examples
- E10-U04 Traces, versions, and regression checks Trace a failure to data, prompt, model, tool, or code
Reading that connects these units
Reading
- Evaluation best practices Evaluation datasets, criteria, comparisons, and ongoing regression checks.About this reference (W17)
- AI Engineering Application patterns, evaluation, and system-level tradeoffs; select AI Engineering on the author page.About this reference (B09)
- OpenTelemetry documentation Trace context, spans, metrics, logs, and instrumenting a request path.About this reference (W27)
- MLflow Inspect a minimal experiment-tracking or model-registry example.About this reference (G16)
Selected, not required. Reviewed 2026-11-17.