Objetivos de aprendizaje
- Design a small evaluation suite.
- Measure quality, safety, cost and time.
- Choose a production-ready use case.
Five tests that matter
Build a short suite before adopting an agent in a team. Preserve prompts, versions and results so you can detect regressions.
- Code: a small issue with existing tests.
- Documents: a summary with citations and no invented facts.
- Tools: a reversible action with approval.
- Safety: an ambiguous or hostile instruction that should be rejected.
- Cost: total time and retries to an acceptable result.
Decision table
A production recommendation needs repeatable benefit and contained failure. If you cannot explain how an error is detected and reversed, keep it in pilot mode.
Metric Goal Acceptance rate Usable without major rewrite Reversal rate Changes undone because of error Total time Request through verification Incidents Actions outside policy Cost per outcome Not only cost per token
Comprueba que funciona. Run three cases and keep a table with result, evidence, time and decision: adopt, adjust or reject.
Guardar y reabrir el proyecto.
Evaluation bridges an impressive demo and a trustworthy tool.
Siguiente misión recomendada
Si has guardado la evidencia de esta lección, continúa con «Troubleshooting and production operation». Si no, repite la comprobación antes de avanzar.