
Eval Design
Avoid shipping an agent / prompt on vibe checks, then discovering after a production failure that there is no repeatable evidence for quality. Produces 5-10 runnable eval test cases + grading rubric: happy path, edge cases, adversarial input, subtle quality tests, regression cases, quantitative assertions, and qualitative review, organized into evals JSON + grading JSON structures.
#プロダクト#エンジニアリング#生産性
評価
さらに評価が必要です
販売数
0
利用方法
ダウンロード
Eval Design
Avoid shipping an agent / prompt on vibe checks, then discovering after a production failure that there is no repeatable evidence for quality. Produces 5-10 runnable eval test cases + grading rubric: happy path, edge cases, adversarial input, subtle quality tests, regression cases, quantitative assertions, and qualitative review, organized into evals JSON + grading JSON structures.
How it works
- Scope and Input
- Eval Dimensions
- Assertion Design
- Qualitative Review
- Test Run
- Write and End
The finished result is saved to journal/evals/ so you can reuse it.
Who it's for
For builders shipping an agent, prompt, or Claude skill who need repeatable evidence of quality before release and a regression set for every change after.
Languages
The setup, working steps, and output follow the language you type — usable in English, 中文, 日本語, and other languages the model supports.

