Sulba
ReviewSign inAccount
Theme
Editor theme
Light
Dark

Intermediate · Evals

Test sets

Measure the help desk's replies on questions it never tuned on: a test set split by page and service, checks of each reply written in code, the margin of error the set gives with each page's questions counted together, a review of an assistant's test set, and a release report that says how many questions a margin needs.

You build
testset.py, then checks.py, then margin.py, then evalset.py, then release.py
Stages
3 Build, 1 Catch, 1 Ship
Time
About 2.5 hours
Runs on
Your machine

Loading the workspace…