Sulba
ReviewSign inAccount
Theme
Editor theme
Light
Dark

Intermediate · Evals

Regression gates

Gate the help desk's releases in CI: several replies to each question and what they take out of the standard error, two releases compared question by question, the smallest drop the test set can be counted on to find, a review of an assistant's gate, and a gate that stops a planted regression and ships a rerun.

You build
samples.py, then compare.py, then power.py, then gate.py, then release_gate.py
Stages
3 Build, 1 Catch, 1 Ship
Time
About 2.5 hours
Runs on
Your machine

Loading the workspace…