Sulba
ReviewSign inAccount
Theme
Editor theme
Light
Dark

Intermediate · Neural networks from scratch

Debugging a training run

Find what's wrong with a training run before it costs a day: the loss a network should start at, a batch it should learn by heart, gradient norms and clipping as torch.nn.utils has them and a learning-rate range test, then review an assistant's training script and ship a run whose report holds up.

You build
network.py, then clipping.py, then range_test.py, then train.py, then run.py
Stages
3 Build, 1 Catch, 1 Ship
Time
About 3.5 hours

Loading the workspace…