Intermediate · Neural networks from scratch
Debugging a training run
Find what's wrong with a training run before it costs a day: the loss a network should start at, a batch it should learn by heart, gradient norms and clipping as torch.nn.utils has them and a learning-rate range test, then review an assistant's training script and ship a run whose report holds up.
- You build
- network.py, then clipping.py, then range_test.py, then train.py, then run.py
- Stages
- 3 Build, 1 Catch, 1 Ship
- Time
- About 3.5 hours
Loading the workspace…
Loading the workspace…