Sulba
ReviewSign inAccount
Theme
Editor theme
Light
Dark

Intermediate · Neural networks from scratch

Optimizers

Build PyTorch's optimizers in NumPy: SGD with momentum as PyTorch writes it, Adam with its bias correction, and AdamW with its weight decay kept apart, each step matched to torch.optim's, then train the office's network on a budget of steps.

You build
optimizers.py, then optim.py
Stages
3 Build, 1 Catch, 1 Ship
Time
About 4 hours

Loading the workspace…