Intermediate · Neural networks from scratch
Optimizers
Build PyTorch's optimizers in NumPy: SGD with momentum as PyTorch writes it, Adam with its bias correction, and AdamW with its weight decay kept apart, each step matched to torch.optim's, then train the office's network on a budget of steps.
- You build
- optimizers.py, then optim.py
- Stages
- 3 Build, 1 Catch, 1 Ship
- Time
- About 4 hours
Loading the workspace…
Loading the workspace…