Intermediate · Transformers from scratch
GPT-2's weights
Run OpenAI's GPT-2 in the reading app's own GPT: its weights read by hand from their file, its tokenizer built from its published vocabulary and merges, its tensors mapped into your model until its predictions match Hugging Face's, a review of an assistant's loader, and a loader for any GPT-2 that refuses a damaged file.
- You build
- weights.py, then tokenizer.py, then gpt2.py, then loader.py, then load.py
- Stages
- 3 Build, 1 Catch, 1 Ship
- Time
- About 3.5 hours
- Runs on
- Your machine
Loading the workspace…
Loading the workspace…