Sulba
ReviewSign inAccount
Theme
Editor theme
Light
Dark

Intermediate · Transformers from scratch

GPT-2's weights

Run OpenAI's GPT-2 in the reading app's own GPT: its weights read by hand from their file, its tokenizer built from its published vocabulary and merges, its tensors mapped into your model until its predictions match Hugging Face's, a review of an assistant's loader, and a loader for any GPT-2 that refuses a damaged file.

You build
weights.py, then tokenizer.py, then gpt2.py, then loader.py, then load.py
Stages
3 Build, 1 Catch, 1 Ship
Time
About 3.5 hours
Runs on
Your machine

Loading the workspace…