Mark Phase 1 tokenizer item done

This commit is contained in:
2026-07-12 10:33:33 -04:00
parent 3a489fef0a
commit 6111aac459
+1 -1
View File
@@ -146,7 +146,7 @@ experiment-llm/
## Definition of done (iteration 1)
- [x] Environment reproducible with `pip install -r requirements.txt`; dataset downloaded and hashed
- [ ] BPE tokenizer trains, round-trips, and is saved to disk
- [x] BPE tokenizer trains, round-trips, and is saved to disk
- [ ] Corpus encoded to binary token files
- [ ] Model builds; parameter count matches the estimate
- [ ] Overfit-one-batch sanity check passes (loss → ~0 on a single batch)