From 6111aac459e19f729419e47ba868e251db5a83e8 Mon Sep 17 00:00:00 2001 From: rzen Date: Sun, 12 Jul 2026 10:33:33 -0400 Subject: [PATCH] Mark Phase 1 tokenizer item done --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 8919ab4..d974e79 100644 --- a/README.md +++ b/README.md @@ -146,7 +146,7 @@ experiment-llm/ ## Definition of done (iteration 1) - [x] Environment reproducible with `pip install -r requirements.txt`; dataset downloaded and hashed -- [ ] BPE tokenizer trains, round-trips, and is saved to disk +- [x] BPE tokenizer trains, round-trips, and is saved to disk - [ ] Corpus encoded to binary token files - [ ] Model builds; parameter count matches the estimate - [ ] Overfit-one-batch sanity check passes (loss → ~0 on a single batch)