Mark Phase 1 tokenizer item done
This commit is contained in:
@@ -146,7 +146,7 @@ experiment-llm/
|
||||
## Definition of done (iteration 1)
|
||||
|
||||
- [x] Environment reproducible with `pip install -r requirements.txt`; dataset downloaded and hashed
|
||||
- [ ] BPE tokenizer trains, round-trips, and is saved to disk
|
||||
- [x] BPE tokenizer trains, round-trips, and is saved to disk
|
||||
- [ ] Corpus encoded to binary token files
|
||||
- [ ] Model builds; parameter count matches the estimate
|
||||
- [ ] Overfit-one-batch sanity check passes (loss → ~0 on a single batch)
|
||||
|
||||
Reference in New Issue
Block a user