rzen 234a37f8fd Phase 4: training loop (code only — for user to run) ...

- src/train.py: AdamW (decay on matrices only), cosine LR w/ warmup, grad
  clipping, periodic train/val loss, CSV logging, resumable checkpoints.
  --overfit mode runs the overfit-one-batch sanity check. MPS, fp32.
- configs/v1.py: TrainConfig (batch 64, peak LR 6e-4, 20k iters, etc.)
- tests/test_train.py: LR schedule + optimizer grouping (3 tests, no run)

2026-07-12 10:51:58 -04:00

..

test_dataset.py

Phase 2: token dataset + corpus encoder (code only, not yet run)

2026-07-12 10:38:20 -04:00

test_model.py

Phase 3: decoder-only transformer (~4.3M params)

2026-07-12 10:48:55 -04:00

test_tokenizer.py

Phase 1: from-scratch byte-level BPE tokenizer

2026-07-12 10:31:16 -04:00

test_train.py

Phase 4: training loop (code only — for user to run)

2026-07-12 10:51:58 -04:00