rzen
921069c5db
- reports/degradation-analysis.md: interpretation of the one-parameter-at-a-time
ablations (ctx/short/small/data vs v1), grounded in val loss + sample text.
Key findings: held-out loss tracks quality for generalizing models; different
degradations give qualitatively different failure text; data-starvation
overfits (train ppl 1.1 / val ppl 322) with samples that hide the damage.
- reports/compare.md: side-by-side samples across all configs
- reports/loss-{small,short,ctx,data}.csv: variant training curves
5 lines
115 B
CSV
5 lines
115 B
CSV
iter,train_loss,val_loss,lr
|
|
500,2.8303,2.8186,0.000564
|
|
1000,2.3438,2.3397,0.000377
|
|
1500,2.1359,2.1259,0.000156
|