aleleba
c24f0ab236
The 32 longest examples of the training mix, 3161 to 3271 tokens each. With batch 1 and gradient accumulation 16, a two-step smoke run consumes exactly these 32, so it trains on the worst case the real run will ever see. Risk #5 in the plan is an OOM discovered hours into the run. Phase 3 peaked around 104 GB of the 121 GB available with a longest example near 2800 tokens, and this corpus goes to 3271. Rather than argue about whether the extra 17% of sequence length fits, the smoke run measures it in ten minutes. If it OOMs it OOMs immediately and cheaply, which is the whole point of running the probe before the 169-step run rather than after.