Spot vs on-demand GPUs: what breaks, and how do you make spot safe?
Spot GPUs cost up to 90% less but can vanish with 30 seconds of notice. What breaks, each cloud's notice window, the cost math and a safe setup.
checkpointing
2 posts with the tag “checkpointing”
How to make GPU training survive spot preemption (without babysitting it)
Save model, optimizer and step to one directory, write atomically, resume on start, and let the platform carry that directory across a reclaim.