Distributed training at scale
Prepare a short walkthrough of a past project that used distributed training, naming the tools you used and the tradeoffs you faced.
The Senior Applied AI Researcher (Brazil) posting asks for hands-on experience with distributed training at scale using DeepSpeed, FSDP, Megatron-LM, or equivalent.
Source posting