fsdp_optimizers supporting pytorch FSDP for optimizers run cifar10.py for tests, tested with torch 2.5, arguments at top of file.