Proposed features [Edoardo]

[ehoelzl]

This is a list of proposed features to be implemented in the near future.

• Use Google Virtual NIC on cluster to improve communication times for tasks GVNIC, alpha cluster with GVNIC.
• Use GCloud's API to create a cost estimator and add the estimated cost to the results. (This cannot be done yet, would need some updates on gcloud's side. I'm not sure for AWS)
• Some modules are now part of PyTorch (e.g. PowerSGD). Might be a good idea to test ours vs theirs and document the results in a blogpost.
• Continue comparison between Torch's DDP and our implementations for the more complex tasks (translation and modelling).
• Upgrade to torch's newest version.
• Run tasks on AWS