Hi Matt,
Firstly, if you'd like to automate the creation of the VM on AWS, I'd recommend using our Deep Learning Container on DockerHub or from NGC. It will help automate setting up the VM if you're creating and destroying it based on your need for more compute on AWS.
There are instructions on how to use containers using docker cam be found in this blog post. NOTE: The 2nd half of the blog is related to NGC, it can also apply to docker hub too.
To answer your questions:
1. If you want to save data in between instances you create or destory:
- Save any data to a cloud drive, such as s3. Here is a doc page on transferring to s3.
- Setup source control, such as Git, and store your files in GitHub. Information on setting up souce control directly in MATLAB can be found here. If you following this programming practise, you can "pull" the files you need from GitHub after setting up a new instance.
2. I normally select the AWS instance type that suits the needs I have for the models I'm training at the time. AWS's p3 instances are recommended if you require a GPU, and theres 4 different options.
3. In the blog post above, it highlights how you can select the NVIDIA AMI.
David
