AWS-tutorial.md

Tutorial for setting up an AWS Virtual Machine

This tutorial will teach you how to set up an AWS Virtual Machine for the final project of our course.

1. Register with AWS and launch an EC2 instance

First, you need to perform several preparatory steps (if you have already done this before, you can skip them):

• Sign up for AWS. You will need to specify your credit card details, but for our project we will use Free Tier instances only, so you should not be charged.
• Create a key pair for authentication. If you use Windows, you will also need to install PuTTY to use SSH.
• Create security group. You must add rules to a security group to allow you to connect to your future instance from your IP address using SSH. You might want to allow SSH access from all IPv4 addresses (set to 0.0.0.0/0), because your IP might change.

Next, you are ready to create your first EC2 instance:

• Launch a free tier instance. For Amazon Machine Image (AMI) choose Ubuntu Server 16.04 LTS.
• Connect to your instance using SSH.
• Later on you can start and stop your instance when needed, and terminate it in the end.

2. Set up dependencies and run your project

• Install Docker container for Ubuntu with course dependencies. Follow our Docker instructions.

• To be able to access IPython notebooks running on AWS, you might want to SSH with port tunneling:

ssh -L 8080:localhost:8080 -i path/to/private_key [email protected]

Then you will be able to see the notebooks on localhost:8080 from your browser on the local machine.

• Bring code and data to AWS instance, e.g.

scp -i path/to/your_key.pem path/to/local_file [email protected]:path/to/remote_file

You might need to install WinSCP for data transfer if you are using Windows.

• It is also a good practice to use tmux to keep your remote session running even if you disconnect from the machine, e.g. by closing your laptop.

Thus, to run your scipts on the machine, we suggest that you run: ssh -> tmux -> docker -> python.