Setting up a single-node EC2 instance for ETL
EC2 instances can have various combinations of CPU/GPU, memory, storage, and network capacity. You can find configurable options for EC2 in the official documentation: https://aws.amazon.com/ec2/instance-types.
When creating an EC2 instance, you can choose a Docker image to run which has been predefined for various projects. These are called Amazon Machine Images (AMIs). For example, there’s an image with TF version 2 installed for DL projects and an image with Anaconda set up for generic ML projects, as shown in the following screenshot. For the complete list of AMIs, please refer to https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AMIs.html:
Figure 5.6 – Selecting an AMI for an EC2 instance
AWS offers Deep Learning AMIs (DLAMIs), which are AMIs that are created for DL projects; images utilize different CPU and GPU configurations and different compute architectures (https://docs.aws.amazon.com...