e. Build an HPC Cluster

In this section, you create a cluster based on the specifications defined in the configuration file. To create a cluster, you use the command pcluster create-cluster.

In your AWS Cloud9 terminal, run the following to create a cluster. Make sure that the configuration file path is correct.

pcluster create-cluster --region ${AWS_REGION} --cluster-name hpc-cluster-lab --suppress-validators ALL --cluster-configuration my-cluster-config.yaml

The cluster creation process will take ~10 minutes. Below is the expected output.

TeamRole:~/environment $ source env_vars
TeamRole:~/environment $ pcluster create-cluster --region ${AWS_REGION} --cluster-name hpc-cluster-lab --suppress-validators ALL --cluster-configuration my-cluster-config.yaml
{
  "cluster": {
    "clusterName": "hpc-cluster-lab",
    "cloudformationStackStatus": "CREATE_IN_PROGRESS",
    "cloudformationStackArn": "arn:aws:cloudformation:eu-west-1:146043110428:stack/hpc-cluster-lab/4934f020-bca3-11ec-9752-0ecc1f64971f",
    "region": "us-east-1",
    "version": "3.2.0",
    "clusterStatus": "CREATE_IN_PROGRESS"
  },
}

There can be only one cluster of a given name at any time on your account.

In the next section you’ll take a look at a visual alternative to the command line interface for deploying and managing your clusters called pcluster-manager.