AWS ParallelCluster v2.1.0

We're excited to announce the release of AWS ParallelCluster 2.1.0.

Upgrade

How to upgrade?

sudo pip install --upgrade aws-parallelcluster

Features

• Support for Elastic File System (EFS)
• AWS Batch Multinode Parallel support
• Support for RAID 0 and 1 EBS Volumes
• Support for AWS Stockholm Region (eu-north-1)

Bugfixes

• No longer schedule jobs on compute nodes that are terminating

Support

Need help / have a feature request?
AWS Support: https://console.aws.amazon.com/support/home
ParallelCluster Issues tracker on GitHub: https://github.com/aws/aws-parallelcluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

AWS ParallelCluster v2.0.2

We're excited to announce the release of AWS ParallelCluster 2.0.2.

Upgrade

How to upgrade?

sudo pip install --upgrade aws-parallelcluster

Features

• Support for new GovCloud region us-gov-east-1

Bugfixes

• Fix regression with shared_dir parameter in the cluster configuration section.
• Fixed issue with jq that prevented customers from using extra_json
• Fixed issue with awscli version on ubuntu1404

Support

Need help / have a feature request?
AWS Support: https://console.aws.amazon.com/support/home
ParallelCluster Issues tracker on GitHub: https://github.com/aws/aws-parallelcluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

AWS ParallelCluster v2.0.1

We're excited to announce the release of AWS ParallelCluster 2.0.1.

Upgrade

How to upgrade?

sudo pip install --upgrade aws-parallelcluster

Bugfixes

• Fix pcluster configure and pcluster createami commands

Support

Need help / have a feature request?
AWS Support: https://console.aws.amazon.com/support/home
ParallelCluster Issues tracker on GitHub: https://github.com/aws/aws-parallelcluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

AWS ParallelCluster v2.0.0

We are happy to launch AWS ParallelCluster!

AWS ParallelCluster is an enhanced and productized version of CfnCluster.

Moving from CfnCluster to AWS ParallelCluster

If you are a previous CfnCluster’s user, we encourage you to start using and creating new clusters only with AWS ParallelCluster. Clusters created with CfnCluster can continue to be managed with CfnCluster and clusters created with AWS ParallelCluster can coexist.

The configuration file from cfncluster can be used with AWS ParallelCluster. To read more about the differences see: https://aws-parallelcluster.readthedocs.io/en/latest/getting_started.html#moving-from-cfncluster-to-aws-parallelcluster

Installation

How to install?

sudo pip install aws-parallelcluster

Features

• AWS Batch Integration
• Support for creating custom AMI's
• Multiple EBS Volume support

Support

Need help / have a feature request?
AWS Support: https://console.aws.amazon.com/support/home
ParallelCluster Issues tracker on GitHub: https://github.com/aws/aws-parallelcluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

CfnCluster v1.6.1

We are happy to announce the availability of CfnCluster v1.6.1.

How to update?

sudo pip install --upgrade cfncluster

Features:

• Fix a bug in cfncluster configure introduced in 1.6.0

Need help / have a feature request?
CfnCluster Issues tracker on GitHub: https://github.com/awslabs/cfncluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

CfnCluster v1.6.0

We are happy to announce the availability of CfnCluster v1.6.0.

How to update?

sudo pip install --upgrade cfncluster

Features:

• Refactor scaling up to take into account the number of pending/requested jobs/slots and instance slots.
• Refactor scaling down to scale down faster and take advantage of per-second billing.
• Add scaledown_idletime parameter as part of scale-down refactoring
• Lock hosts before termination to ensure removal of dead compute nodes from host list
• Fix HTTP proxy support

Need help / have a feature request?
CfnCluster Issues tracker on GitHub: https://github.com/awslabs/cfncluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

CfnCluster v1.5.4

We are happy to announce the availability of CfnCluster v1.5.4.

How to update?

sudo pip install —upgrade cfncluster

Features:

• Cfncluster update bugfix, see #495
• Option to disable ganglia with extra_json = { "cfncluster" : { "ganglia_enabled" : "no" } }
• Updated AMI’s with the latest security patches

Need help / have a feature request?
CfnCluster Issues tracker on GitHub: https://github.com/awslabs/cfncluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

CfnCluster v1.5.3

We are happy to announce the availability of CfnCluster v1.5.3.

How to update?

sudo pip install —upgrade cfncluster

Features:

• Support GovCloud (us-gov-west-1) region. To learn more visit: https://aws.amazon.com/govcloud-us/

Need help / have a feature request?
CfnCluster Issues tracker on GitHub: https://github.com/awslabs/cfncluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

CfnCluster v1.5.2

We are happy to announce the availability of CfnCluster v1.5.2.

How to update?

sudo pip install —upgrade cfncluster

Features:

• Added cfncluster ssh cluster_name, this allows you to easily ssh into your clusters. Extra ssh flags can be provided after the command. See https://cfncluster.readthedocs.io/en/latest/commands.html#ssh
• Added ClusterUser as a stack output. This makes it easier to get the username of the head node.
• Moved global cli flags to the command specific flags. For example cfncluster --region us-east-1 create now becomes cfncluster create --region us-east-1

Bugfixes:

• Fix bug that prevented c5d/m5d instances from working
• Set CPU as a consumable resource in slurm
• Fixed Slurm behavior to add CPU slots so multiple jobs can be scheduled on a single node

Need help / have a feature request?
CfnCluster Issues tracker on GitHub: https://github.com/awslabs/cfncluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192

CfnCluster v1.5.1

We are happy to announce the availability of CfnCluster v1.5.1.

How to update?

sudo pip install —upgrade cfncluster

Call outs:

• Added "ec2:DescribeVolumes" permissions to CfnClusterInstancePolicy
  • If you're using a custom iam role (you specify ec2_iam_role in your config), you'll need to add ec2:DescribeVolumes to your role. See https://cfncluster.readthedocs.io/en/latest/iam.html
• Removed YAML CloudFormation template, it can be generated by the https://github.com/awslabs/aws-cfn-template-flip tool

Features:

• Add support for eu-west-3 region
• Added parameter to specify custom cfncluster-node package

Bugfixes:

• Fix --template-url command line parameter
• Poll on EBS Volume attachment status
• Fixed SLURM cron job to publish pending
• Fixed Torque behavior when scaling up from an empty cluster

Need help / have a feature request?
CfnCluster Issues tracker on GitHub: https://github.com/awslabs/cfncluster
The HPC Forum on the AWS Forums page: https://forums.aws.amazon.com/forum.jspa?forumID=192