Feature/Enhancement Request - Support for cost and user tracking

[Waqiah]

Hello Team,

I understand that ParallelCluster does not support user or cost tracking natively at this moment, therefore I would like to put in this feature request of allowing:

• The tagging a slurm compute node dynamically when a user procures a compute node from slurm. Such as to add/update a subset of tags based on values passed to slurm node (eg. login name).
• To allow the setting of other compute node tagging based on other rules apart from CustomActions.

Currently the below blog has been suggested as a potential workaround:
https://swsmith.cc/posts/cost-explorer-pcluster.html

However I would like this to be a native feature.

[joehellmersNOAA]

Another way to do this would be to use an RDS database for Slurm accounting. It would cost a bit for the database, but it might be worth it if you want to track usage and costs.

https://docs.aws.amazon.com/parallelcluster/latest/ug/slurm-accounting-v3.html

[hanwen-pcluste]

Thank you for the feature request. Our team will discuss this.

[maestro7879]

I had users add the below to their sbatch submission file, the goal being to track costs in AWS Cost Explorer. -
MyInstID=$(srun --nodes=15 ec2-metadata --instance-id | cut -d " " -f 2)
srun --nodes=15 aws ec2 create-tags --resources $MyInstID --tags Key=Name,Value="Compute-Joe Vanilla" --region us-east-1

Not ideal but it works.

[joehellmersNOAA]

@maestro7879 Does that work with sbatch as well? I think it should.

[maestro7879]

@maestro7879 Does that work with sbatch as well? I think it should.

Yes, that's what we are using.

#!/bin/bash

FILENAME: mpi_test.sub

#SBATCH --nodes=2

#SBATCH --partition= partition6

#SBATCH --ntasks-per-node=8

MyInstID=$(srun --nodes=2 ec2-metadata --instance-id | cut -d " " -f 2)
srun --nodes=2 aws ec2 create-tags --resources $MyInstID --tags Key=Name,Value="Compute-Joe Vanilla" --region us-east-1