Just nvidia-smi across the cluster
$ gpustat
it lists all gpu statistics across the cluster$ gpufree
it lists all gpu free across the clustersshfree
logins to a random node with a free gpu
Just download gpustat, and/or gpufree, and/or gpuonefree and sshfree into somewhere in PATH
, e.g. ~/.local/bin/
(when you do not have root privilege, for example):
sudo wget https://git.io/gpustat -O /usr/local/bin/gpustat && sudo chmod +x /usr/local/bin/gpustat
sudo wget https://git.io/gpufree -O /usr/local/bin/gpufree && sudo chmod +x /usr/local/bin/gpufree
sudo wget https://git.io/gpuonefree -O /usr/local/bin/gpuonefree && sudo chmod +x /usr/local/bin/gpuonefree
sudo wget https://git.io/sshfree -O /usr/local/bin/gpustat && sudo chmod +x /usr/local/bin/sshfree