Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

btlapply submitting to only a small number of nodes in Slurm #265

Open
yimyom opened this issue Aug 28, 2020 · 0 comments
Open

btlapply submitting to only a small number of nodes in Slurm #265

yimyom opened this issue Aug 28, 2020 · 0 comments

Comments

@yimyom
Copy link

yimyom commented Aug 28, 2020

Hi,

I have a recurring problem with btlapply, whichever code I use inside. I'm not sure if it's a bug in batchtools, a problem in the way I use it or an error in my Slurm configuration.
I have 16 nodes, each with 40 CPUs. Whatever I submit using btlapply, it never uses more than 1 or 2 nodes. And even the second node is used half.
sinfo reports all the other nodes in idle state.
srun -N 16 hostname will correctly print the hostname of each node, meaning I can send jobs to all the nodes.

Any idea or suggestions on how to fix this problem or where to look at?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant