New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问如何运行mlp_model.py #1

Open

vicwer opened this issue Feb 14, 2023 · 1 comment

vicwer commented Feb 14, 2023

(https://github.com/starkhu/cpp_space/tree/master/deepspeed-notes/model_parallel_model/mlp_model)/MLP_model.py

Author

vicwer commented Feb 14, 2023 •

edited

Loading

您好，读您博客跳转到github代码的，相同的代码我拷贝到本机，使用单机4卡运行。mp_size=4，使用python3 mlp_model_p.py运行，会卡住：

in mlp_on_one_process , out is tensor([[ 1.8929, -1.0371,  0.1980,  1.0083],
        [ 2.2762, -7.5658,  4.9366,  3.6428]])
rank 0
rank 1
rank 2
rank 3

请问我该如何运行可以得到正确结果呢？谢谢！

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment