-
Notifications
You must be signed in to change notification settings - Fork 53
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Host Ir Lowering: foundation #3535
base: main
Are you sure you want to change the base?
Host Ir Lowering: foundation #3535
Conversation
!test --diff |
!test |
!test |
@wujingyue the CI failures seen on the previous commits seem to be caused by a too small tolerance rate on single device test. It doesn't seem related to the present PR |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM overall
auto& mesh = tv->getDeviceMesh().vector(); | ||
std::copy(mesh.begin(), mesh.end(), std::inserter(ret, ret.end())); | ||
} else { | ||
ret.insert(0); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is this change needed?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
involvedDevices
is now called from HostIrEvaluator
which can take in single device fusion where TVs don't have device mesh. In a single device Fusion, it is natural that this function returns device 0
Co-authored-by: Jingyue Wu <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let me know if you have further questions or comments
auto& mesh = tv->getDeviceMesh().vector(); | ||
std::copy(mesh.begin(), mesh.end(), std::inserter(ret, ret.end())); | ||
} else { | ||
ret.insert(0); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
involvedDevices
is now called from HostIrEvaluator
which can take in single device fusion where TVs don't have device mesh. In a single device Fusion, it is natural that this function returns device 0
…ann/Fuser into host_ir_lowering_first_refactor
!test |
What
Refactor Host Ir lowering. https://jirasw.nvidia.com/browse/NVFUSER-105
Dependent on:
Why
How
multidevice/lower_communication
tohost_ir/lower
MultiDeviceExecutor
's constructor logic tohost_ir/lower
I divided in incremental commits to ease the review. The relevant commits start at move HostIr lowering to host ir folder and special class, the commits before that belong to #3524