Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update vista3d to use MONAI components #627

Merged
merged 5 commits into from
Aug 26, 2024

Conversation

yiheng-wang-nv
Copy link
Collaborator

Fixes # .

Description

A few sentences describing the changes proposed in this pull request.

Status

Ready/Work in progress/Hold

Please ensure all the checkboxes:

  • Codeformat tests passed locally by running ./runtests.sh --codeformat.
  • In-line docstrings updated.
  • Update version and changelog in metadata.json if changing an existing bundle.
  • Please ensure the naming rules in config files meet our requirements (please refer to: CONTRIBUTING.md).
  • Ensure versions of packages such as monai, pytorch and numpy are correct in metadata.json.
  • Descriptions should be consistent with the content, such as eval_metrics of the provided weights and TorchScript modules.
  • Files larger than 25MB are excluded and replaced by providing download links in large_file.yml.
  • Avoid using path that contains personal information within config files (such as use /home/your_name/ for "bundle_root").

@yiheng-wang-nv
Copy link
Collaborator Author

/build

Copy link
Collaborator

@KumoLiu KumoLiu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, looks good to me.

Did you try with the model weight to see if it can loaded correctly and the results make sense?

@yiheng-wang-nv
Copy link
Collaborator Author

/build

@yiheng-wang-nv
Copy link
Collaborator Author

Hi @KumoLiu ,
Yes, I tested with multiple sample images and visualize the results

@KumoLiu
Copy link
Collaborator

KumoLiu commented Aug 26, 2024

/build

@yiheng-wang-nv
Copy link
Collaborator Author

/build

@KumoLiu KumoLiu merged commit db0f350 into Project-MONAI:dev Aug 26, 2024
4 checks passed
@yiheng-wang-nv yiheng-wang-nv deleted the update-vista3d-to-use-oss branch August 26, 2024 09:45
@@ -243,8 +243,8 @@ def _iteration(self, engine: SupervisedEvaluator, batchdata: dict[str, torch.Ten
label_set = np.arange(output_classes).tolist()
label_prompt = torch.tensor(label_set).to(engine.state.device).unsqueeze(-1)
# point prompt is generated withing vista3d,provide empty points
points = torch.zeros(label_prompt.shape[0], 1, 3)
point_labels = -1 + torch.zeros(label_prompt.shape[0], 1)
points = torch.zeros(label_prompt.shape[0], 1, 3).to(inputs.device)
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

HI @heyufan1995 , could you help to confirm if the changes here are correct? I got device mismatch error thus changed here, thanks in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants