Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test new contrast-agnostic model #98

Open
jcohenadad opened this issue Jun 4, 2024 · 3 comments
Open

Test new contrast-agnostic model #98

jcohenadad opened this issue Jun 4, 2024 · 3 comments

Comments

@jcohenadad
Copy link
Member

Following up on #95 (comment), the purpose of this issue is to compare the performance of the contrast-agnostic model v2.3 vs. v2.4 on PSIR data.

Example:

ezgif-6-3f0c728f1b

The quality of segmentation is definitely better (see upper thoracic cord). Interestingly however, the model seems more "confident" in that there is much less smoothness in sagittal slices adjacent to the spinal cord:

ezgif-6-0174a979d8

Is that a good thing? Further validation required

@naga-karthik

@naga-karthik
Copy link
Member

naga-karthik commented Jun 4, 2024

Interesting gifs! thank you for posting them!

could you also post the soft values from the 2nd gif? my guess that the soft values from the v2.3 model are already too soft from the looks of the label (i.e. they will be gone if we binarize with 0.5).

Note that these binarized labels (which don't have segmentations on the slices adj to the cord) were used for training so I think the model learned to output less soft values here

@jcohenadad
Copy link
Member Author

could you also post the soft values from the 2nd gif?

I'm not sure I know what you mean by that. If you meant what threshold I used, the answer is '-thr 0' for both models.

Note that these binarized labels (which don't have segmentations on the slices adj to the cord) were used for training so I think the model learned to output less soft values here

right, good point

@jcohenadad
Copy link
Member Author

Note: the 2.4 model is now part of SCT's master branch: spinalcordtoolbox/spinalcordtoolbox@bb479d8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants