Add max_num_validation_steps member of config and client and related … #304
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jewelltaylor
force-pushed
the
add-val-step-limit
branch
from
fa2d8a8 to
9da8ff1
Compare
scarere
approved these changes
Dec 18, 2024
Add logging and documentation to clarify behaviour of specifying max_num_validation_steps
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Type
[Feature | Fix | Documentation | Other ]
Short Description
Add ability to specify maximum number of validation steps to perform
Add ability to specify maximum number of validation steps to perform. This functionality is useful in cases where the validation dataset size is large and we don't want to compute metrics over the entire validation set. This is immediately useful for the nnunet experiments because the nnunet cli only performs 50 steps on the validation set.
Tests Added
Describe the tests that have been added to ensure the codes correctness, if applicable.