Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FIX] Evaluation Results input validation #1954

Merged
merged 9 commits into from
Feb 3, 2017

Conversation

ales-erjavec
Copy link
Contributor

Issue

Most widget in evaluation category fail when presented either an empty Evaluation Results instance or one containing nan values. The source of these is in most cases the 'Predictions' widget.

Description of changes
  • 'Predictions' widget filters out unknown values from the 'Evaluation Results' when the corresponding true target value is unknown
  • Confusion Matrix, ROC Analysis, Lift Curve and Calibration plot widgets handle empty results
  • Confusion Matrix, ROC Analysis, Lift Curve and Calibration plot widgets check for the presence of Nan values and bail out early with an error message.
Includes
  • Code changes
  • Tests
  • Documentation

@ales-erjavec
Copy link
Contributor Author

@ales-erjavec
Copy link
Contributor Author

@ales-erjavec
Copy link
Contributor Author

@ales-erjavec
Copy link
Contributor Author

@ales-erjavec
Copy link
Contributor Author

@ales-erjavec
Copy link
Contributor Author

@astaric astaric modified the milestone: 3.3.11 Jan 30, 2017
@janezd janezd self-assigned this Feb 3, 2017
if nan_values:
self.Error.invalid_values()
else:
self.Error.invalid_values.clear()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No need to change anything here, but just if you didn't know: if you prefer, you can use self.Error.invalid_values(shown=nan_values), which shows or hides the messages.

@janezd janezd removed their assignment Feb 3, 2017
@janezd janezd merged commit 5cbac0e into biolab:master Feb 3, 2017
astaric pushed a commit that referenced this pull request Feb 3, 2017
…ation

[FIX] Evaluation Results input validation
(cherry picked from commit 5cbac0e)
@ales-erjavec ales-erjavec deleted the fixes/evaluate-input-validation branch May 12, 2017 17:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants