Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FIX] Test & Score: hide warnings for hidden scores. #3676

Merged
merged 2 commits into from
Mar 19, 2019

Conversation

thocevar
Copy link
Contributor

Issue

Fixes #2088

A user sees a warning although all displayed scores are successfully computed. The problematic score is not AUC but LogLoss, which the widget tries to compute (and fails) but is not displayed by default.

Description of changes
  • hide warnings for hidden scores
  • fix an error where the user couldn't display additional scores on Windows

We might want to consider fixing LogLoss for the case described in #2088.

Includes
  • Code changes
  • Tests
  • Documentation

@codecov
Copy link

codecov bot commented Mar 15, 2019

Codecov Report

Merging #3676 into master will decrease coverage by <.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #3676      +/-   ##
==========================================
- Coverage    84.5%   84.49%   -0.01%     
==========================================
  Files         373      373              
  Lines       68253    68269      +16     
==========================================
+ Hits        57675    57687      +12     
- Misses      10578    10582       +4

@janezd janezd self-assigned this Mar 15, 2019
item = QStandardItem()
if stat.success:
item.setText("{:.3f}".format(stat.value[0]))
else:
item.setToolTip(str(stat.exception))
has_missing_scores = True
has_missing_scores = scorer.name in self.shown_scores
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be has_missing_scores = has_missing_scores or scorer.name in self.shown_scores? It can already be True.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch.

@janezd janezd removed their assignment Mar 15, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Test & Score: AUC is not computed if some class value in missing in the test set
2 participants