-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use Brier score for classification #41
Comments
In my benchmark, it was not always better regarding the MMCE than for example tuning AUC. It had on average the lowest rank but at least for RF it sometimes provided worse results than tuning MMCE directly or MMCE. Important parameter in my opinion. |
Thanks for the info. Looks interesting. |
Yes, for the ranks this is true. But difference to for example logarithmic loss is not big. Probably it would be interesting to benchmark autoxgboost with different target measures. ;) |
sounds like a good idea. @Coorsaa can you add that to the benchmark? |
Might be better as a default compared to missclassification rate especially for tuning to make everything a bit smoother
The text was updated successfully, but these errors were encountered: