Optimal Confidence Threshold Finder

This plugin is a Python plugin that allows for you to find the optimal confidence threshold for deploying your models!

🔎 Find the magic number in one click!

Installation

fiftyone plugins download https://github.com/danielgural/optimal_confidence_threshold

Operators

optimal_conf_threshold

Finding the optimal confidence threshold can always be tricky. One way to consider doing so is finding the number that maximizes your F1 score. This plugin implements a method of running an optimized version of FiftyOne's evaluate_detections method. This will calculate the F1 score at different thresholds until the best one is found! Here is how it works!

Input the following:

• Lower bound to search between
• Upper bound to search between
• Number of thresholds to check, this will increase complexity
• Ground Truth field
• Prediction field

The plugin will then sweep your range for the optimal confidence threshold until the answer is popped out!