You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When we try to assign a step name to a GM or vice versa, three situations can occur:
We cannot find a GM for the given step name, so we fail the test case. This is the default behavior whenever a test is being executed for the first time.
The step name corresponds to a golden master, so we can proceed with the comparison of expected and actual.
We have a golden master but without a step name.
AFAIK we currently don't handle no. 3? This can happen if a check is removed or a step renamed. The developer has to decide whether the checkpoint is missing, the GM can be deleted, or something else.
In any case, we should probably track the executed tests and then compare them agains the contents of the recheck folder? Afterwards, we could at least print out a warning when there is a GM but no corresponding has been executed.
The text was updated successfully, but these errors were encountered:
When we try to assign a step name to a GM or vice versa, three situations can occur:
AFAIK we currently don't handle no. 3? This can happen if a check is removed or a step renamed. The developer has to decide whether the checkpoint is missing, the GM can be deleted, or something else.
In any case, we should probably track the executed tests and then compare them agains the contents of the
recheck
folder? Afterwards, we could at least print out a warning when there is a GM but no corresponding has been executed.The text was updated successfully, but these errors were encountered: