[Backport]: verify worker exit when signal_exit is_cancelled

[Backport]: verify worker exit when signal_exit is_cancelled #1845