"Select all unlabelled images" only works for a few seconds, then all images reappear

[RoseBunker]

Describe the bug

I had “Select all unlabelled images” and then started labelling those, but after about three images, all image thumbnails re-appeared (i.e. including those labelled), even though “select all unlabeled images” icon was still green.

To Reproduce

Steps to reproduce the behaviour:

1. Go to Curate
2. Click on "Select all unlabelled images"
3. The unlabelled images appear and the rest are filtered out of view
4. Wait
5. After X seconds, all images reappear; the "select all unlabelled images" icon remains green.

Expected behaviour

I expect that the labelled images won't ever reappear in the "select all unlabelled images" filter.

Screenshots

Not provided.

System Info (please complete the following information):

• OS: Windows 10
• Browser: Chrome
• Browser version: 96.0.4664.93

Additional context

I am adding another issue related to this one (Labelling images whilst viewing "select all unlabelled images" don't stay labelled), as both issues occurred within the same user process.

[ChasNelson1990]

So I don't think this is an "After X seconds" issue. It's actually that your changing labels, which refreshes the view (during which time, if you change a label it can be ignored by accident) and the refreshed view isn't obeying the filter.
@cooper667 should we be putting filters and view settings in the URL so that a refresh obeys them? Also, is this impacted (solved) by some of the batch updating work you were doing?