ui_adaptor: don't invalidate uis below when exiting game #94708

Job	Run time
skip-duplicates-code	6s
matrix-variables	1s
skip-duplicates-data	5s
Basic Build and Test (Clang 10, Ubuntu, Curses)	56m 48s
Clang 14, macOS 12, Tiles, Sound, x64 and arm64 Universal Binary	1h 31m 51s
GCC 9, Curses, LTO	57m 22s
Clang 12, Ubuntu, Tiles, ASan	1h 29m 4s
GCC 11, Ubuntu, Curses, ASan	2h 34m 12s
GCC 12, Ubuntu cross-compile to MinGW-Win64, Tiles, Sound	1h 11m 5s
GCC 9, Ubuntu, Tiles, Sound, CMake	25m 22s
emscripten / Build	1h 58m 19s
	11h 4m 15s

Provide feedback