Otherwise we get outdated popup menu, or worse: panics

Fix #4035

(Note that before we had the preview_ui, we were calling
WindowInner::set_component which do close_popup as well)