Right now on Wayland we lock poitner, however the actual behavior that `set_cursor_grab` assumes is confining a pointer.