My guess is that people actually do look in order to aim their mouse but by the time they click, their eyes have already moved onto wherever they’re looking next.
one reviewer said they kept hitting "No" and "cancel" when they meant "Yes" because their natural progression was to look at the buttons in order, pick out the one they want to press but actually click it after they finish scanning all of them with their "mouse" paused on the one they want to hit. It's kind of fascinating that the VisionPro's input method works so well when it does work that it tricks people into doing this, because they really do just expect it to work like magic.
Yep, focused on the play button on a YouTube video to get my mouse there and then my eyes immediately went back to the center of the video a fraction before I clicked the mouse button.
Maybe they could "remember" where your eyes were looking at a few milliseconds ago and click on that, but then they wouldn't know the difference between that or maybe you actually did mean to click in the center of the content area.
The problem is the Vision OS has no cursor. Cursor position is critical. Your eyes move around a lot more than your cursor moves, but in Vision OS, cursor position and eye position are the same. Very annoying. Maybe they could put a little cursor in the center of the screen that you could move around with another gesture.
If you want to stick with the old mouse paradigm. I rather think people are going to get used to looking at what they want to click on for slightly longer very quickly.
