I agree that if anybody could do it then Apple could but I just don't think there's a market for it. The iPhone succeeded because everybody needs a telephone. Nobody has yet shown a reason for actually needing a pair of VR goggles. VR goggles just look plain dumb today and the concept art looks rubbish too.
You could also argue that nobody needed the iPad -- and in fact many people still have no use for tablets -- but it still created a significant new market for Apple and plenty of interesting applications. It doesn't need to take over the world to be successful.
There are a lot of reasons the iPhone succeeded but judging by how much I use mine as a phone, as opposed to everything else I do on it, I don't think it's the phone part of the iPhone that made it successful. Apple was able to convince ordinary consumers they needed a tiny computer with them all the time, creating a new market. Same for AR. Current AR glasses don't have the pull for consumers yet but as soon as that killer app comes out we'll see how the market evolves and changes.