This all feels a bit like arguing against the use of cardinal directions because they don't make sense unless you learn them first.

If you use left and right for the ship, you wouldn't be able to use personal left and right without risking ambiguity. You'd just be trading one convenience for the other.