The imaging sensor is a rectangle in roughly the same aspect ratio as what is captured by the stills mode.

You can see that in any teardown.

I do agree there's no "right orientation" though since it's subjective. However having a square sensor would be illogical