Here's a take I did on the same thing where I create "stereo plots" (the cross eyed 3D thing): https://blog.k2h.se/post/stereo-plotting-in-r/ . Quite fascinating