We can already resolve the interframe wobbles that happen due to the inability to preserve spatial invariants on static meshes allowing for dynamic camera motion.

Of course, the spatial invariants of meat-suits in motion require an understanding of volumetric structure, and not just restricted depth surface meshes.

But it's not some unencodable computational enigma.