I expect people will implement rough geometry with polygons and feed a depth+material map to a diffuser for rasterization. This way you get photorealism from the models but maintain precise control over what the scene has in it and where.