Do you know about vtubers? In case you don't, they are people that record or livestream themselves playing games and whatnot. Instead of using a regular face camera to put themselves onto the video feed, they use a 2D or 3D animated model.
Most people use a desktop webcam which can do decent tracking or an iPhone which does really good tracking through ARkit, but there isn't really a decent solution on Android.
It could be a good new market opportunity for you on desktop, iPhone, or Android - but especially for Android users since there isn't really any alternatives. There is a steady stream of new people getting into being a vtuber and I think a $15 app might be an easy sell considering people can end up spending up to a five-digit amount getting custom character models commissioned. If you are able to improve the eye/face tracking past the basic level you mentioned the 2.0 version having, it would be even more appealing.
Thanks! Yeah, I've been asked about this a few times - however, it does look like this is basically exactly that (using ARKit and ARCore) and exists already: https://denchisoft.com Have you heard of this tool?
VtubeStudio plus an iPhone for mocap is the standard for the big-time vtubers that use 2D avatars, however 2D avatars actually have quite a high barrier to entry because pretty much your only option is to have something commissioned. 3D avatars tend to be what nearly everyone starts out with because there are several free programs out there that can help you make a decent starter avatar.
VtubeStudio only supports the nicer 2D avatars and as far as I know has no intention of getting into the 3D side of things. There are a few decent programs people use with 3D avatars(links below), but it seems they aren't really as high quality as VtubeStudio so they don't have the market cornered like VtubeStudio does for 2D.
As far as tracking goes, on the camera side of things there isn't really any difference between 2D and 3D that might limit you to one or the other.
There is a pretty large demand for tracking apps on Android because there are no widely used apps currently available. Big-time vtubers usually get iPhones so they can use the ARkit tracking that is Apple only, but a lot of people just starting out have Android and are currently forced to use a regular PC webcam that tends not to be as accurate and also doesn't allow people to offload the computing resources needed for face tracking to their phones.
Most people use a desktop webcam which can do decent tracking or an iPhone which does really good tracking through ARkit, but there isn't really a decent solution on Android.
It could be a good new market opportunity for you on desktop, iPhone, or Android - but especially for Android users since there isn't really any alternatives. There is a steady stream of new people getting into being a vtuber and I think a $15 app might be an easy sell considering people can end up spending up to a five-digit amount getting custom character models commissioned. If you are able to improve the eye/face tracking past the basic level you mentioned the 2.0 version having, it would be even more appealing.