Heck, a desktop application that launched from a hot key and immediately highlighted any possible buttons and input fields it can recognize on a screen/window and simulate click on selection is already very useful.