Yep, via OpenCV. If I still had access to Glass I'd love to try out your library. Do you have any first-person videos of your application? If you have an iPhone 5 you can hold it up to the prism in good lighting and record first-person (it's a real pain though).
I don't have any first-person videos yet, but I should give it a go. (I don't have an iPhone 5, but I can try with my HTC One X.) I'll link to it from the project's github page.