I still don't _really_ understand why all those matrix multiplications can reliably determine which handwritten digit they've just seen but having implemented it from the ground up in his class I feel like I at least understand the moving parts.

Have you checked out the new stuff he added a while ago? I assume it's just as good but haven't made the time yet.