I implemented a dummy real-time (tested on Mac M1) transcription approach with Whisper. You can find the project here: https://github.com/gaborvecsei/whisper-live-transcription

The idea was to provide transcription results as fast as you can, and you can refine it along the way by providing more and more context.