Since there are video experts around in this thread, does anyone know if there are implementations out there for a player that enables fast smooth scrubbing with audio, similar to how you can scrub and/or watch the timeline at 16x in Adobe Premiere. I guess one needs to eagerly load something like a 16khz mono audio track and some sort of 1fps sprite or 240p video format with I-frames only to switch to on scrub.
Anything frame-accurate or smooth scrubbing has always been a challenge with he abstraction level of the video element.
I don't have an exact answer from you, but you might look around the web codecs space, where more performant examples are being built at a lower level. https://developer.mozilla.org/en-US/docs/Web/API/WebCodecs_A...
