While other think audiobooks are too clean, I definitely think you could do this and then tune with more noisy data.

I’m also sure you could add subtitles for hard of hearing as a very noisy data set.