In theory PulseAudio should be able to separate the streams, or at least turn off audio for selected applications. However, this was never really a problem anyway because I usually ran the command at night :)

Yes, audio processing in the early days was fun, though it's easier now because of better tools and especially bigger harddrives and faster CPUs :)