I guess it depends on the annoyance? I use NoScript, and it's true that sites load a lot faster. Because an empty page that reads "You must enable JavaScript to view this app" would qualify as a very small payload by almost any standard.
I use noscript too. I try to avoid such websites as much as possible, because they obviously don't want me browsing their website. We need to apply pressure on webmins so they make sure the experience stays good with JS disabled.
Can you blame them for not wanting you to browse their website? Using noscript is probably a pretty decent litmus test for non- or anti-consumerist values, which, in turn, implies being a low-value audience for advertising. Why waste any more bandwidth and server resources than you have to on someone who would be, best case scenario, negatively profitable?
