Kinda related, Hypothesis (and Diigo iirc in past) has an extension/bookmarklet that can provide an annotation/comment overlay on any web page/pdf. Guess what is needed for arXiv discussion is this overlay but smarter, that is knows a paper pdf and web view are the same, and abstract page is connected to them.