Yup. On my Android, each of those push-notifications come with a "configure notifications" which lets you turn them off quickly and easily.

Ironically, I use that feature for installed apps most (you're a banking app, stop bugging me with unrelated news!) and hardly ever to turn off a accidentally allowed web-notification.