Irritations can also be past weaknesses. Like you said, you’ve put in the work why don’t others? That’s irritating/frustrating in itself because it implies that they don’t think it’s worth the work which by implication invalidates your effort and that feels bad.