If someone says "c'mon, it's not that hard" they don't mean it's difficult, and I suspect you know that.
My point is that's frequently false.