Which problems people work on is dictated to a large extent by the need to publish to keep your job. There is a lot of incentive to work on publishable low-hanging fruit problems. Hence the abundance of “write-only” journals in mathematics.

I don’t think there is by any means a shortage of hard, interesting problems. But working on them directly comes with significant career risk.