It would be good to read it with a different mindset. Learning something requires you to feel stupid for a bit, otherwise it's no great feat to learn it (and consequently feel awesome). The problems are all doable, given the expected background of its readers, just not easy or straightforward. If you ignore them you're missing out on 75% of the material - a lot the hard problems require you to apply something from the text that wasn't spelled out for you explicitly.
I didn't ignore them, that's why I eventually gave up. I really enjoyed the book material and the exercises I could understand. But when I ran into an exercise that made me feel like I need to take a non-programming course to comprehend, it was really demotivating.
