This year I read/listened to 30 nonfiction books in philosophy, History, and science. It's been extremely enjoyable and rewarding.
My best advice is to put down bad books after 20 or 30 pages.
That said, I agree 100% about giving up on books early and often.