"Compiling my own kernel" is often a metaphor for the effort involved in running a Linux system. I run a dual-boot Windows/Ubuntu system right next to my MacBook using SynergyKM to control both, so I have a good opportunity to compare both on a daily basis. The "compile my own kernel" factor with recent distributions of Ubuntu (9.10 and newer) is really, really insignificant.

So, it's a mixed bag. "Linux" means so many things that it's hard to say "Linux is easy to use" or "Linux is hard to use" and not be right in both cases.