I think the issue of the original poster was being a math graduate. Little to do with class or social economic background.

With maths, you can work as a professor or work in finance. Two domains with limited demands that are highly competitive.