How is "being smart" a genetic lottery? Are you serious? That brings up all sorts of implications with race and whatnot. "Being smart" is often a proxy for the things the GP mentions: strong stable family, access to good schooling, and a sprinkle of luck.
The previous comment's argument appears to be that heritability of "being smart" is not strictly limited to genetic factors, that measures of "smartness" such as an IQ score also measure other factors that are not strictly related to genetics
Heritability and genetic factors are overlapping but distinct things - for example, socioeconomic status influences many aspects, is hereditary but not genetic.