There are both, and they are related. For example family wealth and wealth accumulation in the US is weighted heavily to home ownership and appreciation, the GI bill that powered a great deal of home purchases was structured to exclude blacks, and the combination of those facts shapes the distribution of wealth today. Expensive neighborhoods tend to have better public schools, the quality of that schooling is a lifelong advantage, yet redlining was only banned around 50 years ago. This directly affected the cohort of people in their 60s who are still part of the work force. Overall social mobility in the US is pretty poor compared to other wealthy countries but I'm not sure if there is any rigorous work to attribute causes.
There's also trailer parks, Appalachia and dying mid-western towns. I'm guessing a majority of them don't have access to better public schools. Sounds more of a problem of how public schools are funded than structural racism, which benefits richer districts. This is a good example of a class issue, since there's no shortage of poorer white folks as well. Yes, there's a smaller percentage of them, but also a larger overall number (5.3 million non-Hispanic white children in 2019 compared to 4.1 million black).
