There's a lot more to it than that. Ride through some rural parts of the country, like in WV...it's pretty easy to find generation after generation of poverty that has nothing to do with race or trying to reach back to slavery. Some people continue the cycle, some don't.
No one who is alive today has been affected by slavery. Certainly, some people a born with more opportunity than others but that's the reality of life for everyone. BTW, I'm one of the people that grew up with less opportunity.