Why is it that diversity and desegregation always applies to white communities, and always means dumping the worst elements from other communities?

I'm not sure it has ever been a racial thing. No one wants you to send them all your crack addicts, no matter the color. Turns out there are plenty of middle- to upper-class Blacks, Hispanics, and Asians living just fine in white-communities of the same class.