It's a racial slur, but against the poor. Most White people don't feel sensitive about being White. However, if you're poor, regardless of race, there's quite a bit of shame that goes with poverty. So, it hurts because of class, not race. Regardless, it's hurtful and insensitive. White people can use it and hear it without taking offense, as long as they're not poor.