I mostly agree with the you about it coming down to a colonizer vs colonized issue, but I think in the US there is kind of a gray area when it comes to Spanish names in particular. Spain was one of the most powerful colonial nations, but in the modern day United States Spanish speakers are often marginalized and discriminated against. So that’s a bit more complicated imo.
http://www.behindthename.com/pnl/87410