There's a difference between criticizing a name and criticizing the people who choose to use the name, and/or making any assumptions about them. The latter is offensive while the former is not.
I'm okay with people saying that
Victoria (my daughter's name) is snooty, prickly, unfriendly, harsh, what-have-you, but if someone said that I must be a pretentious snob or a wanna-be aristocrat because I used it, I'd be offended.