I agree with you, though I'm not sure why.
I've only met one
Pamela "
Pam" (she was my babysitter when I was preschool age), and she was nice, but I remember thinking her name was ugly.
I like it more in some accents, but I could say the same thing about
Bertha.