Well, I just don't find it appropriate for a boy, it's like naming a girl Jim or Mike.
You might be able to get away with it as a childhood nickname within family though, for a P- name like Philip for example but it's nothing I would do. Maybe you will come around and start liking it more for a girl?