Yes, the "AY" sound come from the later A. The thing is that in Spanish, vowels have a dry sound and in English they are more like a compound sound, like this:
Vowel English prn Spanish prn
A "AY" as in Aid "UH" as in
America E "EE" as in English "EH" as in Exit
I "EYE" as in Icon "EE" as in Idiot
O "OW" as in
Owen "OH" as in Octopus
U "YOU" as in Universe "OO" as in Boo
So when a person who thinks in English sees the Spl. José, s/he will read "how-say". Just as it happens with the RR sound in Spanish. I know very few Anglo speaking people who can really role those RRRRRs and say "WROWHOW" instead of "RRRRRROJO"(rojo) and "GWUHSEEAS" instead of "GRRRRRACIAS"(gracias).
It is the same with anyone trying to speak a foreign language...Try to get a French guy to prn
Winnie the Pooh and you will get something like "We-NEE see Pough"(no offense intended. You should listen to a fellow Central American saying
Mickey Mouse... you would pee of laughter...)
I talk too much, I know... :o/
~Magia~