Olivier would frequently get mispronounced as
Oliver in English-speaking countries for sure, that extra i can look quite invisible when you're reading fast and fall back on what you recognize, but I second the thought of
Olivier being much more delightful. It just sounds so dashing and brisk.
Oliver in comparison sounds monotone, and I'm not big on how abrupt the 'ver' ending sounds to me.