I would definitely go with
Noel, especially if you live in Sweden. I do too, and my brother is named
Noel, and as you say, pronunciation is not a problem at all. I also like it because it's rarer than the other two, I feel like everyone is named
Oliver or
August these days.