I agree with the sentiment below that middle names aren't used much. My only hesitation, as a nerd, would be if the names were variants of each other, like
Mary Marie,
John Evan, or
Charlotte Caroline. The child would get only one name really and you would look silly -- to a nerd like me at least. But there's no real harm in it either and if you love it then that's all that matters.