I think
Rory is a great name for a boy, particularly because it's a masculine name to begin with. I agree; it's cool and spunky without being childish.
Rory and
Hugh are both great names, but together they do sound a bit abrupt. Maybe something longer would be nice. Here are a few suggestions:
Rory EdmundRory NicholasRory WillemRory GrahamRory FrederickRory LysanderRory FrancisRory AlasdairRory August or
AugustinRory MalcolmRory KennethRory LeopoldRory EugeneRory DouglasRory AdrianRory JeremiahRory ChristopherRory LeanderRory MatthiasRory ClarenceRory JulianRory Tobias