Possibly a diminutive of names containing the Old English element burg "fortress", as in the case of an 8th-century abbess by this name who corresponded with Saint Boniface and whose full name was Heahburg. Alternatively, it could be related to the Old English verb bugan meaning "to bow down".