No Breton connection as far as I know. The name belongs to the North of France, as this map shows -
http://www.geopatronyme.com/cgi-bin/carte/famcarte.cgi?nom=Lavictoire&client=carteIt may be a metronymic, Victoire was a female given name, from a saint whose Latin name was Victoria.