A famous bearer of the surname was James Madison (1751-1836), one of the authors of the American constitution who later served as president (and after whom Madison Avenue was named).
In the United States this form was more popular than the full form Elizabeth from 1958 to 1978, and was in fact the top ranked American name between 1962 and 1969.