Brown Deer is a village in Milwaukee County, Wisconsin, United States. A suburb of Milwaukee, it is part of the Milwaukee metropolitan area. The population was 12,507 at the 2020 census. The Brown Deer area was organized as part of the Town of Milwaukee in 1835, and the first white settlers began arriving around that time from New England and New …Brown Deer is a village in Milwaukee County, Wisconsin, United States. A suburb of Milwaukee, it is part of the Milwaukee metropolitan area. The population was 12,507 at the 2020 census. The Brown Deer area was organized as part of the Town of Milwaukee in 1835, and the first white settlers began arriving around that time from New England and New York, including some settlers from Granville, New York. In 1841, the Town of Milwaukee was subdivided and the Brown Deer area became part of the new Town of Granville. In the 1800s, the town was a predominantly agricultural community, and many residents were of German and Irish extraction.