Joseph and his first wife Anna Beard came to Vermilion County, Illinois, October 10, 1830, from Mason County, KY, and bought 80 acres of land on Section 26, St. Joseph Township, which in 1833, became a part of Champaign County. Anna died around 1834-1837 and Joseph married Elizabeth McCollom August 19, 1837.

Joseph had eight children by his first wife Anna Beard, whom he married April 5, 1817, Mason County, KY. These children are David B., Joseph Jr., Amos G., an unknown son as shown by the 1830 and 1840 Federal Census, Sarah, Martha Ellen, Mary, and Tabitha Ann. Joseph had five children by Elizabeth McCollom which are Robert James, John H., Elizabeth, Hester A., and Emeline.552