James Monroe came from an wealthy family

James Monroe was born April 28, 1758, in a house owned by his parents in a wooded area in Westmoreland County, Virginia. His father, Spence Monroe (1727–1744), was a reasonably successful plantation owner and slaveholder who also worked as a carpenter. Spence Monroe and his mother Elizabeth Jones (1730–1772) had five children together: Elizabeth, James, Spence, Andrew, and Joseph Jones.

James Monroe began attending Campbelltown Academy, the only school in the county, when he was 11 years old. He only spent 11 weeks a year in this school because the farm needed his labor. During this time, John Marshall, an older classmate, and Monroe grew close. Both Monroe's mother and father passed away in 1772 and 1773, respectively.

Although both of his parents left him property, including slaves, 16-year-old Monroe was compelled to drop out of school in order to help his younger brothers. Monroe and his siblings adopted Joseph Jones, his illegitimate maternal uncle, as their biological father. Jones, a member of the Virginia House of Burgesses, brought Monroe to Williamsburg, the state's capital, and registered him at the College of William and Mary. Additionally, Jones introduced Monroe to notable Virginians like George Washington, Patrick Henry, and Thomas Jefferson.