Martin Kauffman was one of the earliest settlers in Virginia's Shenandoah Valley, arriving in 1732. His son, Martin Kauffman II built the White House in 1760 as a home, a Mennonite meeting place and a fort. Gun ports in the cellar allowed the settlers to shoot at attackers.
A couple of hundred yards from the house, the current highway bridge crosses the river. In 1862, Confederate General Stonewall Jackson ordered the burning of the White House bridge to delay the pursuing Northern Army.
The White House is listed on the National Register of Historic Places.