Joel Lewis Nixon (1818-1896) was born to Joel Nixon (1781-1855) and Hannah Milbourn Nixon (1781-1855) in Loudoun County, Virginia. Joel Lewis married Mary Jane Turner (1821-1891) on 25 July 1845.

In 1860, the family was living in Waterford and had the following children living with them: George Henry (1846-1899), (Emily) Florence (1848-1933), Ada (1851-1937), William Westwood (1853-1909) and Lewis Nixon (1861-1940), the naval architect. By 1870, the family was living in Leesburg.

Throughout his life, Joel L. Nixon was employed in various occupations working as a merchant, a deputy sheriff, and justice of the peace. He was also served as colonel of the 57th Virginia Militia. Nixon was politically and socially active. In 1851, he attended the state Democratic convention in Staunton, Virginia. For years, he served as overseer of the poor in Loudoun County, holding the position at the time of his death.

His son, George Henry, married Virginia Ellen (Hattie) Milbourn (1856-1944) on 9 May 1878. They had four children: Reginald D. Lee (1879-1964), Mary Jessie (1883-1884), George L. Nixon (1885-1893), and Orra Blanche (1891-1933). According to his obituary, George Henry joined the 43rd Battalion Virginia Cavalry, Company D, known as "Mosby's Rangers" in 1864 and was later transferred to the 35th Battalion Virginia Cavalry, Company A, known as "White's Battalion." George H. Nixon and his brother, William, were proprietors of the Linden Hotel located on 20 South King Street in Leesburg, Virginia. The Nixon family is interred at Union Cemetery in Leesburg, Virginia.