James married Elizabeth White McQuiston on 15 Dec 1870. Elizabeth (daughter of Dr. William C. McQuiston and Mary Eleanor Chisolm) was born on 14 Apr 1852 in South Carolina; died on 20 Feb 1920. [Group Sheet] [Family Chart]

1. Mary Eleanor Castles was born on 21 Dec 1871; died on 23 Sep 1907.
2. Alice Emma Castles was born on 13 Jan 1873; died on 24 Nov 1901.
3. William Thomas Castles was born on 17 Jan 1875; died on 10 May 1923 in Memphis, Shelby County, Tennessee; was buried on 11 May 1923 in Atoka, Tipton County, Tennessee.
4. Dr. James Knox Castles was born on 17 Mar 1877; died on 15 Aug 1905.
5. Lois Castles was born on 2 Feb 1880 in Rosemark, Shelby County, Tennessee; died on 11 Sep 1947 in Memphis, Shelby County, Tennessee; was buried on 13 Sep 1947 in Atoka, Tipton County, Tennessee.
6. Castles was born on 27 Nov 1881; died on 27 Nov 1881.
7. Charles Cabeen Castles was born on 19 Nov 1882 in Tennessee; died on 31 Aug 1945 in Shelby County, Tennessee; was buried on 2 Sep 1945 in Rosemark, Shelby County, Tennessee.
8. Elizabeth Chisolm Castles was born on 31 Jul 1885 in Tennessee; died on 9 May 1922 in Memphis, Shelby County, Tennessee; was buried on 10 May 1922 in Kerrville, Shelby County, Tennessee.
9. Ruth Castles was born on 20 Aug 1887; and died.
10. Hope Castles was born on 24 Jan 1890; and died.
11. Castles was born on 24 Jan 1890; died on 27 Jan 1890.