Marriage records show that Warren married a Sally Fairley. However, it appears that Sally died shortly after they married. Together they had three children: Quitman, Elbert and Melvin. Census tracts for 1900 list him and his three sons in the home with his father and mother, Bat and Ammie. This is during a time that his wife has passed and his parents are up in years. He is also listed in the 1910 Census residing with his sister, Violet and nephew, Bill Williams, and is shown as a widower.