Asbery Noah Whiteside was born in Rutherford County, North Carolina and was the son of William Whiteside and Ada Lewis Whiteside on March 15, 1910. He was married to Eula Lyday Whiteside and died in Hendersonville, Henderson County, North Carolina on May 21, 1960 buried at Pleasant Hill Cemetery on May 24, 1960.