Ernest graduated from Deshler High School and Florence state University. He lettered in football, track, and cross-country on both the high school and collage level. At Deshler he played for Coach Buddy Moore and started on both offense and defense for the Tigers. As a member of the Florence State Lions, Ernest played for Coach Hal Self. He was All-Alabama Collegiate Conference from 1962-1965, caught a school record of 11 passes for 189 yards against Jacksonville State in 1965, and never missed a game or practice in the 4 years he played. In addition to being a great athlete he served 20 years in the Alabama National Guard retiring as a Lieutenant Colonel..

​