Jimmy graduated from Sheffield High School in 1959 where he was a four sport sport letterman. He was captain of both the football and basketball teams his senior season. As a Bulldog athlete he was All-State in both basketball and football during his senior season and was chosen to play in the East-West All-Star Baseball Game.He was also   a member of the North  squad in the 1959 All-Star football game. Following high school Jimmy went on to play for the University of Alabama playing on Coach Paul Bryant's first team bowl team in 1959. In 2000 he was chosen as one of the best football players in Sheffied High School History and an All-Time member of the Coffee-Sheffield Thanksgiving Classic.