A winger, Ernie Williams started playing football for his home-town team Ryde on the Isle of Wight. He also turned out for Portsmouth and was a Hampshire county player who won three England amateur caps, making his début against Wales in 1908. He was then one of the non-travelling reserves for the Great Britain squad for the London Olympics. Williams moved to Chelsea in July 1909 and spent one season with the London club, playing eight League and Cup games, making his début in the 2-1 win over Tottenham Hotspur on 18 December. He returned to Portsmouth and, after touring Italy with the English Wanderers at Easter 1912, he moved to rivals Southampton for one final season. Williams remained an amateur throughout his career and after football continued his career as a schoolteacher.