After playing 15 years with Toronto, Etobicoke, Mimico and Hamilton where he won a Mann Cup in 1948, Elmer would go on to coach the Orillia Terriers, Long Breanc Pontiacs and Port Credit Sailors at the senior level from 1956 to 1963.

In 1960 he coached Port Credit to their only Mann Cup Title.

Lee was well respecrted as a coach and player and was known as the "most winning coach" in Lakeshore history.