Empire Bay was originally known as Sorrento being the name of a large boarding house in the locality. The land was subdivided in 1905. The name changed to Empire Bay in 1908 when a Postal Receiving Office was opened in a building attached to the boarding house. The name was changed because there was already a post office named Sorrento in Victoria and Empire Bay was chosen because there was no other such name in the Commonwealth. The name was officially changed on 24 May 1908. William Huggart who owned Sorrento House was the first postmaster. In 1909 the status of the office was changed to Post Office. It was moved into C. C. Swinburne's general store when he became Postmaster in 1910.