A member of the prominent Guest family, he was the third son of Sir John Josiah Guest, 1st Baronet, and his second wife Lady Charlotte, daughter of Albemarle Bertie, 9th Earl of Lindsey. Ivor Bertie Guest, 1st Baron Wimborne, was his elder brother, while Ivor Guest, 1st Viscount Wimborne, Frederick Edward Guest, Henry Guest and Oscar Guest were his nephews. He entered Parliament for Youghal in a 1869 by-election, a seat he held until 1874, and later represented Wareham from 1880 to 1885.
Guest died in November 1909, aged 70. He never married.