Lord Charles was the son of the 1st Marquess of Ailesbury and on 2 February 1860, he married Augusta Seymour, a granddaughter of the 1st Marquess of Bristol.
From 1865 to 1874 he was MP for North Wiltshire and for Marlborough from 1878 to 1885.