Hugh married Margaret daughter of Humphrey De Bohun, Earl of Hereford and of Essex and maternal granddaughter of King Edward I of England.
They had a large family which included Sir Hugh, Thomas, Edward of Godlington, William the Archbishop of Canterbury, John, Sir Philip of Powderham Castle, Humphrey and Sir Peter. Second son Edward married Emeline Downey who bore Sir Hugh Courtenay, father of the Hugh Courtenay who was killed at the battle of Tewkesbury, 1471.