Edward succeeded his father as Baron Dudley in 1553, and at one time is thought to have been a Governor of Hume castle.

Edward married:

(1). Katherine Brydges, the daughter of Sir John Brydges the 1st Baron Chandos of Sudeley and Elizabeth (nee Grey) of Wilton (m. 1556)

(2). (m. 1567) Jane Stanley, (a daughter of Edward Stanley, 3rd Earl of Derby). By the Lady Jane Stanley he had the following children:

i) Edward Dudley, who became the 5th Baron Dudley - (b. Sep 17 1567, d. Jun 23 1643).

ii) John Dudley - (b. Nov. 30 1569, d. c. Feb 1644/45).

(3). (m. 1570) Mary, the daughter of William, 1st Baron Howard.

This branch of the Dudley family is of great interest to many family historians, especially in the United States where his cousins seem to have settled.

He is buried at St. Margaret's Church, Westminster, London, England. He was succeeded by his son, Edward Sutton, 5th Baron Dudley (1556-1643).