The Littleton family had their origins in South Lyttleton, near Evesham, Worcestershire. Thomas de Lyttleton was appointed a judge at the Court of Common Pleas in 1464 and was created a Knight of the Bath in 1475. His son Richard married Joan Winesbury heiress of Pillaton Hall and his grandson Edward, who was appointed Constable of Stafford Castle for life, was High Sheriff of Staffordshire on three occasions. All subsequent Pillaton heirs were named Edward.
The Baronetcy became extinct in 1812 on the death of the 4th Baronet whose heir was Edward John Walhouse (see Baron Hatherton)
The Baronetcy of Littleton of Stoke Milburgh was created in 1642 for Adam Littleton, a descendant of Thomas Litleton of Speechly, Worcestershire, a younger son of Thomas de Lyttleton (above) ; this baronetcy became extinct upon the death of Sir Thomas Littleton, sometime Speaker of the British House of Commons, in 1709.