The promontory was probably named after early Finnish settlers in the New Sweden colony in the early 17th century. According to historical records, settlers began crossing the Delaware from Fort Christina to the east bank of the Delaware as early as 1638. In the 1670s the area became settled by English colonists from the New Haven Colony as part of Fenwicks Colony.
The promontory is the location of Finns Point National Cemetery, a military cemetery used in the American Civil War for Union and Confederate soldiers who died while at Fort Delaware on Pea Patch Island. It was also the location of Fort Mott, constructed after the Civil War and used up through World War I to protect the E.I. du Pont de Nemours and Company facilities upriver at Carneys Point Township, New Jersey, as well as the port of Philadelphia. The fort is now part of Fort Mott State Park.