Gilling Castle lies on a hill overlooking the village. It began as a towerhouse built by Thomas Etton sometime in the fourteenth century. Later in 1492 it passed to the Fairfax family and remained in their hands until 1793. Most of the castle we see today dates from their period of occupancy.
Gilling is the home of the Ryedale Society of Model Engineers (RSME). The RSME railway and club house are at The Old School on Pottergate which is the narrow road running west from the main road alongside the Fairfax Arms.
The village is also known by the name Gilling East.