The Village of Philmont is located in the northeast corner of the Town of Claverack on Route 217.
According to the United States Census Bureau, the village has a total area of 1.2 square miles (3.1 km²), of which, 1.2 square miles (3.1 km²) of it is land and 0.04 square miles (0.1 km²) of it (2.48%) is water.
The village is by the Ockawamick Creek.
There were 576 households out of which 34.2% had children under the age of 18 living with them, 45.0% were married couples living together, 11.6% had a female householder with no husband present, and 37.3% were non-families. 29.5% of all households were made up of individuals and 13.7% had someone living alone who was 65 years of age or older. The average household size was 2.55 and the average family size was 3.20.
In the village the population was spread out with 28.9% under the age of 18, 8.0% from 18 to 24, 29.4% from 25 to 44, 19.9% from 45 to 64, and 13.8% who were 65 years of age or older. The median age was 35 years. For every 100 females there were 98.4 males. For every 100 females age 18 and over, there were 94.5 males.
The median income for a household in the village was $31,094, and the median income for a family was $41,944. Males had a median income of $27,188 versus $23,274 for females. The per capita income for the village was $16,162. About 11.3% of families and 13.7% of the population were below the poverty line, including 14.9% of those under age 18 and 6.3% of those age 65 or over.