Born to Sidney and Judy Gordon, he is the oldest of three children. In 1960, the Gordon family moved to Phoenix where Phil attended Madison Meadows Elementary and Middle School and Central High School. He attended the University of Arizona and graduated with a bachelor's degree in education. After earning his undergraduate degree, Gordon entered Arizona State University Sandra Day O'Connor College of Law.
Gordon has had worked in a variety of professions, including as a school teacher, lawyer, business owner, chairman of Landiscor Aerial Photography Company, as well serving on the Madison School Board.
After serving as chief of staff to a former Phoenix Mayor in 1996, Gordon's interest in Phoenix became his incentive to seek public office. Pledging to fight crime and preserve neighborhoods, he entered the race for Phoenix City Council and was elected in 1997 and 2001.
The former city councilman was elected mayor in the non-partisan mayoral race on September 9, 2003, garnering 72 percent of the vote, and re-elected on September 11, 2007, with 77 percent of the vote.
During his tenure at Phoenix City Hall, Gordon has focused heavily on revitalizing downtown Phoenix. He and other members of the Phoenix City Council have put more than $1 billion into the city's core, investing in projects such as the revitalization of the Phoenix Convention Center, the construction of a new $350 million Sheraton hotel, and the creation of a downtown Arizona State University campus.
Gordon has also been a staunch backer of a planned $1.1 billion multi-modal transportation system which was approved by 65 percent of Phoenix voters in March, 2000. a project that has faced criticism. Most recently, the Mayor has engaged in a verbal dispute with Maricopa County Sheriff Joe Arpaio over issues related to illegal immigration.