Although George Washington selected the site of the White House in 1791, he never lived there. As of 2014, he is the only president who did not reside in the White House.
John Adams and his family were the first presidential family to live in the White House. In 1814, the British set the house on fire; it was rebuilt. In 1817, James Monroe moved in. Harry S. Truman began the restoration of the White House and moved back into the White House in 1952.
Under some presidents, the White House went through construction that did not require the First Family to move out. Theodore Roosevelt had the president's offices moved to the West Wing and William Howard Taft had the Oval Office built.