Architect Benjamin Latrobe had proposed to President Thomas Jefferson that colonnaded extensions be added to the east and west sides of the White House. Instead, original architect James Hoban returned and in 1825 and 1829 supervised the construction of south and north porticos to the White House.

Above is a sketch of James Hoban's design for the initial White House.

While George Washington is the only President to have never lived in the White House, he along with architect James Hoban was responsible for its design. He also laid the first cornerstone and oversaw its design.