The whole building was painted in white color sandstone following the latest Georgia style at that time. During 1812 War, the building was burned down by the British Army. The whole building structure is then destroyed. The reconstruction began immediately after the war and James Monroe shifted into in 1817. At that time, the work was partially completed.