It was a royal residence for a short time, after the 9th Duke of Norfolk offered it to Frederick, Prince of Wales, following his marriage in 1736 to Princess Augusta of Saxe-Gotha. The couple lived there 1737–1741, and their son King George III was born in the house. The family moved to Leicester House in 1742, and it was to remain the prince's home until his death nine years later, and that of his widow until her death in 1772.
The original Norfolk House remained in the ownership of the Dukes of Norfolk until 1938 when it was pulled down, and the site became an office building. During the Second World War this building served as offices for senior officers from a variety of Allied armed forces, including the Canadian 1st Army and the Supreme Headquarters Allied Expeditionary Force under General Dwight D. Eisenhower. Two plaques on the exterior of the building acknowledge the role of the building in the War. Today the 1930s building on the site is occupied by offices, the interior having been fully refitted in recent years.
Parts of the interior of the eighteenth-century house survive, having been removed before demolition, including the Music Room, designed by Giovanni Battista Borra for the ninth Duke's wife Mary. Having been in storage, the room is now displayed in the Victoria and Albert Museum, restored and redecorated to its original scheme of brilliant white paintwork with gilt, carved woodwork.
Plaque says: Norfolk House in this building 24 June 1942 – 8 November 1942 General of the army Dwight D Eisenhower Supreme Allied Commander formed the first Allied Force Headquarters and in conjunction with the commanders of the fighting services of the Allied Nations and the Authorities in Washington and London planned and launched Operation "Torch" for the liberation of North Africa and later 16 January 1944 – 6 June 1944 as Supreme Allied Commander Allied Expeditionary Force in conjunction with the commanders of the fighting services of the Allied Nations and the authorities in Washington and London he planned and launched Operation "Overlord" for the liberation of North West Europe.
Plaque says: The United States of America recognizes the selfless service and manifold contributions of General Dwight David Eisenhower, Supreme Allied Commander, 1944–1945. At this site, General Eisenhower, on behalf of Freedom loving peoples throughout the World, directed the Allied Expeditionary Forces against Fortress Europe, 6 June 1944. This Plaque was dedicated by a United States Department of Defense delegation and the Eisenhower family on 4 June 1990 during the Centennial year of his birth and the 46th Anniversary of Operation Overlord.