The architects say much of the current furniture, crafted by Victorian sculptor Henry Fehr, will have to be removed.
Much of it will be reused elsewhere in the building or at Snaresbrook Crown Court in east London.
But conservationists are appalled and have asked for a judicial review of Westminster City Council's planning process.