'I don't understand how a building like this can be demolished,' said one 'devastated' campaigner.