Speaking on GB News, the former Conservative minister said: "I think that the only flags that should be thrown from a government building are, first of all, the national flag from our case ...