Sergeant, who has repeatedly scored low marks from the panel of judges, has avoided being voted into the bottom two thanks to the public vote.
Speaking about the political broadcaster's continuing presence on the show, Phillips told the BBC: "He's not making much effort.
"The dancers are constantly working but John just sits there and reads the paper.
"A lot of people are non-stop practising, [but] to achieve what? Why don't the girls just all throw off their clothes and the boys do a comedy dance? Is that going to help?"
Veteran actress Cherie Lunghi was the ninth celebrity to be voted off the dance contest yesterday.