The politician and former TV presenter told the Bush Telegraph that the pair may cause "problems" as the show progresses.
"Esther likes being in control as perhaps we all do," he said. "I think the other two [females] are quite feisty and they're quite opinionated and Carly in particular.
"I've just said to her, she's a control freak."
Tensions between Zucker and Kilroy-Silk came to the surface as they rowed about washing up and collecting wood.
"Sometimes you have to be straightforward and say no," he said. "[Carly's] more forward, pushy and intrusive and perhaps wanting to take over."