Contract negotiations between the panel and the show's bosses will take place on Wednesday, claims The Sun.
Reports that Dannii Minogue may be replaced on the reality show have not been confirmed. However, rumours that Victoria Beckham may take over from the Australian have been denied.
A source commented: "That is utter rubbish. Simon [Cowell] has not spoken to Victoria at all."
"Nothing is being decided or officially discussed until next week," said an insider.