Producers are said to be keen to do whatever it takes to improve ratings, after the show experienced its lowest launch since 2006.
Viewing figures for the ninth series of the talent contest are down 3 million on last year, and insiders have said that as well as pushing the 2013 series launch back a month, the team are considering bringing guest judge Mel B back to the panel as a permanent replacement for Scherzinger.
"It maybe airs a little early and people struggle when they might be on holiday or enjoying the sunshine at home," the source said.
"The guest judges just don't work. It's great for audiences who are watching live but it doesn't translate well on the telly.
"People get confused as the lineup's always changing from song to song."
In the meantime, producers are said to be hoping that the end of the Paralympics and the start of the Boot Camp and Judges' Houses rounds - including Cheryl Cole's return as Gary Barlow's guest mentor - will draw in bigger audiences.
Cole was clear to point out that her appearance, filmed earlier this month, took place as a favour to Barlow and wasn't a marketing ploy devised by Cowell.
"I saw Simon's tweet," she is quoted as saying. "I'm not doing this for him. I am doing this for Gary as he's my friend and he asked me to do it."
The X Factor continues tonight at 8pm on ITV1.