TV
The 47-year-old, who created the talent show's format for ITV, is still furious with Sharon for getting involved in a bust-up with Chris Tarrant in front of shocked audience members last month. He also believes that Osbourne's comments in the third series were not witty or memorable enough to warrant her huge salary.
"I have never seen Simon so angry as he was after Sharon's row with Chris," a show source told The People. "Despite his image, Simon hates rude behaviour.
"He has become increasingly disappointed with both Louis and Sharon. He wants X Factor judges to come out with comments that viewers will remember. He feels they could do better on the show and it could be time for a change."
Osbourne's future on the show was previously questioned following her tirade against Steve Brookstein in the series one final.
Tube Talk
'Friday Night Lights': Why watch?Tube Talk explains why you should watch Sky's new show Friday Night Lights.
TV Interviews
'The Bachelor' Blakeley Shea - interviewModel was sent home following a two-on-one date with Ben and Rachel.
Reality Bites
Does Simon Cowell have new SuBo?: VideoWatch a clip of Jonathan Antoine, who is tipped for success on BGT.
TV Ratings
'Take Me Out' climbs to 5.1mThe ITV1 dating show fails to register a significant boost despite last week's controversy.
