The pop superstar judged the second season of the show which wrapped last week but will reportedly be replaced for next year's contest.
> 'X Factor' USA: A look back at Britney and Demi's first season
> 'X Factor' USA: Five things we liked most about season two
"Britney will get the boot," a supposed insider told Us Weekly.
"Producers wanted her for the long haul, but it isn't working."
It is claimed that Spears's reported $15 million contract is a stumbling block, with a second source adding: "They paid all that for her to say 'amazing' and offer half-claps."
An alleged third source said that show boss Simon Cowell "wanted crazy Britney, but he got boring Britney".
Fellow judge LA Reid has confirmed his departure from the show and said that his replacement should be someone who "really loves music and really loves talent".
X Factor USA - The Finals - Part Two: Photo gallery