A source told The Sun that Tulisa's debut The Female Boss, which is released on Monday (December 4), is not expected to make the album chart top five, but could be further damaged by her appearance on the ITV1 talent show this weekend.
Tulisa is due to perform new single 'Sight of You' on the Sunday night results show.
The unnamed insider said: "We're not thinking it will be number one - that's never going to happen. It won't be top five in a million years. But hopefully it will make the Top 10.
"The X Factor thing is a risk as it might not translate into sales and everyone will just slag off her performance if it's anything less than brilliant."
Artists who perform on the show typically see an increase in sales, with Bruno Mars and Rihanna enjoying a respective 67% and 36% boost in their album figures following last week's appearances.
Tulisa hit number one with her first single 'Young', but its successor 'Live It Up' reached number 11.
Watch the video for 'Sight of You' below:
> Win: Tulisa 'Live from the 34th Floor' tickets
> Tulisa boyfriend Danny Simpson's dad 'arrested over kill threat'
> 'X Factor': Louis Walsh walked in on naked Tulisa