The Strictly Come Dancing host explained that he has never managed to sit through a full episode of Simon Cowell's talent series because he does not find it entertaining enough.
Speaking to The Mirror, Forsyth commented: "It's not my cup of tea, I haven't watched an entire show. I can't hear people singing for two hours, that to me is not entertainment.
"I'm an old variety performer, I want to see a juggler, or something to break it up. I hate seeing people disappointed in public. It can be embarrassing at times."
The veteran entertainer also claimed that the ITV1 programme has become too over-the-top, remarking: "Bigger venues and the pyrotechnics made it much more of an event last year. Sometimes it was like a firework display with someone singing to be voted on. The electricity bill must have been enormous."
The X Factor and Strictly Come Dancing will both return to screens later this year.