The Twilight actor was reportedly approached by producers after they discovered that he is hooked on the ITV1 talent contest.
Writing on her official blog, show judge Dannii Minogue explained: "I've just heard that Twilight star Robert Pattinson is a HUGE X Factor fan.
"I know the British-born actor now spends most of his time in America but my X Factor crew would love to meet him - so he has officially been invited by the gang to one of the live shows!"
Meanwhile, sources close to the 23-year-old star told The Mirror that he is likely to accept the offer, claiming that he watches the programme from the States and would "love" to meet the judges.
A number of other celebrities, including supermodel Kate Moss, have previously been seen in The X Factor's live show audience.