The music mogul, who has seen ratings for the British version of the talent show tumble since he left to launch the American edition, is planning a Christmas meet-up with the Bajan singer, according to The Sun.
Cowell is so focussed on getting Rihanna to join the franchise he is willing to offer her a judge's slot on either side of the Atlantic, a source told the newspaper.
The insider said: "Simon is a huge admirer of Rihanna and knows she's star quality. As well as bringing an aura to the panel thanks to her current standing in music, she is also feisty and will make great TV. Simon loves these sort of characters."
Cowell is also allegedly eyeing Rihanna's on-off boyfriend Chris Brown to replace LA Reid on The X Factor USA, after the music producer confirmed he would depart following two seasons of the Fox show.
"The US X Factor has improved on the first season's ratings but it's got some way to go to reach Simon's expectations. Adding Chris to the panel will certainly create a talking point," the source added.
> Exclusive: 'X Factor' Dermot O'Leary: 'Don't be snobs about James Arthur'
> 'X Factor' USA season three audition details confirmed
> 'The X Factor' USA result: Season two finalists revealed