A Facebook campaign has been launched by fans to reinstate the singer, after he was axed at the show's Boot Camp stage.
Whelan lost out on a chance to perform at Judges' Houses to Jake Quickenden, James Arthur, Jahmene Douglas, Nathan Fagan-Gayle, Adam Burridge and Rylan Clark.
A Facebook page titled 'Get Joseph Whelan back onto The X Factor' has so far gained over 220,000 fans.
Tulisa said that she wasn't sure if there was any way he could be given another chance, but she would be happy to see Whelan once again.
"I have no idea what the likelihood of that happening is, but I can say everyone wants a bit of eye candy every year and a nice male figure," she told The Huffington Post UK.
She added: "All of the judges have different opinions. Sometimes it's not unanimous and everyone is making different decisions. From the get go I wanted him in the competition.
"I think he's gorgeous but I was battled with on that one. I am actually a Joseph fan so, 'Hey, bring back Joseph'."
When asked about Whelan's recent comments that he felt "shafted" by the judges, she said: "I don't know what he means.
"We've got to pick somebody and it's not like all of us came to the same decision but if it was up to me he would still be in it."
The judge also picked her early favourite to win the entire competition.
"I'll tell you someone that isn't in my category, I absolutely love James Arthur," she said.
"He's amazing. I think he's got an amazing voice. I think he's going to go so far in the competition - even a potential winner."
The X Factor continues on Saturday (September 29) at 7.30pm on ITV1, where the acts will join their mentors for the Judges' Houses stage of the competition.
Photo gallery - The X Factor Final 24:
Copyright: THAMES TV/SYCO