The boyband, who were voted off the ITV1 talent show, were rebranded "No Vibe" by judges Gary Barlow and Louis Walsh after their rendition of U2's 'With or Without You'.
"Nu Vibe - sorry guys, but no vibe for me. At this stage of the competition I'd be expecting to hear vocals a lot tighter than this," said Barlow on Saturday night.
Jordan Higo, Stefan Romer, Bradley Johnson, Richard Milford and Ashford Campbell then became a trending topic on Twitter as viewers joked about their disappointing performance.
Johnson claimed that Barlow's remarks and the public response did affect them over the weekend.
"Every comment [Gary] said to us, did go against us," Johnson told DS. "It did go against us, every single comment. He would say things like the 'No Vibe' thing and then people picked it up and started tweeting about it.
"That did get to us a bit on Saturday."
Campbell commented: "Some of the things he said, we took on board and we would have taken him on next week by proving him wrong. But we're not going to get that opportunity."
Higo added: "I think maybe Gary has got something against us."
Nu Vibe lost out to Frankie Cocozza in last night's first X Factor sing-off of the series.
> Nu Vibe 'X Factor' exit interview - In Full