The singer, who was runner-up on the show in 2005, told The Times that he is still performing and trying to build his own "brand" after being dropped by Sony following the release of his second album.
Of other losing participants, Abraham said: "They'll realise quickly that the industry doesn't want them.
"You've got to understand that the only reason your first single gets to number one is the X Factor brand, and when the costs are all added up, you don't make any money out of it. Once the show moves on it's an uphill struggle."
However, Andy Pemberton of that year's third-placed duo Journey South insisted that he would "never say anything bad about X Factor".
"We make four or five times what I was making as an electrician. If it wasn't for that show me and Carl would still be playing gigs in horrible pubs with our mum and dad sat there," he added.