The winner of the 2010 X Factor told Flavour magazine that he has in fact had a fantastic year.
"It annoys me sometimes because people are too quick to write me off, and they have been doing so ever since I came off the show," Cardle said.
"They seem to forget the fact that my first album was platinum. I have just had another top ten record.
"That's two top tens in one year, and people are still out there saying that I haven't been successful, it gets frustrating."
He added: "But it doesn't seem to matter what I do as people want to give this perception that I have failed or it's the curse of a male [X Factor] winner, when it has not been - as I've had an amazing year.
[Left: Cardle in new video / Right: Winning X Factor 2010]
"Earlier this year, the first album went platinum, and I also had a sold-out tour. So to have had another top ten [album] off the back of going to an indie label - I just couldn't be in a better position."
Of reports of him feuding with X Factor boss Simon Cowell or contestants on the show, Cardle said: "It makes me laugh because it's all bulls**t."
Cardle recently announced details of an unplugged tour of the UK and Ireland.
He releases new single 'Anyone Else' on December 31. The track is the latest to be taken from Cardle's second album The Fire.
Watch the Matt Cardle 'Anyone Else' music video below: