The singer said that he is currently working on the follow-up to his 2011 debut Letters, but insisted that it must be right before he will release it.
Cardle told the Daily Star: "I'm writing all the time. I'd like it out ASAP but like Letters, it has to be right and I'm not going to be rushed.
"There are well-known artists out there who have had two or three Top 10 singles and barely sold any albums."
He continued: "Perception-wise, people are like, 'Oh they've had three hits, they must be creaming it', but it's absolutely the opposite.
"You can't live off singles but what you can do is keep an album bobbing away."
Cardle recently admitted that he would love to record a collaboration with Coldplay frontman Chris Martin and called the star an "absolute genius".
> Matt Cardle performs acoustic versions of 'Amazing', 'When We Collide'
Watch the music video for Matt Cardle's recent single 'Amazing' below: