The comedian, who quit the series in 2010 following his sex text scandal, explained that he never intended to stay in the job longer than a year.
© Rex Features / Ken McKay/ITV
© BBC
"It wasn't me really. I miss the team and Alex [Jones], but for a comic it was quite constrained... harder than I thought it would be," Manford told The Mirror.
"It was good experience. But when I flick it on and see Matt [Baker] and Alex I think, 'These two are better'. They look right. I felt like I was wearing my dad's suit and was a little bit constrained.
"My mind as a comic works at a different speed to other people's and you just say what you think and try to get a laugh. I don't think it would have been a long-term thing anyway. I would have done the year and got out."
Manford revealed that he now plans to limit his TV exposure as he focuses on his stand-up career.
"Stand-up is my favourite thing because it is so direct and you get an immediate response," he said. "There is no director, there is no-one in your ear telling you what to do, there is no Ofcom, nothing like that."
