The quickfire comedian told Digital Spy that he prefers panel shows like Call My Bluff, which give the contestants their own time rather than having them fight one another for gaps.
"Someone sort of asked me to do it and I kind of declined, because I'm a bit rubbish at panel games," Vine said.
"Whenever a little gap turns up, everyone's jumping for that gap. I'm a bit rubbish at that. The honest truth is I find it a bit safer to be the funny one."
He continued: "You get a situation where the gap appears and people who are more confident than you jump into the gap.
"Then you find four or five minutes have passed and you haven't said anything, so you think to yourself, 'Flip I need to get involved - so the next time a gap comes I'm jumping for it'."
Vine added: "So the moment comes and you're in there and you say something and you jump for the gap before you really have anything to say in the gap and it's a bit rubbish.
"All that does is erode your confidence even more. I'm not good at it as some people... I'm not competitive enough for it. I'm just not good enough at it."
Show regular Andy Parsons has admitted that some comedians feel hard done by because of the tight edit on the show.
Chris Addison has said that the show is not as "aggressive" as it is claimed and that the atmosphere is in fact "very playful".
> Read Digital Spy's full interview with Tim Vine
Tim Vine's new DVD The Joke-amotive is released on November 21. Watch the trailer below: