Brydon, whose big screen roles include 24 Hour Party People and A Cock And Bull Story, said that he would not copy close friend Steven Coogan and move to the US to boost his film career.
"I'd love to be in some huge American film but that would involve going over there, spending a lot of time, and probably wouldn't happen even if I did that, and I'm just not that fussed," he told The Sun.
"I suppose I've just got to a point where the thing that brings me happiness is not the work."
He added: "The more important thing is my home life, my wider family, all that stuff. That's what makes me happy in the long run. The reality of America would be living over there for a bit, and then how would I take my kids to school? How would I do all that then?"
Brydon, who wed second wife Claire in 2006, has two sons and two daughters from his marriages.