The America's Got Talent host and Carey are parents to 1-year-old twins Moroccan and Monroe, who were born on the couple's third wedding anniversary in 2011.
Cannon recently attended a holiday toy drive in Los Angeles, where he scoffed at the idea of any new arrivals to his family in the near future.
"More kids? Two kids are enough," he teased.
He went on to insist that having children has changed his and Carey's marriage for the better.
"We are parents now; it's a whole different dynamic in the household," Cannon explained to Life & Style. "It solidifies what a family is all about."
Cannon recently praised Monroe and Moroccan's intelligence by claiming that they are already fascinated by technology.
He has also teased that he is under pressure to buy Carey the perfect Christmas gift this year.