The Monty Python star admitted that he finds the tag insulting because it gives people the impression that he lacks passion.
"People saying I'm nice makes me angry," the Daily Express quotes him as saying. "I think that it's a weak word because it suggests you've got no strong feelings.
"And of course I have very strong feelings about a lot of things."
The 66-year-old claimed that broadcaster Gary Lineker had the same problem before he started his relationship with lingerie model Danielle Bux.
He explained: "People tend to think that those in showbiz are awful, apart from a couple of us like Gary Lineker and myself, who are nice.
"I think Gary is married to a younger woman now so he's lost a few points and doesn't have to be nice anymore. Lucky him!"
Lineker tied the knot with Bux earlier this month.