The Stand Up for the Week host told Digital Spy that he does not believe comics "shouldn't" or "can't" say certain things, but added that there is some subject matter he would not tackle himself.
"My personal opinion is that I don't ever do jokes that are about disability or cancer or what are seen as 'edgier' topics," Richardson said.
"I've been affected by those things myself and I think that comedy should be a safe place for people."
He added: "It doesn't mean you can't discuss important things, but I would never do a joke about cancer just because I don't think any joke is funny enough to justify upsetting someone who is going through that.
"Even if it's one person in an audience of a million. I, as a person, just simply can't justify making someone's life worse for the sake of a routine. I tend not to talk about those things. But that doesn't mean it's not other people's decision if they want to."
Richardson's 8 out of 10 Cats colleague Jimmy Carr recently admitted that he never feels guilty about his controversial material.
Stand Up for the Week returns tonight (Friday) at 11.10pm on Channel 4.
> Read our full interview with Jon Richardson
Watch Jon Richardson talk about climate change below: