In a series of YouTube videos posted earlier this week, Mary accused the actor of cheating on her repeatedly during their marriage, as well as "stealing" their son and leaving her with nothing following their 2005 split.
E Online reports that during Tuesday morning's episode of his syndicated radio show, the Original Kings of Comedy star addressed the allegations and insisted that the truth will eventually be known.
"My father always taught me, he'd say, ‘Son, there's three sides to every story - there's their side, your side and the truth'," he said.
"I know the truth. My son is coming into the room crying. And that's what hurts me, why you would do this. And I don't even understand the purpose. I mean, I got you're mad, but [you're talking about] 12 years ago. That's what we're doin' now?"
Harvey went on to insist that he would not retaliate against Mary as it would not set a good example for the former couple's son.
"The truth's gonna come out. Because once you go public, you allow people to start asking questions…I'm just more concerned about my son, who I happen to have total custody of. He doesn't deserve the questions," he explained.
"A lot of it's lies. I don't want nobody to do nothing. Here's my job as a father to my son: I have taught him to just be respectful of his mother and women overall. What he can't do is see me making particular accusations and rants…and I'm not going to."
He added: "It is still his mother and I'm his father, and it's my job to raise him right."