The Britain's Got Talent judge, who interviewed Prime Minister Gordon Brown earlier this year, mocked the Conservative leader for choosing to be interviewed by Sir Trevor McDonald instead.
"I think it shows he's a coward. He could have had me but he went with Trevor McDonald," Morgan told Star magazine. "It's like being asked to do Jeremy Paxman but ending up with Fern Britton."
Speaking about his interview with the PM, he added: "Talking to Gordon Brown was the most extraordinary experience. To have the serving Prime Minister sitting there, answering such personal questions was special."
Morgan's Life Stories viewing figures dropped to 1.98m at the weekend, when he spoke to Michael Winner.