The Daily Show host named the British actor as his least favourite guest of all time, and will "never" be invited back.
Stewart made the comments while talking to Stephen Colbert at a fundraiser for the Montclair Film Festival in New Jersey on Friday, December 7.
Grant appeared on The Daily Show while promoting his 2009 movie Did You Hear About the Morgans?
"He's giving everyone s**t the whole time, and he's a big pain in the ass," Stewart said. "And we've had dictators on the show."
Stewart added that Grant later complained about the clip provided from the movie, asking him: "What is that clip? It's a terrible clip."
"Well, then make a better f**king movie," Stewart joked, saying he would "never" have Grant back on The Daily Show in the future.
Hugh Grant will next star in multiple roles in the upcoming epic project Cloud Atlas.
Cloud Atlas opens in the US on October 26, 2012 and in the UK on February 22, 2013. Watch a Digital Spy exclusive featurette below: