Writing in his Zoo column, the Doghouse star said that it was laughable that Holden had been employed to judge other people on their talent.
"[She] really f***s me off. I know she is an actress but I'd say she's one of the least talented people in the UK, so how she can sit there and say who's got talent is beyond me," he said.
"The only reason that bird first became famous was by having a roll-about with Les Dennis. Now it's sitting there, clapping its hands and giving advice. It makes me feel f*****g sick."
The 31-year-old went on to say that he was not a fan of fellow judge Piers Morgan either, describing him as a "snake".
"I don’t know why [Simon Cowell] rolled in someone like Morgan, a tosser who just loves being famous. Now Morgan’s swanning around acting like he’s the bollocks."
Doghouse opens in the UK on June 12.