Speaking to Digital Spy at the Collar & Coats Gala Ball for Battersea Dogs & Cats Home last week, Holden admitted that her boss and fellow judge is "disappointed" with The X Factor's performance this year.
"I think that he's probably disappointed, but if he's got any sense he'll get on his white horse and he'll come charging back next year and save it," she said.
"I think Simon should come back to the UK. I just miss him. I want him to come home."
Holden also revealed that she is already "planning outfits" for the upcoming seventh series of Britain's Got Talent, and declared that she would like a comedian to triumph when the show airs next year.
Confirming that Cowell, David Walliams and Alesha Dixon will join her on the panel again, Holden continued: "I'd say that we're comfortable now and hopefully this panel will stay.
"I think the show's gonna run for at least another three years, so it'd be great if we all stayed for that long."