The actress admitted that she was unpopular with the public before joining the ITV1 show's judging panel in 2007.
Holden cheated on husband Les Dennis with Men Behaving Badly star Neil Morrissey in 2000. The couple announced that they were divorcing two years later amid reports that their marriage never recovered from the betrayal.
"People close to me know the real me. But they were pleased that I was able to show the public what I'm really like," Holden told Take 5 magazine.
"After having an affair, I got the tag of being a minx. A mistake like that, as a woman, stays with you for years. Now the attention is positive. One doesn't like to be disliked."
Confirming that she has not seen Dennis since 2002, she added: "There's no bitterness, although I did turn his life over so I'm not sure he'd want to see me."
Britain's Got Talent continues on Saturday at 8pm on ITV1.