The 21-year-old told journalists including Digital Spy that he wouldn't seek out a romance with any of his fellow contestants or female fans.
Asked if he had his eye on any X Factor co-stars, Douglas explained: "They're quite young aren't they? They're either a lesbian or too young.
"I think a lot of female attention goes over my head, because I don't find myself worthy enough really.
"I'm just waiting for that one, that's why I'm wearing a purity ring. [Because] I'm not married."
He added: "I've always had the values of it, but this is just something to show people."
Douglas did admit to having a crush on mentor Nicole Scherzinger, though he joked that she would never convince him to sing 'Like A Virgin'.
"Half the time I'm just trying to get over how beautiful she is," he admitted. "She's quite cool, she's got a real, dry, English sense of humour. I haven't got over [her] 'grow your balls' [comment] yet. I haven't got her back yet."
On what other types of music he would refuse to sing, Douglas replied: "Anything degrading to women or [with] swearing. I can't see what's around in the charts for children... I think a lot of people are yearning for that soul back."
The X Factor continues tomorrow (October 13) at 8.20pm on ITV1.
New! Digital Spy breakfast show - watch Daniel Sperling discuss the day's biggest stories including Rihanna's next album, Quentin Tarantino's Django Unchained and The X Factor's Rylan: