The 29-year-old, who split from Hills star Doug Reinhardt in April, has also previously been linked to Backstreet Boys singer Nick Carter and Good Charlotte's Benji Madden but admitted that she is no longer interested in such high-profile relationships.
"The media are constantly making up stories and it's just hard to know if you can trust a guy who has fame," she told Heat.
"I'd rather be with someone who's not in the public eye - I think it just makes it easier, and I don't know, there's so much that comes along with it. I'd rather be with someone who's not in this world."
However, she added that she is happy being single and is in no hurry to find romance.
"I'm so happy right now. I'm spending time with my girlfriends and my sister and my family and just really getting to know myself. I've always had a boyfriend, so right now it's really important for me just to focus on me and my life and not really put all that energy into someone else," she explained.
"I'm having the time of my life - I didn't know I could be this happy."
Hilton was recently voted as the best summer holiday companion in an online poll.