The publicist told ITV1's This Morning that he was aware of claims about Savile sexually abusing girls, adding that other stars of the era slept with underage girls.
"I was aware because of Gary Glitter," Clifford said.
"Don't forget I was the one that broke the Gary Glitter story, and when the people that came to me to tell me about Gary Glitter, Jimmy Savile's name came up several times in those conversations. That was years ago... I passed it all on."
Asked by Phillip Schofield if he passed the allegations on to the police, Clifford replied: "No, the people concerned. The people that came to see me.
"And two or three of the people that came to see me didn't then fulfil their story with Gary Glitter for their own reasons... it's up to the people concerned to go to the police. It's not for me to say. They're the ones that this happened to or experienced it or saw it."
He added that many of those involved say that they cannot handle the ramifications of coming forward, and continued: "You can't make someone go to the police, it's their lives, it's their future. The information doesn't stack up unless they are prepared to go to the police and explain it."
"In the '60s and '70s you had all the young pop stars, and you had young girls throwing themselves at them going in the dressing rooms at the concerts halls, everywhere they went.
"What happened, happened - and they were young guys themselves - asked for birth certificates and I'm not condoning it but that's what happened."
He added: "But then you had people around them that saw opportunities - people like Jimmy Savile - all these young girls 'I can introduce them to The Beatles, I can do this, I can do that...'
"They're the ones they should be going after, and there are several of them whose names haven't come out."
Clifford said: "Fortunately now, a lot of people are coming out that were frightened. So it has changed, but there's an awful lot more to come... potentially."