The Strictly Come Dancing co-host said that he couldn't figure out the real nature of Savile, who has been the subject of many child abuse accusations in recent months.
"I never liked him. I can honestly say that," Forsyth told The Sun.
"There was something about him that was difficult to like. It wasn't because he was so brash about everything - it wasn't that.
"He had this manner that you thought, 'What is behind this man?' Now we know what was behind it all - which is terrible to find out."
Forsyth added: "I feel sorry for his family and the charity people that put so much trust in him. But of course he was making so much money."
The 84-year-old also defended the BBC for its part in the Jimmy Savile scandal, saying that the corporation is not responsible for his actions at Broadmoor and at Leeds Royal Infirmary.
He said: "The whole thing is too dreadful. It is unbelievably bad.
"He got into hospital and molested people. That is far worse than being in the BBC."
Sir Paul McCartney has also spoken about Sir Jimmy Savile, saying there was always "something suspect" about him.