Lord Hunt of Wirral made the claim when being questioned by the House of Commons culture, media and sport select committee today (December 11).
Hunt became chairman of the PCC in October 2011 and two months later recommended closing down the commission and replacing it with an independent press regulator.
"On 3 February, I became aware there was a hostility towards the governance [side of the PCC]," Hunt is quoted by The Guardian as saying.
"I was confronted by senior people in the PCC who felt it wrong that someone who has just been appointed their chairman - I think the words used were, 'To seek immediately to destroy the organisation to which you had been appointed chairman'."
He added: "This was a body that... they had been unfairly criticised by the three party leaders and who felt, genuinely speaking that the valuable work by the complaints staff really did need to continue, although with some sophisticated and detailed changes.
"It was quite a difficult situation to handle, but later in February I did get the permission of the commission for a transition phase, but it was a difficult period but it was something I have not aired before. I wasn't able to make progress with the speed I felt necessary."
Hunt was quizzed by Liberal Democrat MP Adrian Sanders on which members of the commission were blocking his proposals.
He added: "It was coming primarily from those who were independent or lay members of the commission, one of whom accused me of consorting with the editors in seeking to destroy the very organisation I was appointed chairman of. One has to recognise there were very strong feelings at the time."
Hunt expressed the hope that the replacement for the PCC would be set up by the start of 2013.
Under questioning, he added that the new regulator would have an ethics committee at arm's length from the funding body and the power to investigate phone hacking and other wrongdoing.
Lord Justice Leveson last month published his report on the ethics and standards of the British press, recommending "a genuinely independent and effective system of self-regulation" of the industry, but backed by a new press law.
Leveson said that the original proposals by Lords Hunt and Black did not go far enough because "any model with editors on the main board is simply not independent... it is still the industry marking its own homework".