The legendary music producer said he was never praised in the same manner as composers Irving Berlin and George Gershwin when he started making music.
During an interview with the BBC in March 2007, Spector said: "I was just a loner and was always treated with contempt.
"[The establishment] never considered me with the same respect that they considered Berlin or Gershwin... but that just builds up the anger and the rage which made you do better, made you do a lot better."
Speaking about his famous Wall Of Sound recording technique, he commented: "Most producers don't create, they interpret.
"When I went into the studio I created a sound that I wanted to hear... and I always compare it to what Da Vinci did when he went to a blank canvas... and I always considered it not rock 'n' roll I always considered it art.
"The Spector sound took a lot of work and creativity and it was a b*tch to get."
Spector worked with acts including The Beatles, Tina Turner and The Ramones during his 50-year-career.
The Agony And The Ecstasy Of Phil Spector airs on BBC Two tonight at 9.40pm.