The 'In The Air' rapper faced intense opposition to the recent collaboration, but stated that he never had to "think twice" about working with somebody who inspired him to achieve success.
"I never talked to him about [Rihanna]," Chipmunk told The Mirror. "I stay out of people's personal lives. I'm not going to lie - every single person told me not to do that track. I don't care.
"Even before I started rapping I was a fan of Chris Brown and I still am. I think he's the best alive. Working him wasn't something I had to think twice about. That song felt like it was written for me and Chris."
Chipmunk added that he was also hoping to record with Rihanna in the future and had even begun to dream of the team-up.
"You know, what's funny is that I had a dream that I did a song with Rihanna," he revealed. "Yeah, one day I'm going to do one.
"I met her once in a club. It was very brief, but she's a star. She walks in and you know she's there."
Brown was sentenced to five years' probation and six months of community service for assaulting Rihanna in 2009. He suggested back in March that he had finally been forgiven for the incident.
Chipmunk earlier described working with Brown as "the biggest learning experience" ever.
Watch the video for Chipmunk's 'Champion', featuring Chris Brown, below: