The country music star previously finished as runner-up on The Celebrity Apprentice in 2008, but has said that he did not enjoy his experience on the show.
Adkins told reporters at the TCAs over the weekend that he only signed up for All-Stars to raise money for the Red Cross, which aided him when his home burned down in 2011.
"The only reason that I would do a reality television show is because this one at least has a shred of nobility because of the charitable aspect of it," he declared, reports Entertainment Weekly. "That's the only reason that I even considered coming and doing something like this."
He added: "I held [producers] off for a month or so, kept telling them, 'No, I'm not ever going [back]'. The first time I was on The Celebrity Apprentice was one of the most stressful periods of my adult life, and I didn't want to come back and do it again. So it took my house burning down to get me to come back."
(Pictured Above: 'Celebrity Apprentice' cast announced on 'Today')
Adkins went on to insist that The Celebrity Apprentice: All-Stars was also stressful, but much more enjoyable than his first season.
"It puts me in a position where I'm forced to tolerate individuals that I normally wouldn't tolerate. And just I don't live my life like that. I don't have to spend time around people that I abhor," he said.
The musician concluded: "This year wasn't that way... it was a great experience."
His fellow Celebrity Apprentice: All-Stars contestant Omarosa also expressed complaints about the show this week, claiming that guest mentor Piers Morgan unfairly targeted her for firing in the boardroom.
"It wasn't a mentor environment," Omarosa said. "It was the most toxic experience - I mean, to the point where my castmates went - on my behalf - to the powers that be, because it was so vile and so vicious and so personal."
The Celebrity Apprentice: All-Stars premieres on March 3 at 9/8c on NBC.
Watch a preview for the series below: