Brook, who was fired after working on the Britain's Got Talent judging panel for only six days, branded Simon Cowell's ITV1 show "a circus".
The model and actress, who has also competed on Strictly Come Dancing, said that the atmosphere was much better on the BBC One reality series.
Brook told this week's Fabulous magazine: "I've been on both sides, and for me there's a warmth and a niceness to Strictly that BGT simply doesn't have.
"The whole thing is a circus and I don't want my life to be like that. I'm quite straightforward. I've got enough drama in my life without having to deal with Simon Cowell's as well! I don't want it. I've got no interest in it."
She added: "I don't doubt for a second that Simon deliberately stole her from Strictly. I wish Alesha all the best - it's a fantastic opportunity."
Amanda Holden said at the launch of this year's Britain's Got Talent that Alesha Dixon would prosper longer than Brook on the show because she had "a brain". Ant & Dec have also been critical of Brook's efforts on the programme, claiming that it was a bad decision to hire her.
Brooks's full interview will be in Saturday's Sun newspaper.
> Simon Cowell, Alesha Dixon won't be like Kelly Brook