Cole has apparently been replaced on the judging panel by previously-announced host Nicole Scherzinger. It has been suggested that Cole's strong accent is behind the still-unconfirmed decision by Fox to remove her.
Brand told ITV's Daybreak: "Our Cheryl? That cannae be right! Our Cheryl, kicked off X Factor? What, the American one? And I've come to this country in good faith and they've kicked Cheryl off, our Cheryl? Oh no! She's Britain's sweetheart."
Asked why he thinks American viewers would struggle to understand Cole, he remarked: "Is that what they don't understand - the accent? Just listen more, just listen very intently.
"All them things she's saying - that's English."
Comedian Al Murray also told hosts Adrian Chiles and Kate Garraway: "That's not the special relationship, is it? Dumping our Cheryl, dumping the nation's sweetheart. Mind you, that hair – it's bonkers, look at it!"
> Cheryl Cole poll: Should she rejoin 'X Factor' UK?
> Cheryl Cole 'X Factor' USA: Where it all went wrong
> Alan Sugar tips Cheryl Cole for UK 'X Factor' return
> Cheryl Cole, Steve Jones in new 'X Factor' video
> The X Factor USA complete coverage