The Take That frontman has told producers that he will not leave Europe as it clashes with the birth of his fourth child with wife Dawn, reports The Sun.
Bosses had reportedly wanted to send Barlow to Los Angeles as a follow-up to last year's Judges' Houses stage, where he was joined by Robbie Williams, who lives in the area.
However, he has stated that he requires to be just a few hours away from his wife in case she gives birth.
"Gary's daughter is due to arrive at exactly the same time the Judges' Houses are set to be filmed," a show source said.
"Gary is really torn — he wants to be with his acts but he knows he can't miss his daughter's birth."
The insider added: "You could see Gary making a hospital dash on the show. This really is reality TV."
Robbie Williams has also dropped out of the closing ceremony of the Olympic Games as it clashes with the birth of his first child with Ayda Field.