The Take That frontman has told producers that he does not want to leave the UK for this series.
Barlow's request is so that he can stay near his family following the loss of his and wife Dawn's baby daughter Poppy, who was delivered stillborn earlier this year.
Three manors in Oxfordshire and Northamptonshire are being researched as possible locations for Barlow's category of acts to sing for a place in the live finals.
The homes in question are said to include Cornbury Park, Cornwell Manor and Boughton House.
"Gary understandably doesn't want to be too far from his family after their ordeal," a show source said, "so we're making sure we give the wannabes a treat here in the UK."
Robbie Williams is expected to join Barlow for a second year to help him choose his category, which was reportedly leaked last weekend.
Nicole Scherzinger is said to have delayed X Factor filming by taking a diversion to see her boyfriend Lewis Hamilton prior to filming her Judges' Houses footage.