The likes of Johnny Robinson, Kitty Brucknell and Frankie Cocozza have been rewarded for getting to the final stages of the talent show with a stay at Connaught House in Hertford Heath.
ITV bosses will spend £4,000-a-week to use the venue, according to The Sun. It has apparently been dubbed the "naughty house" by contestants.
The mansion includes a swimming pool, hot tub, sauna, steam room and duck pond. The house will contain cameras to film the finalists during their stay, with only six bedrooms to share between all 27 contestants.
A source said: "Frankie and Kitty jumped in the hot tub at Boot Camp in front of hundreds of people, so imagine what will happen when they're alone."
> X Factor Top 16: Who is your least favourite act? - Poll
Take a look at the X Factor finalist mansion below: