It has also been revealed that the Saturday show will have a 'Love & Heartbreak' theme.
Last year, the second episode had the same theme and featured Little Mix singing 'I'm Like a Bird', Frankie Cocozza covering 'Red' and Marcus Collins performing 'Russian Roulette'.
Swift is expected to perform her single 'We Are Never Ever Getting Back Together'.
Former X Factor runner-up Ferguson is also scheduled to promote her latest track 'Backtrack', which is released on Sunday (October 14).
Copyright: Ken McKay/Thames/Rex FeaturesCarolynne Poole became the first contestant to be eliminated from the singing show last night, losing out in a dramatic sing-off with Rylan Clark.
The X Factor Live Show continues next Saturday (October 13) at 8.20pm on ITV1.
New! Digital Spy breakfast show - watch Anna Williamson discuss the day's biggest stories including The X Factor, Homeland and Leona Lewis: