Brendan Cole will step in for Windsor on Saturday night's episode and partner Anita Dobson.
Cole had previously replaced Holly Valance's partner Artem Chigvintsev for an edition of the BBC show earlier this month, after the Russian pro suffered a back injury.
Windsor's dancing partner Dobson recently said that she wants to stay on Strictly Come Dancing "forever".
Last Sunday's episode saw Russell Grant eliminated from the competition.
Strictly Come Dancing continues on Saturday at 7pm on BBC One.
> More Strictly Come Dancing news