But who should Simon Cowell call upon to replace the popular figure of McIntyre?
James Corden and David Walliams were linked to the job last year and are obvious fits to step into the comic's empty chair. Paul O'Grady was supposed to be in the original judging lineup way back in the first series and has continually been tipped for a role, so could it be his turn in 2012?
Will Louis Walsh be finally given the job full-time after two guest stints in a row? It might be time for Simon Cowell to go looking for someone more leftfield to bring the show some fresh sparks, so how about Russell Brand at the helm?
Or even comic actor Les Dennis? That would definitely cause some tension with his ex-wife and judging veteran Amanda Holden.
Vote in our poll below and offer your own suggestions for new judges at the bottom of the page:
This poll is now closed - read the results here