The impressionist told Metro that he mourned the loss of the build-up to the Christmas number one since the show's winners have dominated the seasonal top spot.
Culshaw said: "The fact we don't have a proper Christmas number one anymore is irritating, it's just whatever wins The X Factor.
"Noel Gallagher was right when he said X Factor was everything to do with television and nothing to do with music."
Musicians Sting and Patrick Wolf have recently agreed that the reality talent contest is concerned with entertainment ahead of music.
When asked if he would ever do a celebrity reality show, Culshaw added: "No, there are far too many and they're too spun out.
"The Apprentice is interesting as there's something going on, but the rest are full of desperately irritating people who just want to build their profiles, little celebrity cockroaches who crawl out from under their rocks."