The judge said he believes the ITV talent show is 'stronger than ever', The Irish Herald reports.
"I'm not concerned," he said. "Both shows are the two biggest shows on TV right now and that's the truth.
"X Factor is watched all around the world and everywhere I go, people are talking about it. They're like, 'I watched you last night on YouTube'. It's gone crazy. This is the best X Factor ever and I'm not worried about other shows."
Walsh admitted that he hasn't yet managed to see Westlife's Nicky Byrne in action on the BBC dancing show, also suggesting that he hopes for the group to reunite in the future.
"I haven't even seen it but I'd love to see Nicky dancing. At least he'll be able to dance for when Westlife get back together - which will only be a good thing!" he said.
Walsh still has two acts left in this year's X Factor. He claimed that Simon Cowell doesn't want his act Union J to win the series as they are a 'threat to One Direction'.
X Factor latest pictures: