A show insider told the News of the World that the 27-year-old teacher is making life difficult for his fellow singers.
They said: "This is bringing everyone down. Tensions are already high enough but it's not right for one contestant to take so much attention.
"Danyl has changed his song two weeks in a row now and that means he needs a lot more work from support staff like Brian Friedman. It's not fair."
Another insider revealed that even Simon Cowell is getting fed up with Johnson.
They explained: "Simon doesn't want to lose face by losing Danyl this week. That would leave Cheryl with two acts - one more than him - and he couldn't handle the indignity of that.
"So he's going to stay very upbeat about Danyl and hopes the others judge him on his vocal performance. But he's realistic about the long term.
"Why would he want to work with an artist who's already caused him this much grief?
"Imagine what Danyl could be like with a million-pound record deal and number one single under his belt. He could become a real diva.
"They're not the sorts of people Simon likes to worth with."
However, producers have reportedly expressed concerns about Johnson's state of mind.
A source said: "He's been on the edge at moments this week. Everyone hopes if Danyl does leave that he's able to cope.
"If not, things could get very ugly. He truly believes he should be the winner of this show and exiting under these circumstances will be difficult for him to take."
> Danyl 'in danger of being kicked out'