The Black Eyed Peas star has been criticised by some of his acts because of his lack of focus on them, according to The Mirror.
However, will played down claims that he doesn't care about the show as much as the other coaches, commenting: "I've just got a different approach. My coaching is, 'Hey, let's talk'."
Asked whether he was concerned his absences would affect the singers, he said: 'I'm not worried. I don't get nervous about not being here. It all depends on how you coach.
"If you focus on trying to unlock the magic within you, there's no coach and no rehearsal which can bring that."
will's remaining four acts on the BBC talent show are Joelle Moses, Jaz Ellington, Tyler James and Frances Wood.
This weekend's live show will see Team Jessie and Team Danny's acts singing live for the first time.