Several cast members of the ITV2 series were recently said to have walked out of filming after complaining about low pay and long working hours.
However, producers have now allegedly sent out a warning letter to cast members telling them that they may be axed if they keep halting production.
"Bosses aren't prepared to take any nonsense," an insider told The Sun.
"They know some cast members have been complaining about long hours and low pay, but have told them to stop whingeing and get on with it.
"Producers are particularly annoyed about time-keeping and the way some of them treat production staff. The stars have been told they have to start arriving on time and must be respectful to the crew."
The source added: "They have been told nobody is bigger than the show - and if they don't like it they should leave as there are loads of people who'd replace them in a heartbeat.
"Even though the cast only get paid £80 a day, they earn thousands from personal appearances and deals they wouldn't get if they weren't on the show, so producers feel in a strong position."
The Only Way Is Essex returned for its sixth series earlier this month.
Photo Gallery - 'The Only Way is Essex' series six cast pictures:
Copyright: ITV Lime Pictures