The MP has said that she is hoping to use the ITV reality show as a platform to discuss her views on reducing the current 24-week time limit for abortions, and will appear on the programme this weekend.
Chief Whip Sir George Young has said that Dorries did not seek permission to leave the UK for Australia, and has demanded a meeting with her when she returns, reports the Daily Mail.
Conservative MPs have criticised her involvement in the show, which will reportedly see her earning £40,000.
A senior Conservative party source said: "She has been suspended from the party until she meets with George Young when she comes back, when she will have to explain herself.
"The concern is she is not doing her parliamentary duty and serving her constituents."
> I'm a Celebrity poll: Is it wrong for MP Nadine Dorries to enter?
Chairman of the Mid Bedfordshire Conservative Association Paul Duckett has also stated that he has been "trying to track her down".
"If that is what she is doing we will be taking a very severe view," he said.
"There is a range of actions open to us, everything from reprimand, de-listing, deselection for the next election."
Conservative MP Sarah Wollaston has also slammed her appearance on the reality show, saying it may damage the image of women in politics.
She said: "I am just dismayed. We want women to be taken seriously. We need to get more women to put themselves up for election. What message does this send out about the job?
"If we want women to be taken seriously we need them to take the job seriously. If you appear on a programme like I'm a Celebrity, your whole role in that is to make yourself look ridiculous for public entertainment.
"Did people vote for Nadine to go to Parliament so she could be a minor celebrity or to do a serious job?
"What I am saying is she has been elected to represent people in Parliament and think there is a point at which you have to decide what you want to be. Do you want to be a celebrity or be taken seriously as an MP?"
I'm a Celebrity launches on Sunday, November 11 at 9pm on ITV1.
In pictures - rumoured lineup: