The former So Solid Crew star flashed and spread his buttocks in front of Coleen Nolan after an '80s party on Tuesday night (September 4).
Coleen claimed that Harvey was "absolutely slaughtered" and admitted that she had put her head under her duvet, but Harvey's other co-stars were less generous about his behaviour.
Spandau Ballet star Martin Kemp claimed that Harvey had "crossed the line", while Julian Clary claimed that his behaviour was "disrespectful".
"There is 'banter' and then there is getting your arse out and opening your cheeks and showing it all to Coleen," said Kemp.
"This is the sort of thing you do as boys at football but not to a woman."
A rep for the Channel 5 show said: "Harvey was called into the Diary Room and told his behaviour could be seen as inappropriate."
Celebrity Big Brother concludes on Friday (September 7) on Channel 5.