The actor - who plays Joey Branning in the BBC soap - said that although his partner doesn't mind him kissing co-stars on-screen, she struggles with how girls throw themselves at him off it.
"She has got used to the on-screen kissing. She understands it is a job. But the attention outside the show is different," he told The Sun.
"You have to accept that with this job, some kind of hype does come with it. As long as you don't believe the hype and carry on as normal then you are fine."
Witts went on to explain that he found it uncomfortable to be named 'Sexiest Male' at the Inside Soap Awards last year.
"If it was 'nicest-looking male' then that is flattering. But sexy? I don't even use that word. I steer away from that."
He added: "I try to work out five times a week. It's not as much as everyone might think! The fitness and keeping in shape is a by-product of a hobby I have, which is training."
However, he has put a ban on doing any more shirtless scenes on the soap in an attempt to be taken seriously as an actor.
[Witts kissing co-star Hetti Bywater (Lucy Beale)]
"I don't do it anymore. Unless it is important there is no point because all it does is make you a pin-up rather than an actor," he said.
"There is a misconception that I used to model underwear - I didn't! I've never worked as a model, but I was like, 'I might as well have physique shots'. You never know when a casting will come up for a guy with a muscular body."
Witts recently said that his character has changed since his breakdown at father Derek's funeral earlier this year.