Boyle sparked a furore last month by suggesting that the Team GB star would have an advantage at the Olympics due to her "possessing a dolphin's face".
Speaking after collecting two bronze medals at London 2012 to add to her double gold in Beijing, Adlington insisted that she would "not get caught up" in cyber bullies' attempts to bring her down.
"I'm not a model, I'm not attractive, it's just one of those things," she told the Mail Online. "I've got over it.
"I'm one of those people who thinks if you haven't got anything nice to say, don't say it.
"I think it's quite sad that people take the time to be nasty. I wouldn't ever write abuse on Twitter. But that's how the world is, I've had to get used to it and not get caught up in it."
Adlington added that she doesn't care how she looks as long as she is satisfied with her performance in the pool.
"I don't look good in post-race interviews," she said. "My hair is wet, I'm bright red from racing and working hard. I don't focus on trying to look good then.
"When it comes to racing I'm focused on what I want to do, I don't want to be worrying, 'Is my mascara running?', or anything like that."
Adlington was previously targeted by Boyle following her success at Beijing 2008 when he likened her to "someone looking at themselves in the back of a spoon" on an episode of Mock the Week.
The comment attracted 75 complaints from viewers and was branded "humiliating" by the BBC Trust.
Photo gallery - London 2012's best bits:
Copyright: PA Images