The actress played Ruby Allen in the BBC1 soap from 2005-2006, and has since made a move to Los Angeles, playing a significant role in American Pie: The Book of Love in 2009.
Speaking about her role as a British exchange student in the straight-to-DVD movie, she told OK: "That experience was brilliant, as it does give you an insight into what you want to do in your career.
"But there is so much I still want to do at home, like theatre, and build myself up, because I have missed out on things like drama schools. It's funny because when I was there they thought I was a huge star back in Britain!
"For them, being a soap star is massive, yet in this country, if you do a soap, you're almost looked down on as an actress."
On her time in EastEnders, she explained: "I left in 2006, having been in it for two years. It seems a lifetime ago.
"It's crazy, because I was so young, but it was absolutely the biggest thing that could have happened to you, career-wise, at that age and straight from school. It's funny that I still get recognised from it now, all these years later."
She added that there may always be a door open to return to the soap if asked, saying: "I'd never say never.
"I'll always be grateful to the show, it got me where I am and gave me an amazing opportunity. A lot of other actors have said they'll never go back to EastEnders - and then they do! So I won't say I won't go back!"
Lytton currently stars in British drama Payback Season opposite BAFTA Rising Star Award winner Adam Deacon.
> Louisa Lytton: 'I'd return to Walford'
Watch the trailer for Payback Season below:
Get the Inside Soap magazine on your iPhone or iPad