The 40-year-old actress, who had first son Henry 18 months ago, said that she has always dreamed of having a large family.
Driver told The Times: "Growing up, I thought I'd have at least five kids. I'm surprised I have only one; I really want more."
Talking about putting children off for so long, she added: "It was never the right time, right place or right person. Too many women put it off until everything is in place, but there's never a perfect time, is there?
"I wouldn't change a thing about what I've done in the past because what may have been bad choices have all led me to this moment. I'm incredibly happy because I've got my beautiful baby and lovely partner. Everybody is cool with the situation."
Driver has never revealed who the father of her son is.