The 30 Rock actor - who already has 16-year-old daughter Ireland - revealed on Piers Morgan Tonight that becoming a father again is one of his dreams.
"Have I thought about having more kids? Oh sure, that would be great, that would be heaven, that would be fantastic," Baldwin told Piers Morgan.
"As my friend said to me, 'When you have children, typically in a second marriage, when you're older and you get married again to a woman who would have children, you must always remember that you make sure [the children] attend a college where the commencement ceremonies are held in a facility with a wheelchair accessible ramp'."
Baldwin and Thomas were first linked last year when it was reported that they moved into a luxury Manhattan apartment together .
Earlier this month, Baldwin wore a ring on his wedding finger while attending a public event, but remained coy when asked if he and Thomas are engaged.
A rep for the actor later dismissed suggestions that he plans to marry.
Baldwin's series 30 Rock airs Thursdays at 8/7c on NBC.
> 30 Rock season seven could be mini-season, says Alec Baldwin
> 30 Rock star Alec Baldwin: 'I still want to run for office one day'
Watch a clip of Alec Baldwin on Piers Morgan Tonight below: