The show stars Christina Applegate and Will Arnett as Reagan and Chris, a couple who are getting used to their new lives as parents.
Maya Rudolph also stars in the show as Reagan's colleague Ava.
Up All Night's creator Emily Spivey has now told Zap2It that Taccone has signed up to play Ava's ex-boyfriend in the show.
"You're going to see flashbacks of them from the '90s," Spivey teased. "They have a little song together and everything, and a music video."
Taccone is best known for his work on Saturday Night Live. SNL star Will Forte also recently signed up for a guest role in Up All Night, which premieres on NBC on September 21.
> Nick Cannon, Jennifer Hall sign up for 'Up All Night' roles
Watch a preview of Up All Night below: