The actor and his partner Naomi Watts are parents to two sons, but Schreiber told People that he wants to make the most of his time with the children.
"They are growing up too fast and it's tough to leave them," he said. "When you are working as much as Naomi and I are working, there's some guilt.
"I want to be present and experience all the milestones. Both of us are getting pulled so I don't take time with them for granted. Every day with them is remarkable to me."
Schreiber also spoke about the family's fondness of cycling, as they are often photographed on bikes in New York City.
"[My sons] are not off training wheels yet," he said. "The problem is they are not riding their own bikes. They would rather ride with me or with Naomi. So we have this great bike where the three of us can all sit on. It's fun, but it's time to get them on their own. I'm trying to get them to the park so they can practise."
Watts has previously said that she would consider having another child if she could have a daughter.