The actor announced on his Twitter page that he has started filming scenes for the show.
"Doing The Office this week," he said. "Ridiculously fun and talented group, including Rainn Wilson, who I worked [with on] his first job in '89 in the Park."
Collins also revealed that he was "just about to" work with James Spader, who recently joined the cast as the new CEO of Sabre.
Collins is expected to play the father of Andy (Ed Helms) when he appears in The Office, TV Line reports.
He recently worked on No Ordinary Family and has previously had roles in shows including Private Practice and 7th Heaven.
The Office will return for its new season on September 22 on NBC, and Collins's episode is expected to air in October.
> 'Office' eighth season will feature two pregnancies
> Read more coverage of The Office