The Liverpudlian singer finished second to Little Mix on Sunday's final under Barlow's guidance, and Collins said that he wants their "amazing" partnership to continue beyond the show.
"Gary's an amazing musician, songwriter and performer," he told the Liverpool Echo. "Not only is he my mentor, he's my friend as well, and he wants to be involved in everything.
"Gary's taught me so much. He's taken me under his wing and he's moulded my career from the start. Gary's always encouraged me and we're in talks over songwriting. I'm team Barlow and I'm not going anywhere."
Collins went on to reveal that the Take That star is looking to start work on his debut album immediately after Christmas.
"I'm looking forward to taking a few days to calm down," he said. "Gary's told me he wants me working from January 1.
"I want to concentrate on making an amazing album and Gary will be writing it with me."
Barlow and Collins performed a duet of Billy Joel's 'Always a Woman' at the X Factor final.
The 'Shine' singer predicted last week that Collins and his fellow finalist Amelia Lily will have no trouble getting record deals.
Scroll through photos of the X Factor wrap party below: