The singer thinks that the responsibility, which he shares with her father Jamie, is ruining their romance, according to RadarOnline.
A source said: "Britney has made it known that she wants Jason removed as co-conservator. He was appointed to the position when she joined The X Factor so that he could be with her at all times while on set.
"The relationship has been more than slightly rocky in the past few months and Brit attributes that to having her man essentially being one of her babysitters. It has killed the romance in the relationship, and she wants to get it back."
Her partner is apparently in full agreement with her wishes and thinks it best the duty remains solely with her father.
The insider added: "Jason is co-conservator of Spears as a person, meaning he controls who she sees, where she goes, etc.
"Her father has had that role since the conservatorship was appointed, and she thinks it should only be him, and not Jason anymore. Jason is in full agreement and supports her decision."
The couple were reportedly forced to cancel their planned Christmas wedding as they tried to work through their issues.
According to insiders, the pair have even been sleeping separately while she focuses on work commitments and he pays attention to taking care of her well-being.
The source went on: "Britney and Jason have been sleeping in separate bedrooms for a very long time. She has been staying in a hotel during the week because of the live X Factor shows, and although Jason stays at the same hotel, he is in a room adjacent to hers.
"Jason feels like he is Britney's babysitter, and it's pretty much just a business arrangement at this point."
Trawick is said to be trying to seek alternative arrangements for Spears so that they can work on getting the spark back in their relationship.
The insider added: "Jason has been talking it over with Jamie and Lynne Spears, and he just wants to get his and Britney's relationship back on track. He doesn't want to be her babysitter, he just wants to be her fiancé.
"There are steps that have to be taken legally first for the judge to sign off on it. It will happen though."
Photo gallery - Britney Spears's life and career:
Copyright: Rex Features