The former royal butler and I'm A Celebrity... star recently returned from his home in Florida to visit relatives in Farndon, Cheshire.
It is believed that Burrell has since been helping out at a flower shop owned by his family and is determined to "stay under the radar".
A source told the Daily Express: "Paul feels it is sensible for him to keep a low profile while in England. He fears a hostile response if he speaks out any more."
Burrell was criticised last year after reportedly admitting that he did not tell "the whole truth" when he gave evidence at an inquest into the death of Diana, Princess of Wales.
Recent reports have claimed that the 51-year-old is planning to launch an art career in the near future.