Bristow made the accusation after a conversation with the Made in Chelsea star about Scotland.
Taylor was reminiscing about a trip to Loch Ness with some friends, where he said that the group ate three huge meals a day.
When Colin Baker asked if they had cooked for themselves, Hugo replied: "No, we were very lucky. We hired a chef."
An amused Bristow later said in the Bush Telegraph: "It was the way it rolled off his tongue - 'No, we had a chef'. He's in another world, isn't he? Brilliant."
He then relayed the talk to Nadine Dorries and Ashley Roberts, saying: "Of course he didn't pay for it. Daddy paid for it. He's daddy's boy. Daddy's got loads of money."
He continued: "They live a different lifestyle. That's the way he's been brought up. He doesn't know any better. He doesn't realise that people around him don't want to listen to all that. I had pheasant for breakfast. Who gives a s**t?"
I'm a Celebrity continues on Thursday, November 15 at 8.30pm on ITV1.
Photo gallery - I'm a Celebrity: