The X Factor winner explained that it always takes him by surprise when admirers go up to him in public.
"It freaks me out a little bit. There were loads of them singing 'Impossible' outside my friend's today and I was like, 'What? It's freezing cold, go home'," he told ITN.
"I wouldn't say mobbed, I can handle myself. There's 20, 30 girls. It's fine."
Arthur also discussed his hopes to co-produce his debut album, which is due out later this year.
The singer was recently spotted on a night out with Xtra Factor host Caroline Flack.
Watch the video for 'Impossible' below: