The musician, who records as The Streets, replied to the accusation on his Twitter page.
Skinner wrote: "I'm glad Lily Allen thinks my music is boring. At least she's not stalking me anymore."
He also told a fan: "There's no such thing as fans on twitter. We're all in it together."
Last year, Skinner said that Allen wants and needs photographers to follow her around and craves attention from the media.