Nina Steel claimed earlier this month that her 11-year-old daughter, who caused controversy after breaking down in tears during last year's semi-finals, was "dropped like a penny" by producers.
However, Cowell has now insisted to Reveal: "Last year's finalist Hollie Steel's mum has been saying certain things about the show. But kids aren't dragged on the show - parents bring them.
"Kids are always going to be disappointed if they don't win. Most of the kids I've seen during auditions had a blast. If I thought they weren't enjoying themselves I'd do something about it."