The Olympic medallist is said to have arrived late for rehearsals on a number of occasions, which has led to professional partner Flavia Cacace questioning his commitment.
"His partner Flavia has been sweating blood to make sure they get to the final and it sometimes feels Louis doesn't have the same determination," a source told The Sun.
Smith has also compared rehearsing for the show to a recent dream about being in prison.
He tweeted: "The last time I didn't want to be somewhere so bad as this I was dreaming I was in prison."
> Strictly Come Dancing week six: Our top five dances - watch videos
Lous Smith was forced to miss Strictly rehearsals in early November due to an illness.
The gymnast was previously rapped by producers after accidentally tweeting a spoiler about Sid Owen's exit from the competition.
Strictly Come Dancing latest pictures: