The Mad Men star recently complained that "stupidity is certainly celebrated", using Kardashian and Paris Hilton as examples.
Kardashian later described Hamm's remark as "careless", and he responded by explaining that his comments were not "personal" but about "something in our culture".
However, Hamm has now continued the debate during an appearance on Today after Matt Lauer asked him about Kardashian's response.
"I don't think [the comments] were careless," Hamm said. "I think they were accurate. But it's a part of our culture I certainly don't identify with and I don't really understand the appeal of it, other than in a sort of car crash sensibility, and it's not something I partake in or enjoy. But it is what it is and here we are."
Hamm's co-star Vincent Kartheiser added: "I agree with everything he said. I think our society enjoys to turn on the television and see someone who's maybe awful, and they can say, 'Well, at least I'm not as terrible as that person'."
Hamm also suggested that there is room for both Mad Men and shows like Keeping Up with the Kardashians, saying: "There's a lot of channels on the dial and those channels need to be filled up with things. Different strokes for different folks, I suppose."
Watch the cast of Mad Men speaking to Matt Lauer below: