The Mad Men star quipped at the Toronto Film Festival that his imaginary love scene with the crime drama's director and co-star was a good choice to scrap, reports People.
He said: "My sex scenes with Ben, which were cut, I think, wisely... were raunchy."
When asked how Affleck was on set, Hamm added: "It was an awful experience. [Ben's] a horrible human being. Talent-free, I guess we could probably say. It was pure misery... two and a half months of absolute, abject terror."
The Town arrives in US cinemas on Friday, and in the UK on September 24.