The filmmaker, who's shed 65 pounds in recent months, told HLN host Joy Behar that he doesn't believe he'll ever be classified as attractive.
"Let's be honest… I've lost 65 pounds but nobody's going, 'I wanna sleep with you'," he said. "They're just like, 'Keep going, you look better'."
Last year, Smith disclosed that he was ejected from a Southwest Airlines flight after allegedly being told he was "too fat to fly".
The Chasing Amy director admitted that the incident spurred his bid to drop excess pounds, but also led him to realise that he doesn't want to let his weight define his lifestyle.
He explained: "I'm still the same person I was when I was 65 pounds heavier… Sometimes a fat dude has a lot to offer, if [you] can just get past the blubber."
Smith's latest project Red State, a horror film about religious extremism, is currently scheduled to be released on October 19 in US cinemas.