The former O.C. star was asked by Diablo Cody in her online show if he would like to be left alone and be known as just an actor, like Stewart has argued.
He responded to the Twilight star's previous remarks, saying: "I don't have a lot of patience for people who moan about it too much because there are many things you could do... Like, quit... you don't need to be an actor, so it's like, if it's that much of a problem... there's the door."
However, Brody has now apologised on MTV News for being "ungentlemanly".
He explained: "It wasn't taken out of context, I saw [the episode] and thought I sounded like an idiot - I did.
"Regardless of how anyone else took anything, I would think that sounds very ungentlemanly and I sounded like a jackass."