The actor told the Daily Star that he invited the pair to his house for lunch but became concerned when they failed to show up.
Eventually Brolin received a call from Cruz saying that she and Bardem were lost, but he found the couple's banter amusing and decided not to help them on their way.
"They come here from Spain, they're jet-lagged also. Everybody gets stupid when they're jet lagged," he explained.
"They were on their way to my house. [My wife] and I had set up a nice thing for them... finally I get a call from Penelope that says, 'Josh, I'm very sorry but I can't find your house'. And then I hear Javier in the background going, 'Where the hell is his house? We are like in the forest right now!' It was too interesting going back and forth. It's much more fun not picking them up."
Brolin added: "Now Javier is going to be so p**sed at me, but that's OK."