The artists announced plans last week to perform one of Sheeran's tracks together at the ceremony, to be held on February 10 in Los Angeles.
Sheeran explained that he has known John for several years and that it was the 'Crocodile Rock' singer who suggested they share a stage during the awards show.
"He put it together. He rung me up one day and said, 'How would you feel about performing with me at the Grammys?' I was like, 'I'll check my schedule'," Sheeran recalled in an interview with MTV News.
"He's been in touch for the past kind of three years, but has mostly become very prominent when we started to break the States, 'cos he knows the States like the back of his hand."
The 'Lego House' singer went on to express his excitement for his Grammy outing, adding: "I can't wait to kind of just be involved in the whole thing. Just to be going is an honour, but to be nominated and performing is nuts."
Watch Ed Sheeran's video for 'Lego House' below: