People reports that the rocker lodged the necessary documents with authorities in Brown County, IN close to his home.
"John picked a good place to file because this is very quiet and out of the way," a source told the publication.
No further details are currently available and reps for Mellencamp did not return calls for comment.
The couple announced their split in December 2010 after 18 years of marriage.
Mellencamp has since been linked to actress Meg Ryan.