Taylor, who left the E4 programme last year, said that the broker's treatment of ex-girlfriend Louise Thompson, who he admitted to cheating on, shows that he has "gone massively downhill" without the support of his friends.
"I don't know why he does it," Taylor told Heat. "He said ever since I've left the show his character's gone massively downhill.
"I'm not there to tell him what's right and wrong. From what I've heard from other people it's really quite shocking."
Made in Chelsea co-star Oliver Proudlock confirmed Matthews and Thompson's split last week, and their break-up was shown on last night's (April 22) episode.
Matthews is now believed to be dating model Verity Chapman, while Thompson has been romantically linked to his MIC rival Andy Jordan.
She told the press today that she is "really relieved" to be free from the Bachelor star.
"I'd been so depressed for the last four months of our relationship," she said. "The day we broke up, I just suddenly found happiness again."
Made in Chelsea continues next Monday (April 29) at 10pm on E4.
View all of today's best celebrity pictures - Photo gallery: