Rory responded to rumours that her nephew and Swift are an item by telling Us Weekly that the entire Kennedy family has come to love the 'Mean' singer.
"I think she's fantastic and I couldn't be more thrilled," Rory declared, adding: "She's a good friend of our family and we all adore her and love her. It's great to have her around."
Documentary filmmaker Rory went on to say that she is a "huge fan" of Swift's music as well as of her personality.
Swift and Conor were linked in early August after being photographed together several times in the same week in Cape Cod.
The budding romance has received public approval from Kennedy matriarch and Conor's grandmother Ethel Kennedy.
Swift previously dated celebrities John Mayer and Joe Jonas.
Watch Taylor Swift's 'Mean' music video below: