He was thrilled to get to meet Phoebe Mae, his new Great Granddaughter, when Sophia visited early 2020