"It was a heavy, emotional, but very happy moment," the TV personality tells PEOPLE about seeing his father for the first ...