I suspect that he knew from that tender age that your home was a safe place, that he was simply accepted for who he was. Very young children have very good instincts.