User blog comment:B214/Volume 17 spoilers./@comment-117.193.172.96-20140220163805/@comment-24468758-20140221014211

You are right, but Issei and his mother stated they don't want them to come there and we don't know of a single time of them visiting the Hyoudou residence, so I assume he did or said something to keep them away.