I think it is possible that he was watching and waiting for a chance to enter. Maybe when VF went outside to leave, he overpowered her and forced her back inside?
If you belive whatever the surviving housekeepr NG is saying, she claimed the family even sometimes left the doors open.
In that case the suspect could have simply walked right in.