From a developmental psychology standpoint he is destroying those children's chance at a well adjusted future. Michelle was their primary care giver, living with her mother- those children view Yvonne as another "parent". They've now lost their mother, their grandmother they are used to seeing everyday and their older brother. That has severe psychological repercussions. There are cases where you can't minimize loss in a child's life- but in this case you can. Anyone that cares about their children SHOULD.
That's what tells me most of all that he's guilty. If he wasn't he would literally have nothing to fear by letting them visit her- nothing for them to accidentally leak. He knows Yvonne can't legally keep them from him- so that really leaves no other reason not to allow your children to see their family , if you love them and care about their well being. That's what tells me they're investigating in the right direction.
What a truly disgusting person.