I remember in the inquest he was asked why on none of the overseas trips, did his wife or family go with him.
He seemed totally taken aback by the question. I think he answered that "she had to look after the kids" and he said it
like it was a taken for granted thing, that wife and children couldn't have a holiday.
In my opinion, he never once thought that his wife and/or his children might like to have a holiday too.
IMO, he's lived his life looking out for number 1
Of course they would have gotten in the way of his scams. You can't actually show up with your family if you're acting the part of a single man.
Though he slipped up once with Monique seeing who she thought was his son.