Initially, that was the plan. For him to rejoin SW & girls for their last week in NC. Since there are pictures of them all together, we can safely assume that he was following through with the original plan to be with the family.
Jumping of your post, Serena.....
IF he told his AP that he and SW were separated (or going to separate), what reason do you think he gave for going to be with his family in NC? Wouldn't the AP wonder about this?