In my opinion Harvey came in late. Remember Charlie said he told them everything. IMO I'll bet he was shocked.
If this is the case, "upsetting your father" would be quite the understatement.
"Now, honey, I don't want you to get upset, but Charles and I have been using your business as a front to pay off a woman who served as an intermediary to help retain two goons to brutally murder Wendi's ex-husband. Oh yeah, and we had to give her your Lexus."