He stopped them because he thought it may be them.. He would not be able to know that in a few minutes.
I think it's a very good guess, and he was in fact, correct. There are few people that large in the vicinity. He's an unusual looking guy, and my guess is they had the description to go off and it was in fact him.