A woman in the parking garage attached to 10 Amistad saw a suspicious man that afternoon: http://www.newhavenindependent.org/archives/2009/09/was_that_annie.php
Might just be coincidence, since it was so much later in the day.
She described the man as being white and of medium build. He wore glasses and had reddish brown hair
Nothing about facial hair...