As I've posted in the past, I have family from the area, who are all sadly passed on.
BUT I remember visiting in the 1970s and anybody not "from there" stuck out like a sore thumb. There were also 2 kinds of people: white and black.
A Greek family ran a local diner, and they were not considered to be "white" by either group. I'm using that specific as an example of why an olive skinned couple, as they've been described, would have definitely stood out there at the time.
My mom is from a Northern state and married my dad (whose family were the ones from there) and their entire lives, they called her "____'s Yankee Wife," and not as a joke at all.