I don't see what her grief is all about. A Mexican doing yard work isn't an unusual sight in Florida, so I doubt he'd be suspicious she wasn't somewhere she shouldn't be. Could be he didn't think it was her yard, and it's always questionable if the Mexican workers can speak English, so that no conversation took place would also be usual.
No evidence he was mad or went out of his way to make anyone uncomfortable. The primitive has an inferiority complex which has her dreaming up motives that don't exist.
.