thats understandable. they can sense your discomfort and may mistake it for aggression but generally, if they're just foraging, they're not really going to be very defensive. if they get uncomfortable, they'll go forage somewhere else.
the only reason they would sting while foraging (far from their colony) is if they feel trapped and are unable to leave the situation that is stressing them out.
its possible some may investigate a human who is near where they're foraging but it's pretty easy to pass their assessments by just vibing. sometimes i'll talk to them when they check me out. it's a great feeling to have passed though cuz they'll just go back to what they're doing