I can't help but feel annoyed when people pick up my antique camera and take a few photos with it without asking. Worse, the photos will be completely useless, because they know nothing about the fundamentals of photography.
It may be unproductive to feel like that towards people who clearly don't know, but is it that hard to ask?