Here's the thing; I think drones are super fucking cool. It's basically a big boy toy and a lot of people (probably a vast majority) will use them as hobbyists do, just cruising around, maybe making some videos. My boss wants one to make cool wakeboarding videos. I'm 100% fine with that.
Then you have the nosy motherfuckers. The people who have to get their drone over wildfires to get sick footage and end up hampering rescue efforts, or people like this who have no qualms about flying one right into a neighbor's backyard. These people can't fathom that it's essentially the same as walking into their neighbors yard and just setting up a video camera, or flying an actual helicopter into their backyard. legally, it should be viewed as the same thing, but their thought is that the air is free space and "i ain't hurtin nobody."
It's stupid to shoot at anything unless you've got tons of space around your property, that's just unsafe and poor gun ownership, but that doesn't excuse poor drone ownership.
Really there's no good way to handle it. Both sides are at fault but IMO they need to come down hard on the drone operator. You have as much a right to swoop down low and video my home/property as you do to simply walk onto my property, which is fucking none.