DMC0627,
I know Orange very well, and actually think you should do the opposite of what you're hearing here. Host a small neighborhood cookout or dinner. Invite all these people over for one day. Let them in your house, let them see how gracious and courteous you are. Once everyone is comfortable, happy, and certain you're not a nut, let them know how you feel about your privacy.
The next day set a bunch of
Claymore mines around your yard to see who wasn't paying attention. Turn those people into fertilizer, spread them on your daylillies and hostas with a little cedar mulch. Water thoroughly.