John, I know how you feel, but that often comes with the title of moderator. Over at one of the HL2 mod sites I help super mod I even have my own Hate club. LOL.
As a mod you are going to be disliked by the members that just cannot seem to behave, you gotta learn to let it roll off and not bother you. Continue to make unbias correct actions and you will be just fine.
The negative oftem seems to outweigh the positive because the positive response to your action is no response, but negative is somebody bitching.