A metamoderation scheme could be useful for the prevention of abuse of the reporting system.
Slashdot have that implemented very elegantly to have the comment section self-moderated by it’s users.
First, common users are randomly assigned temporal power as moderators, and they are assigned an x number of moderation points to “spend”. Whenever a moderation occurs, one moderation point is spent.
This can be freely spent while browsing the content, and once all their moderation points are spent, they become common users again.
And then, another batch of random users are assigned as moderators of moderators, and they are also assigned metamoderation points.
In this case, a bunch of already moderated posts by other users (anonymized) are shown and they are asked if such moderation seems to be valid or justified.
It is shown one after another until all the metamoderation points are spent.
If a bunch of different metamoderators evaluate that the same moderator has been moderating incorrectly, he could be banned from moderating again.
And if a user has been reported of being disruptive by a bunch of different moderators, he would be suspended for a time. If the behavior persists several times, would be banned.