What would be most helpful is if everyone had access to 5-minute votebans. As long as you require a high enough percentage of yes votes, it doesn't seem like it would be able to be abused... It gets REALLY bad during the day when no admins are around.