Bandits should get bad karma. Tripping over, misfiring more often, and more misfortune. Maybe they should trigger the zombies easier. Almost natural things that makes the bandit role less attractive, but still the persons that like to be bandit can play that role. They are part of the essence of the game.