“I will not allow few handfuls to harass common man, work of people is my priority: CM Mann”