There is no follower count threshold below which you get a free pass to harass people.