There is a fragment by Solon the Athenian whose exact reading is disputed, but one of the ways to take it is that, if stasis grips your polis and the factions come to blows, you exile the neutrals and not the losers.

Because they didn't care enough about the polis to take sides.