Why did the colonists refuse to pay the tax, even though it was very small? (What principle is at stake?)

Paying the small tax would validate the British existence in the colonies. It would mean tacit approval of British control over their affairs.