Actually not a fundamentally illogical position, weirdly enough. It's the exact scenario described by the Paradox of Tolerance, but that's just a matter of non-ideal outcomes to absolute policies, not a true logical contradiction.
Granted, the logic typically in use is driven by double-think...