At some point, if one looks like a duck, quacks like a duck, and acts like a duck, it can safely be called a duck. Or if it self admits to being a duck.
For a non-controversial example, take calling me an Anarcho-Capitalist. This would be an extremist position, but... A) I admit to it, (or...