There are limits to taken (Not many) but he did try to Take the Guardians but he couldn't because of their Paracasuality. Guardians are also further referenced as immune by wearing Taken armor which we know can infect Vex who have molecular lvl manipulation so its a feat for Guardians.
And on...