it comes down to stakes.
Would you actually enjoy a story where the Villains goal was the extermination of "Insert Nice People Here"?
On the other hand, there's a book I read a LOOOOOONG time ago... like, a decade ago, called "Xenocides", it involved multiple species but the race that got set...