Yep, Rare Earths are often found alongside radioactive ores.
I know of one that has a very large amount of radium and thorium, along with a lot of rare-earth gems and literal boulders of lithium ores, that was shut down after a couple years because the rads were so high the safety gear needed...