Who would serve the rich old dudes? Poor old dudes? If you look at things like resorts, the infrastructure needed to support them is far larger than just the staff. At that point, why go to some cursed land when you could go literally anywhere else?
It becomes effectively quarantined, as no one knows why it happened. Over time the population ages and their relevance economically goes down the drain, the island becomes an international penal colony.