I understand the concept. And yes, it would make sense, these castles are living beings, steeped in more mystery than any of us really understand. It would well be that finding something out about them is irreversible. Much like the person leaving the cave.

They're not fans of us, after all, we escaped a place full of disease. Maybe they're worried we still have it, and can spread it to them.