This is a tangent universe anyway. If they leave, they might just be going back to the primary universe or to a different universe. It's not like we know where people go when they leave. Maybe they're going someplace better.