As far as we know, the Children were native to Westeros. There's no connection to the rest of the world. That said, the White Walkers are both intelligent and hateful. If they wanted to, they could use boats. Or possibly just freeze the Narrow Sea and march over, depending on the AoE of their freezing aura.