Originally in the comics Kryptonians weren't a space-faring race. But in the show yeah. Kara has mentioned having visited a dozen planets back in Season 1. Either space travel is common, in which case people can escape, or it's not. This is a major example of bad writing.