I take my sandals off when I drive with flip flops because they are too distracting to me. I think the main issue with driving with flip flops is in the case of an accident. You will most likely lose your flip flops and/or your feet could be seriously injured, so you’d end up walking around barefoot.