iirc, he got blasted back towards the crack, so the light touched him almost immediately. Then the Doctor told Amy not to touch him, maybe based on the idea that the light tends to act a bit like electricity, and will flow into/around any touching bodies? Dunno, something like that.