According to the Game of Thrones wiki, Olly bragged previously about his archery skill. Ygriette killed his father.