This is exactly why in any reasonable discussion about speed limits you’ll hear about the 85th percentile rule. Many traffic engineering manuals recommend measuring the 85th percentile speed on a road in free flowing conditions and then setting the limit above that point.