Throwing a punch is as much of a skill as hitting a baseball. You may have the eye sight, power, coordination, dexterity, flexibility, et cetera, to excel, but if you haven't spent hours upon hours for many years with a bat in your hands swinging away at pitches, you'll have no hope. Likewise, if you haven't been practicing how to throw punches, you're not going to be very good
That is why if you ever do get in a fight, the chance of a punch in the face causing much damage is pretty low. Most guys don't know how to do it correctly