Other terms in general use which arose from sports:

Below the belt
Bullpen
Bullseye
Deadlock
Face-off
Fall guy
Game plan
Haymaker
Jump the gun
Keep an eye on the ball
Play the field
Real McCoy
Roll with the punches
Screwball
Throw in the towel
Up to scratch