If you have a true 5.1 surround set up (not a soundbar), just unhook the center channel speaker. If the network is doing an actual 5.1 broadcast, the announcers go to the center channel and the field/stadium sound gets sent to the front left and right speakers and rear surrounds.