You can use we if you are referring to the fanbase and the organization. Saying “the ref screwed us” is accurate if you are a member of the fanbase of the team being screwed, because you are also suffering.
But saying “We scored 25 points in the last ten minutes to win the game”? No. Unless you personally scored some…