It certainly can put a damper on things...
From a realism point of view, the elements are a big part of the challenge. But it can get awfully frustrating when you start feeling like you're fighting with one hand (or at least one deck gun) tied behind your back.
