Unless you are at Battle Stations, or otherwise have the Damage Control team activated for repairs, they are usually laying about the boat, smoking cigarettes, maybe trying to thieve some torp juice, or otherwise wasting good air with worthless conversations... In other words, they will not get fatigued in those positions, unless you put them to work.
