Yeah I, too, keep free view enabled. To me, a big part of the fun is the cinematic experience of watching things happen from the external camera view. It's like watching a movie where you direct the action. I even like watching the depth charges explode around my sub.
I tried turning it off for a while to be more realistic but then the game becomes 90% staring at the map screen listening to pings and explosions.