I have seen it once but I was modding the torpedo files at the time, so unless you were doing something similar it is a bit uncommon yeah.
Or it could just be sub-waterline doors or trans-dimensional weapons
I mean, the Japs have got lots of secret superweapons, didn't someone spot a UFO lately?