Yup! They even go underwater faster if you manage get them down
Oh, there's another reason not to fight aircraft - shooting one down on the attack run often ends in it crashing straight into your boat, which never ends well! While it wasn't that common historically, there were a few known incidents of the aircraft and u-boat successfully killing each other.