The last ship sunk by a U-Boat (U-853) was just off our shores.
http://www.usmm.org/blackpoint.html
PT boats and torpedos were also tested here and the first Seabee battalions were formed just down the road in Quonset RI. Pretty much the entire bay was turned into a giant Navy base for the duration.