usually when I'm in a situation like this:
1. I use my deck gun and finish them off
2. If option 1 is not possible then I stay at periscope depth and follow them until they sink. The hydrophones have quite a range so you can be quite far away but still get the kill when they sink