You're a u-boat, your job is to sink tonnage to prevent supplies from reaching England or it's armies. You shouldn't be attacking destroyers, that's a job for the surface fleet.
Use your best weapon against destroyers: stealth. Not being seen by them while sinking merchants is worth far more than sinking any number of escorts.
