Sink them wherever you can. In real life they were supposed to take every opportunity they get to sink merchants. So no need to go to your patrol grid if they are within hearing distance. (Just make sure they are foe, not friends) Once you mopped them up, then you are free to search wherever you want.
