From what I've seen, I can sail right past neutral ships...warships included in broad daylight even and they will not attack....
UNLESS...
You put a shell or torpedo into a neutral ship in the area. Then they are more than happy to join the hunt for you!
