The game will penalize you for sinking any neutral ship. You will lose renown equal to that ship's "worth", and that country will consider you an enemy for 24 hours.
Here is a thread discussing how to deal with that.
http://www.subsim.com/radioroom/show...eutral+shippin