For Kriegsmarine caps, I suggest this place:
http://www.lynx.net.uk/epicmilitaria...?recnumber=183
This is a reproduction cap which is in my opinion better than the alternative redone East German caps that can be found.
As for the 'Nazi' issue, I don't think it's fair to characterize the Kriegsmarine as 'nazi'. The Kriegsmarine was not a nazi organization, and it retained its own non-political identity throughout the nazi administration of Germany. The Kriegsmarine even refused the nazi's order to fire officers of Jewish descent. The commander of the Bismarck, Admiral Lutjens, was part-Jewish, as was at least one of his officers.
For more about Jewish soldiers under the nazis, check out:
http://www.kansaspress.ku.edu/righitpix.html