They are classed as environmental objects and thus can not be destroyed, just like the light ships marking shoals. The only reason you are alerted to their presence is the small boats parked next to them. Without the small boats, your watch crew would not "see" them and call them out.
