Chesapeake Bay has a rich maritime history.
Mariner's Museum in Newport News, VA
http://www.marinersmuseum.org/
USPS Yorktown Battlefield
http://www.nps.gov/yonb/index.htm Been there numerous times though it's better to visit when it's warmer (spring or fall especially fall)
War of 1812 bicentenial up in Baltimore, sometime in June I think.
OH! Carl's Custard & Ice Cream in Fredericksburg, VA. can't miss that if you're in the area. While you gorge yourself on custard there's the Fredericksburg and Spotsylvannia Battlefields
http://www.nps.gov/frsp/index.htm
.