Did you build 'around' the market or add one in as a latter thought?
One thing with markets that I have learnt is that it should really have a Stockpile next to it. This ensures that any material that can be stockpiled doesn't take up space that could be better used by food items.
Just opened up my second seed, this time I'm going to plan the entire town layout first, pause everything and bring it online when needed. Let's see how that works out.
__________________
|